-- Logs begin at Tue 2022-08-30 17:19:05 UTC, end at Tue 2022-08-30 19:52:22 UTC. -- Aug 30 17:57:34.629545 n-d-854119-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 17:57:34.640214 n-d-854119-10 devstack@n-api.service[106654]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 17:57:34 2022] *** Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: nodename: n-d-854119-10 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: machine: x86_64 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: clock source: unix Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: pcre jit disabled Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: detected number of CPU cores: 4 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: current working directory: / Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: detected binary path: /usr/bin/uwsgi-core Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: your processes number limit is 47680 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: your memory page size is 4096 bytes Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: detected max file descriptor number: 2048 Aug 30 17:57:34.642322 n-d-854119-10 devstack@n-api.service[106654]: lock engine: pthread robust mutexes Aug 30 17:57:34.643727 n-d-854119-10 devstack@n-api.service[106654]: thunder lock: enabled Aug 30 17:57:34.643727 n-d-854119-10 devstack@n-api.service[106654]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 17:57:34.643727 n-d-854119-10 devstack@n-api.service[106654]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 17:57:34.684630 n-d-854119-10 devstack@n-api.service[106654]: Python main interpreter initialized at 0x5572f1d7d9c0 Aug 30 17:57:34.684630 n-d-854119-10 devstack@n-api.service[106654]: python threads support enabled Aug 30 17:57:34.684630 n-d-854119-10 devstack@n-api.service[106654]: your server socket listen backlog is limited to 100 connections Aug 30 17:57:34.684630 n-d-854119-10 devstack@n-api.service[106654]: your mercy for graceful operations on workers is 90 seconds Aug 30 17:57:34.685396 n-d-854119-10 devstack@n-api.service[106654]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 17:57:34.685396 n-d-854119-10 devstack@n-api.service[106654]: *** Operational MODE: preforking *** Aug 30 17:57:34.685608 n-d-854119-10 devstack@n-api.service[106654]: *** uWSGI is running in multiple interpreter mode *** Aug 30 17:57:34.685608 n-d-854119-10 devstack@n-api.service[106654]: spawned uWSGI master process (pid: 106654) Aug 30 17:57:34.685792 n-d-854119-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 17:57:34.690144 n-d-854119-10 devstack@n-api.service[106654]: spawned uWSGI worker 1 (pid: 106655, cores: 1) Aug 30 17:57:34.690144 n-d-854119-10 devstack@n-api.service[106654]: spawned uWSGI worker 2 (pid: 106656, cores: 1) Aug 30 17:57:34.690144 n-d-854119-10 devstack@n-api.service[106654]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 17:57:35.390261 n-d-854119-10 devstack@n-api.service[106656]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:57:35.405023 n-d-854119-10 devstack@n-api.service[106655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 17:57:36.539312 n-d-854119-10 devstack@n-api.service[106656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:57:36.539312 n-d-854119-10 devstack@n-api.service[106656]: from cryptography.utils import int_from_bytes Aug 30 17:57:36.540234 n-d-854119-10 devstack@n-api.service[106656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:57:36.540234 n-d-854119-10 devstack@n-api.service[106656]: from cryptography.utils import int_from_bytes Aug 30 17:57:36.547522 n-d-854119-10 devstack@n-api.service[106655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:57:36.547522 n-d-854119-10 devstack@n-api.service[106655]: from cryptography.utils import int_from_bytes Aug 30 17:57:36.548848 n-d-854119-10 devstack@n-api.service[106655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 17:57:36.548848 n-d-854119-10 devstack@n-api.service[106655]: from cryptography.utils import int_from_bytes Aug 30 17:57:39.209541 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:57:39.210412 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:57:39.210412 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:57:39.210718 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:57:39.210975 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:57:39.211371 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.211701 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.212022 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.212340 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.212673 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.212981 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.213301 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.213617 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.213947 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.214205 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.214546 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.214866 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.215184 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.215580 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.215851 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.216171 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.216590 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.217162 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.217511 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.218029 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.218511 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.218953 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.219217 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.219567 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.219881 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.220189 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.220508 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.220810 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.221135 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.221445 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.221876 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.222203 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.222540 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.222852 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.223281 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.223592 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.223900 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.224220 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.224553 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.224853 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.225172 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.225488 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.225807 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.226124 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.226451 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.226760 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.227069 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.227394 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.227698 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.228000 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.228247 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.228551 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.228875 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.229195 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.229516 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.229763 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.230011 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.230326 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.230678 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.230985 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.231287 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.231594 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.232429 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.232749 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.233121 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.233433 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.233741 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.234070 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.234409 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.234737 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.235045 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.235370 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.235778 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.236026 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.236331 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.236675 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.236994 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.237301 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.237620 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.237939 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.238242 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.238577 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.238881 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.239200 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.239538 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.239841 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.240087 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.240388 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.240690 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.241006 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.241312 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.241614 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.241921 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.242446 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.242612 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.242843 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.243145 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.243448 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.243751 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.244053 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.244353 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.244656 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.244960 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.245297 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.245613 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.245923 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.246227 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.246431 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 17:57:39.247125 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.247260 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 17:57:39.247449 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.247449 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.247815 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 17:57:39.248068 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.248359 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.248507 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 17:57:39.248787 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 17:57:39.248945 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.249411 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.249588 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.249731 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250041 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250218 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250441 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250619 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250790 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.250980 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.251508 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.251661 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.251916 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252084 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252238 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252525 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252695 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252829 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.252958 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253103 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253228 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253418 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253661 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253833 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.253989 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.254129 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.254304 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.254607 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.254778 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.254933 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.255165 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.255319 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.255526 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.255725 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.255926 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.256104 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.256281 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.256478 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.256713 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.256871 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.257055 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.257279 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.257446 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.257721 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.257870 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.258066 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.258285 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.258514 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.258702 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.258855 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.258996 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.259316 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.259619 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.259809 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.259954 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.260144 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.260305 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.260536 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.260696 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.260838 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.261118 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.261269 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.261444 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.261677 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.261842 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.262083 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.262230 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.262428 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.262727 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.262972 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.263128 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.263244 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.263459 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.263907 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.264317 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.264827 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.264993 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.265267 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.265416 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.265603 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.265838 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.266041 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.266267 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.266480 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.266688 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.266957 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.267105 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.267287 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.267557 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.267709 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.267912 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.268073 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.268269 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.268523 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.268688 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.268829 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.269082 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.269248 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.269461 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.269609 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.269782 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.270093 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.270259 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.270436 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.270655 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.270825 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.271031 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.271191 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.271350 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.271637 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.271786 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.271943 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.272169 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.272332 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.272576 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.272721 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.272886 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.273199 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.273370 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.273506 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.273651 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.273798 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.273928 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.274116 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.274331 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.274594 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.274741 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.274898 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.275132 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.275288 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.275508 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.275695 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.275847 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.276034 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.276241 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.276394 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.276664 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.276898 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.277054 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.277209 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.277366 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.277596 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.277774 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.277931 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.278136 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.278289 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.278715 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.278923 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.279098 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.279404 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.279621 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.279892 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.280122 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.280376 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.280545 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.280733 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.280909 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.281058 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.281364 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.281707 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.281869 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.282014 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.282157 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.282310 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.282535 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.282692 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.282905 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.283051 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.283233 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.283493 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.283647 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.283813 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.284030 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.284181 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.284418 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.284578 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.284734 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.285021 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.285184 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.285357 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.285560 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.285706 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.285979 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.286212 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.286448 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.286634 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.286785 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.286980 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.287189 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.287340 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.287531 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.287775 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.287941 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.288103 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.288318 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.288483 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.288699 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.288899 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.289048 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.289290 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.289452 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.289595 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.289851 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.290005 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.290151 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.290428 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.290601 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.290785 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.290930 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.291074 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.291375 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.291527 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.291691 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.291914 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.292067 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.292293 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.292441 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.292639 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.292975 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.293126 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.293271 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.293456 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.293673 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.293894 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.294061 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.294524 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.294677 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.294999 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.295166 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.295474 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.295628 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.295895 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.296043 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.296188 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.296448 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.296666 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.296816 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.296957 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.297160 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.297414 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.297561 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.297718 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.297962 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.298116 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.298702 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.298846 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.299009 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.299311 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.299463 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.299650 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.299835 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.299986 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.300286 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.300452 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.300597 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.300821 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.300972 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.301199 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.301369 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.301528 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.301802 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.301951 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.302096 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.302334 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.302533 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.302736 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.302893 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.303037 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.303348 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.303497 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.303656 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.303858 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.304009 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.304257 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.304402 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.304560 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.304836 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.305000 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.305144 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.305370 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.305521 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.305800 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.305972 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.306116 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.306387 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.306607 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.306802 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.307018 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.307180 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.307385 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.307554 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.307705 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.307926 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.308086 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.308231 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.308524 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.308675 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.308818 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.309051 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.309378 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.309528 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.309668 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.309867 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.310142 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.310591 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.310767 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.311127 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.311419 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.311629 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.311787 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.311940 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.312085 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.312307 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.312469 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.312624 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.312932 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.313099 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.313244 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.313454 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.313618 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.313922 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.314136 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.314295 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.314482 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.314631 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.314911 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.315059 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.315204 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.315501 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.315651 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.315845 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.316029 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.316180 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.316433 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.316621 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.316764 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.317012 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.317164 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.317341 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.317549 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.317708 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.317949 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.318095 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.318239 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.318571 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.318756 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.318886 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.319101 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.319252 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.319475 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.319670 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 17:57:39.319832 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.320068 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.320297 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.320450 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.320674 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.320872 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.321035 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.321270 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.321505 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.321657 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.321858 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.322025 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.322241 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.322567 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.322742 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.323118 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.323272 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.323488 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.323636 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.323777 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.324099 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.324309 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.324470 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.324629 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.324772 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.325075 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.325243 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.325441 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.325674 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.326031 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.326270 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.326591 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.326915 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327115 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327264 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327459 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327631 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327847 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.327992 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.328136 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.328439 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.328610 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.328769 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329058 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329280 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329424 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329616 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329786 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.329940 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.330081 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.330224 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.330495 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.330643 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.330805 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331091 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331255 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331399 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331652 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331816 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.331979 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.332205 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.332368 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.332564 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.332735 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.332900 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.333195 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.333343 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.333485 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.333781 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.333940 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.334134 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.334443 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.334597 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.334793 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.334990 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.335142 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.335404 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.335551 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.335706 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.335993 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.336145 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.336360 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.336508 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.336653 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.336960 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.337109 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.337336 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.337574 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.337752 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.338067 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.338222 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.338513 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.338764 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.338937 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.339094 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.339317 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.339470 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.339780 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.339941 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.340090 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.340378 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.340557 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.340703 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.340917 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.341705 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.341705 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.342072 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.342218 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.342471 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.342689 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.342906 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343054 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343054 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343315 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343471 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343653 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.343923 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344069 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344248 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344408 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344605 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344826 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.344993 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.345137 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.345369 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.345524 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.345744 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.345889 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.346048 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.346334 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.346514 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.346642 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.346913 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.347080 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.347226 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.347484 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.347692 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.347838 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.348133 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.348309 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.348453 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.348655 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.348808 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349009 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349180 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349361 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349671 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349826 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.349981 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.350267 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.350478 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.350644 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.350826 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.350980 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.351178 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.351379 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.351551 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.351790 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.351951 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.352096 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.352383 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.352546 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.352702 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.352940 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.353093 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.353309 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.353468 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.353611 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.353926 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.354080 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.354226 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.354490 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.354655 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.354877 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.355039 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.355182 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.355470 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.355622 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.355779 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.356005 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.356158 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.356365 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.356529 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.356975 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.357142 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.357454 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.357657 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.357808 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.358004 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.358169 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.358461 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.358631 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.358777 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.359077 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.359229 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.359374 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.359613 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.359790 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360013 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360213 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360373 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360619 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360791 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.360936 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.361152 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.361305 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.361518 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.361677 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.361834 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.362122 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.362283 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.362478 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.362688 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.362853 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363052 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363254 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363407 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363653 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363800 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.363944 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.364240 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.364392 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.364536 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.364788 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365002 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365165 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365365 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365516 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365725 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.365871 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.366017 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.366318 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.366578 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.366723 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.366919 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.367095 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.367368 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.367530 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.367675 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.367903 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.368065 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.368255 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.368435 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.368586 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.368865 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.369015 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.369159 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.369396 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.369563 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.369862 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.370022 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.370185 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.370494 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.370646 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.370807 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371014 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371165 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371381 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371526 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371684 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.371985 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.372138 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.372350 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.372646 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.372959 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.373145 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.373444 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.373681 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.373950 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.374103 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.374314 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.374551 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.374773 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.374985 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.375130 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.375382 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.375531 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.375799 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.375951 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.376094 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.376410 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.376545 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.376729 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.376933 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.377097 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.377362 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.377522 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.377668 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.377972 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.378192 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.378371 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.378568 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.378786 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.378939 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.379200 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.379352 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.379509 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.379739 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.379891 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.380118 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.380391 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.380589 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.380735 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.380897 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.381041 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.381297 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.381468 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.381756 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.381918 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.382058 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.382311 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.382569 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.382736 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.382879 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.383021 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.383302 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.383452 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.383609 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.383901 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384050 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384192 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384434 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384588 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384800 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.384992 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.385185 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.385485 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.385622 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.385793 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.386080 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.386233 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.386406 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.386632 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.386787 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.387010 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.387180 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.387324 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.387635 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.387785 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.388053 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.388250 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.388475 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.388743 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.388948 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.389275 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.389441 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.389741 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.389901 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.390046 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.390330 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.390583 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.390729 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.390868 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.391013 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.391291 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.391441 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.391612 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.391855 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.392022 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.392274 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.392423 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.392580 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.392868 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.393019 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.393219 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.393398 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.393564 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.393837 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.394054 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.394230 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.394492 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.394643 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.394807 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395085 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395253 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395413 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395612 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395747 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.395976 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.396134 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.396277 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.396574 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.396722 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.396879 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.397114 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.397267 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.397471 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.397732 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.397894 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.398081 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.398299 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.398568 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.398746 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.398899 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.399095 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.399301 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.399446 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.399592 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.399883 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.400035 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.400226 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.400415 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.400565 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.400851 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401016 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401172 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401453 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401605 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401750 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.401969 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.402134 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.402394 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.402541 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.402687 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.402987 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.403162 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.403306 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.403592 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.403747 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.404101 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.404269 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.404576 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.404730 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.405044 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.405195 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.405518 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.405712 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406023 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406177 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406324 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406594 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406754 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.406975 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.407143 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.407288 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.407574 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.407729 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.407888 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.408129 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.408280 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.408500 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.408731 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.408883 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.409131 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.409343 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.409528 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.409780 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.409934 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.410184 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.410383 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.410552 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.410792 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.410944 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.411189 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.411392 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.411566 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.411801 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.411954 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.412110 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.412350 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.412519 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.412708 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.412883 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.413044 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.413326 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.413489 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.413632 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.413911 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414065 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414209 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414475 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414627 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414843 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.414991 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.415151 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.415454 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.415602 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.415745 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.415999 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.416209 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.416396 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.416543 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.416715 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.417025 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.417304 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.417304 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.417569 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.417714 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.418028 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.418195 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.418520 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.418669 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.418864 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.419121 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.419321 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.419538 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.420017 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.420170 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.420486 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.420650 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.420899 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.421064 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.421264 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.421495 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.421644 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.421813 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.422023 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.422189 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.422439 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.422609 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.422781 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.423090 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.423613 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.423770 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.423972 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.424123 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.424346 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.424494 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.424892 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.425042 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.425259 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.425406 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.425577 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.425890 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.426056 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.426194 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.426550 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.426794 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.426945 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.427167 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.427337 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.427483 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.427765 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.427914 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428056 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428311 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428448 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428663 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428845 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.428992 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.429264 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.429454 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.429767 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.429935 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.430059 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.430216 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.430463 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.430610 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.430877 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.431157 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.431368 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.431589 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.431750 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.431896 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432070 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432217 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432377 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432649 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432803 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.432949 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.433164 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.433329 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.433620 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.433784 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.433942 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.434182 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.434421 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.434572 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.434849 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.435262 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.435423 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.435725 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.436000 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.436160 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.436343 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.436546 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.436791 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.442901 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443090 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443263 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443417 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443417 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443717 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.443870 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444017 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444187 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444187 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444457 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444605 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444750 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444895 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.444895 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445189 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445334 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445480 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445625 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445768 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445931 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.445931 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.446211 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.446501 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.446727 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.446904 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.446904 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447182 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447320 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447470 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447619 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447619 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.447908 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448136 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448136 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448422 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448586 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448586 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.448864 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449008 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449008 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449280 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449425 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449554 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449710 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449710 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.449960 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450103 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450103 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450413 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450602 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450602 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450867 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.450992 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451155 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451295 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451295 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451568 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451715 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.451942 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452094 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452094 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452367 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452513 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452659 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452822 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.452822 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453199 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453356 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453506 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453652 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453652 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.453941 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454088 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454248 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454469 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454621 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454621 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454915 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.454915 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455189 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455320 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455483 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455631 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455631 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.455881 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456020 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456156 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456314 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456314 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456646 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456792 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.456921 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457066 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457066 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457336 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457489 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457839 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457991 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.457991 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.458277 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.458434 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.458586 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.458733 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.458733 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459006 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459167 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459167 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459489 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459782 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.459782 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460094 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460227 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460227 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460477 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460624 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.460624 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461135 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461276 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461430 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461577 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461577 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.461861 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462001 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462001 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462260 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462444 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462444 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462731 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462875 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.462875 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463133 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463291 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463434 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463599 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463599 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.463865 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464009 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464009 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464304 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464564 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464564 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464832 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.464978 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465124 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465294 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465442 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465599 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465727 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.465883 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466048 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466209 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466410 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466556 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466713 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.466868 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467006 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467169 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467308 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467500 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467649 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.467820 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.468090 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.468261 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.468406 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.468650 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.468805 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.469016 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.469188 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.469336 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.469645 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.469856 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470010 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470242 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470454 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470605 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470835 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.470991 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.471207 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.471346 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.471568 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.471875 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.472019 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.472164 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.472461 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.472627 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.472787 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.473089 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.473240 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.473383 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.473689 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.474267 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.474579 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.474727 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.474890 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.474890 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475173 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475331 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475471 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475618 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475779 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.475936 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.476088 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.476246 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.476391 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.476531 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.476843 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477014 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477170 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477374 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477529 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477773 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.477921 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.478092 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.478335 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.478636 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.478789 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.478954 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479114 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479255 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479416 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479563 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479699 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.479837 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480032 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480191 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480348 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480495 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480644 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480789 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480886 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.480972 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.481135 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.481229 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.481450 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.481554 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.481938 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.482206 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.482481 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.482624 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.482798 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.482985 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483138 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483305 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483452 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483595 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483738 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.483967 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:57:39.484116 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.484307 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.484618 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.484924 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.485232 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.485534 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.485976 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.486288 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.486754 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.486983 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.487228 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.487537 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.487851 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.488196 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.488467 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.488891 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.489223 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.489589 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.489898 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.490203 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.490532 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.490842 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.491166 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.491466 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.491905 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.492219 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.492541 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.492846 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.493168 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.493595 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.493907 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.494210 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.494679 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.495085 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.495400 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.495727 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.496043 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.496368 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.496748 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.497065 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.497409 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.497733 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.498055 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.498432 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.498783 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.499091 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.499411 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.499730 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.500107 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.500644 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.501324 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.501866 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.502278 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.502833 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.503334 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.503655 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.504119 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.504898 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.506493 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.506822 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.507243 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.507568 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.507893 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.508212 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.508549 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.508916 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.509230 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.509558 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.509868 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.510201 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.510531 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.510867 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.511208 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.511578 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.511906 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.512217 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.512514 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.512963 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.513419 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.514059 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.514410 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.514743 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.515084 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.515419 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.515732 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.516071 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.516405 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.516728 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.517042 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.517363 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.517686 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.517993 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.518299 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.518640 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.518944 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.519252 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.519558 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.519866 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.520169 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.520473 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.520780 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.521107 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.521411 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.521730 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.522037 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.522371 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.522672 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.522976 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.523319 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.523622 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.523953 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.525561 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.525907 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.526275 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.526642 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.526974 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.527292 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.527616 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.528043 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.528456 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.529266 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.529591 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.530025 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.530460 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.531073 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.531407 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.531930 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.533512 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.533880 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.534209 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.534568 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.534892 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.535212 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.535530 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.535849 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.536195 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.536527 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.536864 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.537209 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.537534 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.537854 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.538172 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.541819 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.542332 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.542739 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.543049 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.543397 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.543760 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.544363 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.544555 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.544830 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.545111 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.545441 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.545770 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.546093 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.546456 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.546816 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.547135 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.547773 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.548156 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.548792 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.549114 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.549444 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.550040 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.550416 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.550738 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.551073 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.551467 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.551743 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.552129 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.552370 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.552683 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.552996 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.553313 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.553625 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.553933 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.554268 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.554616 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.554924 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.555253 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.555566 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.556175 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.556539 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.556861 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.557192 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.557519 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.557838 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.558148 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.558505 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.558816 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.559125 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.559442 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.559756 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.560090 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.560397 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.560715 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.561027 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.561331 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.561678 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.561939 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.562270 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.562608 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.562912 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.563218 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.563528 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.563835 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.564144 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.564450 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.564750 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.565065 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.565370 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.565681 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.565989 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.566299 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.566655 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.567020 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.567324 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.567662 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.567971 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.568274 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.568598 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.568911 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.569240 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.569555 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.569870 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.570236 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.570589 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.571193 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.571528 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.571956 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.572229 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.572515 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.572832 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.573137 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.573439 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.573774 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.574094 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.574435 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.574751 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.575062 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.575402 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.575817 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.576048 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.576425 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.576866 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.577182 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.577495 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.577810 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.578127 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.578466 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.578792 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.579151 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.579473 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.579788 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.580106 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.580425 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.580735 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.581043 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.581352 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.581664 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.581981 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.582332 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.582675 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.582984 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.583432 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.583745 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.584062 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.584382 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.584691 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.585016 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.585339 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.585649 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.585970 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.586277 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.586646 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.586987 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.587314 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.587635 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.587939 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.588243 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.588545 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.588858 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.589179 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.589488 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.589791 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.590100 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.590450 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.590760 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.591134 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.591408 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.591954 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.592301 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.592691 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.592999 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.593305 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.593609 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.593914 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.594217 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.594562 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.594872 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.595178 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.595482 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.595900 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.596210 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.596561 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.596894 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.597217 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.597539 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.597854 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.598176 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.598513 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.598837 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.599160 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.599480 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.599790 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.600127 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.600436 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.600750 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.601062 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.601597 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.601796 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.602001 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.602570 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.602899 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.603208 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.603537 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.603861 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.604193 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.604520 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.604833 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.605167 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.605480 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.605788 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.606105 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.606444 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.606919 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.607270 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.607666 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.607979 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.608298 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.608618 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.608960 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.609288 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.609599 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.609925 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.610254 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.610646 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.610966 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.611320 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.611647 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.611961 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.612274 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.612579 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 17:57:39.612819 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 17:57:39.657339 n-d-854119-10 devstack@n-api.service[106656]: INFO dbcounter [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Registered counter for database nova_api Aug 30 17:57:39.681341 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_db.sqlalchemy.engines [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.695947 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writer thread running {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.766896 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.context [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=106656) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:57:39.771459 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.771752 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.773278 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:39.774131 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.774690 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.776855 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_concurrency.lockutils [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:39.779691 n-d-854119-10 devstack@n-api.service[106656]: INFO dbcounter [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Registered counter for database nova_cell0 Aug 30 17:57:39.785623 n-d-854119-10 devstack@n-api.service[106656]: INFO dbcounter [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Registered counter for database nova_cell1 Aug 30 17:57:39.796084 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_db.sqlalchemy.engines [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.797484 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_db.sqlalchemy.engines [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.804746 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writer thread running {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.806649 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writer thread running {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.819225 n-d-854119-10 devstack@n-api.service[106655]: INFO dbcounter [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Registered counter for database nova_api Aug 30 17:57:39.843123 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_db.sqlalchemy.engines [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.851126 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writer thread running {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.928630 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.context [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=106655) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 17:57:39.934276 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.935036 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.936795 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:39.939234 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:57:39.939234 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:57:39.941382 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:57:39.943828 n-d-854119-10 devstack@n-api.service[106655]: INFO dbcounter [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Registered counter for database nova_cell0 Aug 30 17:57:39.950074 n-d-854119-10 devstack@n-api.service[106655]: INFO dbcounter [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Registered counter for database nova_cell1 Aug 30 17:57:39.967170 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_db.sqlalchemy.engines [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.968173 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_db.sqlalchemy.engines [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.969825 n-d-854119-10 devstack@n-api.service[106656]: INFO dbcounter [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Registered counter for database nova_cell0 Aug 30 17:57:39.976222 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writer thread running {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.978169 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writer thread running {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:39.979562 n-d-854119-10 devstack@n-api.service[106656]: DEBUG oslo_db.sqlalchemy.engines [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:39.989255 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writer thread running {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:40.178077 n-d-854119-10 devstack@n-api.service[106655]: INFO dbcounter [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Registered counter for database nova_cell0 Aug 30 17:57:40.189553 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_db.sqlalchemy.engines [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 17:57:40.195768 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writer thread running {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 17:57:40.506237 n-d-854119-10 devstack@n-api.service[106656]: WARNING keystonemiddleware.auth_token [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:57:40.517212 n-d-854119-10 devstack@n-api.service[106656]: WARNING keystonemiddleware.auth_token [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:57:40.565732 n-d-854119-10 devstack@n-api.service[106655]: WARNING keystonemiddleware.auth_token [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:57:40.572068 n-d-854119-10 devstack@n-api.service[106655]: WARNING keystonemiddleware.auth_token [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:57:40.959296 n-d-854119-10 devstack@n-api.service[106655]: WARNING keystonemiddleware.auth_token [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:57:40.965655 n-d-854119-10 devstack@n-api.service[106655]: WARNING keystonemiddleware.auth_token [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:57:40.972385 n-d-854119-10 devstack@n-api.service[106655]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572f1d7d9c0 pid: 106655 (default app) Aug 30 17:57:40.974726 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:57:40.975958 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001955 Aug 30 17:57:40.976749 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Aug 30 17:57:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:57:40.976893 n-d-854119-10 devstack@n-api.service[106656]: WARNING keystonemiddleware.auth_token [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 17:57:40.983377 n-d-854119-10 devstack@n-api.service[106656]: WARNING keystonemiddleware.auth_token [None req-63ed094e-f8da-48ab-afdc-96fdb17a03d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 17:57:40.988968 n-d-854119-10 devstack@n-api.service[106656]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572f1d7d9c0 pid: 106656 (default app) Aug 30 17:59:15.497748 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:15.499527 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002442 Aug 30 17:59:15.500643 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:15.519264 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_api:SELECT=3 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:15.520716 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_cell0:SELECT=3 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:15.522683 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_cell1:SELECT=3 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:15.524400 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:16.852192 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-352b252c-abb6-46b5-8daf-cc2f0eb576dd admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:16.905996 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-352b252c-abb6-46b5-8daf-cc2f0eb576dd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.395557 Aug 30 17:59:16.906981 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 17:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:19.998603 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:20.001397 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-fdb83f59-4efe-4ed0-9f46-fd3631cee5f2 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003418 Aug 30 17:59:20.002172 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:20.623151 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8b79b799-8fe5-4445-9ece-5c914ad148e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:20.689739 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-8b79b799-8fe5-4445-9ece-5c914ad148e6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.679858 Aug 30 17:59:20.698759 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:20.947294 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-c2a27250-3928-4a0e-ad52-12c34ff07f60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:20.954626 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_api:SELECT=3 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:20.955454 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_cell1:SELECT=3 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:20.956857 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_cell0:SELECT=3 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:20.957893 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_cell0:SELECT=3 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:21.047539 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-c2a27250-3928-4a0e-ad52-12c34ff07f60 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.346349 Aug 30 17:59:21.048727 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 17:59:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:24.030930 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8b79b799-8fe5-4445-9ece-5c914ad148e6 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:24.033058 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-8b79b799-8fe5-4445-9ece-5c914ad148e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003143 Aug 30 17:59:24.034250 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:25.247828 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-6437cc59-641f-4e9e-99c1-4c0dcb9a2518 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:25.318117 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-6437cc59-641f-4e9e-99c1-4c0dcb9a2518 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.276093 Aug 30 17:59:25.320824 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:59:25.344478 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-badee5f7-7b68-4bdd-88e4-fe042155e899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:25.415096 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-badee5f7-7b68-4bdd-88e4-fe042155e899 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082695 Aug 30 17:59:25.415960 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 17:59:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:28.279026 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-6437cc59-641f-4e9e-99c1-4c0dcb9a2518 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:28.281261 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-6437cc59-641f-4e9e-99c1-4c0dcb9a2518 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002729 Aug 30 17:59:28.287990 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:28.793457 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8dd030e6-6b3c-4623-9d67-0454ad19682d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:28.818407 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-8dd030e6-6b3c-4623-9d67-0454ad19682d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528992 Aug 30 17:59:28.819349 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:59:28.832265 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-cc9d84a2-ce96-41fc-a363-c9f7acf47e60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:28.872659 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-cc9d84a2-ce96-41fc-a363-c9f7acf47e60 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040475 Aug 30 17:59:28.872659 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 17:59:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:31.600762 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8dd030e6-6b3c-4623-9d67-0454ad19682d admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:31.601799 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-8dd030e6-6b3c-4623-9d67-0454ad19682d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 30 17:59:31.602955 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:59:32.249737 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-5aa80897-3066-46e6-91f9-8d06eec27f07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "name": "ds2G", "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:32.273395 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-5aa80897-3066-46e6-91f9-8d06eec27f07 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.659994 Aug 30 17:59:32.274388 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:32.295222 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-6a1051c2-ab8b-4410-a1f7-4aa4608fe414 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:32.340694 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-6a1051c2-ab8b-4410-a1f7-4aa4608fe414 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052105 Aug 30 17:59:32.341298 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 17:59:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:35.568779 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-5aa80897-3066-46e6-91f9-8d06eec27f07 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:35.569830 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-5aa80897-3066-46e6-91f9-8d06eec27f07 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 30 17:59:35.570618 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:59:36.442090 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "disk": 20}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:36.479681 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.896054 Aug 30 17:59:36.481619 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:36.500192 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-eeae24e3-ff0f-40ca-9e58-6186286258b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:36.538884 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-eeae24e3-ff0f-40ca-9e58-6186286258b8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045099 Aug 30 17:59:36.538884 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 17:59:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:59:39.647714 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:39.651163 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004101 Aug 30 17:59:39.653386 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:40.538874 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-bc909a21-8828-4376-b1bb-0984fdca4672 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:40.586608 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-bc909a21-8828-4376-b1bb-0984fdca4672 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.926592 Aug 30 17:59:40.603157 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 17:59:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 17:59:44.583079 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:44.584863 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-88f297ea-9335-4d1b-ad92-60076dfc7073 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002510 Aug 30 17:59:44.586518 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:45.195681 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-4ee73819-d35c-4b69-8367-128a06524bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "id": "1"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:45.227221 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-4ee73819-d35c-4b69-8367-128a06524bf4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.629094 Aug 30 17:59:45.228238 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:45.245163 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-b14b10c0-9049-46a1-a692-d8d5a5174e10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:45.277399 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-b14b10c0-9049-46a1-a692-d8d5a5174e10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036919 Aug 30 17:59:45.278262 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 17:59:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:59:48.324665 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-4ee73819-d35c-4b69-8367-128a06524bf4 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:48.325915 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-4ee73819-d35c-4b69-8367-128a06524bf4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Aug 30 17:59:48.326490 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:48.884383 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-e27a8bb1-dc5b-402f-8c40-18758da80399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:48.895035 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:48.920513 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-e27a8bb1-dc5b-402f-8c40-18758da80399 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.586565 Aug 30 17:59:48.921526 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:48.940966 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-24cb220c-2267-4a48-8f90-85ef2ceebd90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:48.976605 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-24cb220c-2267-4a48-8f90-85ef2ceebd90 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040560 Aug 30 17:59:48.977263 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 17:59:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:51.585733 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-e27a8bb1-dc5b-402f-8c40-18758da80399 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:51.587056 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-e27a8bb1-dc5b-402f-8c40-18758da80399 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 30 17:59:51.587978 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:59:52.098515 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-ddf32edc-33cf-468f-815f-243430b32224 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 40, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:52.105869 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:59:52.134839 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-ddf32edc-33cf-468f-815f-243430b32224 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.538356 Aug 30 17:59:52.135835 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:52.167611 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-88683a0d-2648-4162-80ee-ca706567fbf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:52.211747 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-88683a0d-2648-4162-80ee-ca706567fbf9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060233 Aug 30 17:59:52.212659 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 17:59:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:54.899439 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-ddf32edc-33cf-468f-815f-243430b32224 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:54.901199 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-ddf32edc-33cf-468f-815f-243430b32224 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002448 Aug 30 17:59:54.902042 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:55.629691 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-24c6b452-6eec-443f-8869-80e885739180 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:55.660370 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-24c6b452-6eec-443f-8869-80e885739180 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.750588 Aug 30 17:59:55.661609 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 17:59:55.687881 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-459bd00f-d50d-44f3-be6f-5e81252bbc7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:55.741681 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-459bd00f-d50d-44f3-be6f-5e81252bbc7a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062155 Aug 30 17:59:55.743457 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 17:59:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:59:58.949090 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-24c6b452-6eec-443f-8869-80e885739180 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:59:58.950929 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-24c6b452-6eec-443f-8869-80e885739180 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002439 Aug 30 17:59:58.951666 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 17:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:59:59.837532 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:59.866933 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.902489 Aug 30 17:59:59.867838 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 17:59:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:59:59.887003 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-7aa03a3d-c089-45b0-bd62-afdcbc10b7d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:59:59.924006 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-7aa03a3d-c089-45b0-bd62-afdcbc10b7d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041852 Aug 30 17:59:59.924973 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 17:59:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:00:22.499209 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:22.500705 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002454 Aug 30 18:00:22.501366 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 18:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:22.513741 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:23.085744 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-bfdfd356-e959-435e-8ca3-7686d3e2a7eb admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:23.108628 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-bfdfd356-e959-435e-8ca3-7686d3e2a7eb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.599398 Aug 30 18:00:23.109445 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:00:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:00:24.452285 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:24.453512 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-f57efc86-54cc-4f59-94b5-0cc66f88d35e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 30 18:00:24.453943 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:25.202084 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-cbf878a9-60f9-4d33-a3ba-d8eba84d84fa admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:25.209309 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.wsgi [None req-cbf878a9-60f9-4d33-a3ba-d8eba84d84fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-cbf878a9-60f9-4d33-a3ba-d8eba84d84fa admin admin] Request method failure captured: Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Accept: application/json Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Accept-Encoding: gzip, deflate Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Connection: keep-alive Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Content-Length: 0 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Host: 10.222.0.25 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: Openstack-System-Scope: None Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: User-Agent: python-novaclient Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Auth-Token: gAAAAABjDlA48bd--GKVk-ih9FjGQe7dGC9xQrS7X_xOV9PSQDw3DJ1f8Mi1j7QkCGSJnQkobOD_RaU_46iQYygWAxbrT_V_SHj21CeuKi_2TzF4NegNmbWCbuX-XpNeUrsSLAItdB6xwRJBk1Z1bxVdvNMaQUv84jnh97aki-JscalTsrgUSgY Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Id: None Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Name: None Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Identity-Status: Confirmed Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Is-Admin-Project: True Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Id: default Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Name: Default Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Name: admin Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Role: reader,member,admin Aug 30 18:00:25.212748 n-d-854119-10 devstack@n-api.service[106656]: X-Roles: reader,member,admin Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant: admin Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Name: admin Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-User: admin Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Id: default Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Name: Default Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: X-User-Name: admin Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: method: > Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: exception: Flavor 42 could not be found. Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: action_args: {'id': '42'} Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:25.216810 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:25.218428 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.220463 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-cbf878a9-60f9-4d33-a3ba-d8eba84d84fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:25.222292 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-cbf878a9-60f9-4d33-a3ba-d8eba84d84fa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.546633 Aug 30 18:00:25.222292 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:00:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 548 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:25.227787 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-52bea491-c9a3-4f93-8c24-d358e4c61c3b admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:25.232388 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:00:25.254385 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-52bea491-c9a3-4f93-8c24-d358e4c61c3b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030269 Aug 30 18:00:25.254997 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:25.275452 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-465b9c6d-c9bb-4195-86a9-a64b862b33c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:25.301498 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-465b9c6d-c9bb-4195-86a9-a64b862b33c8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029708 Aug 30 18:00:25.302124 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:25.312698 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-8bb0e4df-98bf-40bf-aad7-d3c50c2321eb admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:25.319809 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.wsgi [None req-8bb0e4df-98bf-40bf-aad7-d3c50c2321eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-8bb0e4df-98bf-40bf-aad7-d3c50c2321eb admin admin] Request method failure captured: Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Accept: application/json Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Accept-Encoding: gzip, deflate Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Connection: keep-alive Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Content-Length: 0 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Host: 10.222.0.25 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: Openstack-System-Scope: None Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: User-Agent: python-novaclient Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Auth-Token: gAAAAABjDlA48bd--GKVk-ih9FjGQe7dGC9xQrS7X_xOV9PSQDw3DJ1f8Mi1j7QkCGSJnQkobOD_RaU_46iQYygWAxbrT_V_SHj21CeuKi_2TzF4NegNmbWCbuX-XpNeUrsSLAItdB6xwRJBk1Z1bxVdvNMaQUv84jnh97aki-JscalTsrgUSgY Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Id: None Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Name: None Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Identity-Status: Confirmed Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Is-Admin-Project: True Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Id: default Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Name: Default Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Name: admin Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Role: reader,member,admin Aug 30 18:00:25.323231 n-d-854119-10 devstack@n-api.service[106655]: X-Roles: reader,member,admin Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant: admin Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Name: admin Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-User: admin Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Id: default Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Name: Default Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: X-User-Name: admin Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: method: > Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: exception: Flavor 42 could not be found. Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: action_args: {'id': '42'} Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:25.325655 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:25.327008 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:25.329218 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-8bb0e4df-98bf-40bf-aad7-d3c50c2321eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:25.331320 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-8bb0e4df-98bf-40bf-aad7-d3c50c2321eb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015976 Aug 30 18:00:25.331320 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:00:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:26.418777 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-465b9c6d-c9bb-4195-86a9-a64b862b33c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:26.419866 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-465b9c6d-c9bb-4195-86a9-a64b862b33c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Aug 30 18:00:26.420378 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:27.182856 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-11aecaa4-7565-4598-9415-f1ef26bd0ce1 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:27.189523 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.wsgi [None req-11aecaa4-7565-4598-9415-f1ef26bd0ce1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-11aecaa4-7565-4598-9415-f1ef26bd0ce1 admin admin] Request method failure captured: Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Accept: application/json Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Accept-Encoding: gzip, deflate Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Connection: keep-alive Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Content-Length: 0 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Host: 10.222.0.25 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: Openstack-System-Scope: None Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: User-Agent: python-novaclient Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Auth-Token: gAAAAABjDlA6uk1O6S5ereN_zVEKsyH_mo-0WznNaSzGt5OSWYBEv4lVGnbUbUIr9Z5vFLpgdQ5aL2wX9qF9LDBozOmwWMs-Q3Y3EByQ0x_ASao1IT3KNf2l9SA2eejRdAvahteXs_KuSA45IIlC-8mdsybPgPSWzcDD8FPsj_V56rCgzSOEX44 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Id: None Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Name: None Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Identity-Status: Confirmed Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Is-Admin-Project: True Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Id: default Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Name: Default Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Name: admin Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Role: reader,member,admin Aug 30 18:00:27.191179 n-d-854119-10 devstack@n-api.service[106655]: X-Roles: reader,member,admin Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant: admin Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Name: admin Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-User: admin Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Id: default Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Name: Default Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: X-User-Name: admin Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: method: > Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: exception: Flavor 84 could not be found. Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: action_args: {'id': '84'} Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:27.193388 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:27.194787 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.196739 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-11aecaa4-7565-4598-9415-f1ef26bd0ce1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:27.198630 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-11aecaa4-7565-4598-9415-f1ef26bd0ce1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.633923 Aug 30 18:00:27.198630 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:00:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 636 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:27.205449 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-211b1c21-784e-4349-acc5-c9fe91b51403 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:27.222364 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-211b1c21-784e-4349-acc5-c9fe91b51403 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020790 Aug 30 18:00:27.223052 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:27.233695 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-0c8b7e6b-0fae-4b90-800e-f579e5adef42 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:27.251451 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-0c8b7e6b-0fae-4b90-800e-f579e5adef42 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021569 Aug 30 18:00:27.252007 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:27.262594 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-a905d56b-e541-4358-9534-6fcfbdb35160 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:27.269232 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.wsgi [None req-a905d56b-e541-4358-9534-6fcfbdb35160 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-a905d56b-e541-4358-9534-6fcfbdb35160 admin admin] Request method failure captured: Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Accept: application/json Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Accept-Encoding: gzip, deflate Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Connection: keep-alive Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Content-Length: 0 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Host: 10.222.0.25 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: Openstack-System-Scope: None Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: User-Agent: python-novaclient Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Auth-Token: gAAAAABjDlA6uk1O6S5ereN_zVEKsyH_mo-0WznNaSzGt5OSWYBEv4lVGnbUbUIr9Z5vFLpgdQ5aL2wX9qF9LDBozOmwWMs-Q3Y3EByQ0x_ASao1IT3KNf2l9SA2eejRdAvahteXs_KuSA45IIlC-8mdsybPgPSWzcDD8FPsj_V56rCgzSOEX44 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Id: None Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Name: None Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Identity-Status: Confirmed Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Is-Admin-Project: True Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Id: default Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Name: Default Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Name: admin Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Role: reader,member,admin Aug 30 18:00:27.270826 n-d-854119-10 devstack@n-api.service[106656]: X-Roles: reader,member,admin Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant: admin Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Name: admin Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-User: admin Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Id: default Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Name: Default Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: X-User-Name: admin Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: method: > Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: exception: Flavor 84 could not be found. Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: action_args: {'id': '84'} Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:27.272367 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:27.273342 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:27.274758 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-a905d56b-e541-4358-9534-6fcfbdb35160 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:27.275960 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-a905d56b-e541-4358-9534-6fcfbdb35160 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013426 Aug 30 18:00:27.275960 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:00:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:28.418992 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-0c8b7e6b-0fae-4b90-800e-f579e5adef42 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:28.420053 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-0c8b7e6b-0fae-4b90-800e-f579e5adef42 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 30 18:00:28.420563 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:29.099693 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8cb314aa-6e9b-4554-804d-526d27b80cb4 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:29.106004 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.wsgi [None req-8cb314aa-6e9b-4554-804d-526d27b80cb4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8cb314aa-6e9b-4554-804d-526d27b80cb4 admin admin] Request method failure captured: Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Accept: application/json Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Accept-Encoding: gzip, deflate Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Connection: keep-alive Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Content-Length: 0 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Host: 10.222.0.25 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: Openstack-System-Scope: None Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: User-Agent: python-novaclient Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Auth-Token: gAAAAABjDlA8H5-YFUXHaIfFWbcJm9hdnFz0-2r03Nicaz73GJitP5aq3lFgEgopbGEZswAOJQiRs0Rqv-RUVsTDiJHjohnIIk8KrNpGQyjopAGuqVzC-z2TblmzOhWs34JUdzahuCOGuOncn98jVva6WZH0eBk8ABvbvKRng179USHx8gHiFz8 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Id: None Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Domain-Name: None Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Identity-Status: Confirmed Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Is-Admin-Project: True Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Id: default Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Domain-Name: Default Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Project-Name: admin Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Role: reader,member,admin Aug 30 18:00:29.107579 n-d-854119-10 devstack@n-api.service[106656]: X-Roles: reader,member,admin Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant: admin Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-Tenant-Name: admin Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-User: admin Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Id: default Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-User-Domain-Name: Default Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: X-User-Name: admin Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: method: > Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: exception: Flavor 451 could not be found. Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: action_args: {'id': '451'} Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:29.110237 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:29.112165 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.114100 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-8cb314aa-6e9b-4554-804d-526d27b80cb4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:29.116345 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-8cb314aa-6e9b-4554-804d-526d27b80cb4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.547792 Aug 30 18:00:29.116345 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:00:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:29.120654 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-c1b36edb-5314-445f-8e60-17dad4dbe5d9 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:29.137938 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-c1b36edb-5314-445f-8e60-17dad4dbe5d9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021307 Aug 30 18:00:29.138871 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:29.154482 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:29.172799 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024355 Aug 30 18:00:29.173377 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 18:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:00:29.184967 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-3708497b-f5ba-4dff-8c7a-82562be0f3df admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:29.192125 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.wsgi [None req-3708497b-f5ba-4dff-8c7a-82562be0f3df admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-3708497b-f5ba-4dff-8c7a-82562be0f3df admin admin] Request method failure captured: Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Accept: application/json Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Accept-Encoding: gzip, deflate Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Connection: keep-alive Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Content-Length: 0 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Host: 10.222.0.25 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Openstack-Api-Version: compute 2.90 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: Openstack-System-Scope: None Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: User-Agent: python-novaclient Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Auth-Token: gAAAAABjDlA8H5-YFUXHaIfFWbcJm9hdnFz0-2r03Nicaz73GJitP5aq3lFgEgopbGEZswAOJQiRs0Rqv-RUVsTDiJHjohnIIk8KrNpGQyjopAGuqVzC-z2TblmzOhWs34JUdzahuCOGuOncn98jVva6WZH0eBk8ABvbvKRng179USHx8gHiFz8 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Id: None Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Domain-Name: None Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Identity-Status: Confirmed Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Is-Admin-Project: True Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Id: default Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Domain-Name: Default Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Project-Name: admin Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Role: reader,member,admin Aug 30 18:00:29.193816 n-d-854119-10 devstack@n-api.service[106655]: X-Roles: reader,member,admin Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23112e5fb55c489c8d73048f87a72984"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23112e5fb55c489c8d73048f87a72984"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant: admin Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Id: 23112e5fb55c489c8d73048f87a72984 Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-Tenant-Name: admin Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-User: admin Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Id: default Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-User-Domain-Name: Default Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-User-Id: 1a4b2c1db446415ea5255867b973e8a8 Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: X-User-Name: admin Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: method: > Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: exception: Flavor 451 could not be found. Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: action_args: {'id': '451'} Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:00:29.196804 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:29.198731 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: ERROR nova.api.openstack.wsgi Aug 30 18:00:29.201214 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-3708497b-f5ba-4dff-8c7a-82562be0f3df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:00:29.203853 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-3708497b-f5ba-4dff-8c7a-82562be0f3df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014643 Aug 30 18:00:29.203853 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:00:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:00:30.321566 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:30.323372 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002541 Aug 30 18:00:30.324081 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:30.992780 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-4f626007-f7c1-45fb-a8bb-ea88c6cfe393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:31.015312 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-4f626007-f7c1-45fb-a8bb-ea88c6cfe393 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.549425 Aug 30 18:00:31.016028 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 18:00:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:00:32.095519 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:32.096458 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 30 18:00:32.096915 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:32.813926 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-63436e00-52f6-4ba9-8b55-2290b9ecf002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:32.836103 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-63436e00-52f6-4ba9-8b55-2290b9ecf002 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.595779 Aug 30 18:00:32.836668 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 18:00:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:00:33.956537 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:33.957698 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 30 18:00:33.958280 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:34.715743 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-c26dc151-af47-47a6-bdee-0c4c8588e373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:34.737558 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-c26dc151-af47-47a6-bdee-0c4c8588e373 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.534495 Aug 30 18:00:34.738115 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 18:00:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:00:35.798032 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:35.799106 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 30 18:00:35.799503 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:36.497340 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-1f3834ed-bf12-4f3f-887d-dc16a8f06e73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:00:36.520560 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-1f3834ed-bf12-4f3f-887d-dc16a8f06e73 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.579925 Aug 30 18:00:36.521128 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 18:00:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:00:37.574028 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:37.575173 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 30 18:00:37.575664 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:00:38.233410 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-5f0972ec-e4b8-4263-819b-7ed2583218f5 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:00:38.255570 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-5f0972ec-e4b8-4263-819b-7ed2583218f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.536713 Aug 30 18:00:38.256154 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Aug 30 18:00:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:01:38.894433 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:38.896484 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-878b9112-473c-412b-90c4-23fba3fb40c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003113 Aug 30 18:01:38.897235 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 18:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:01:38.909281 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:39.411552 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-de47f595-d684-477f-ab8c-b008b2498899 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.435469 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-de47f595-d684-477f-ab8c-b008b2498899 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.527419 Aug 30 18:01:39.436059 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:01:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:01:39.458453 n-d-854119-10 devstack@n-api.service[106656]: DEBUG dbcounter [-] [106656] Writing DB stats nova_api:SELECT=14 {{(pid=106656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:01:39.463554 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-4e8b03ba-97f3-4e89-bb29-08ce6bda1354 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.473220 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-4e8b03ba-97f3-4e89-bb29-08ce6bda1354 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016427 Aug 30 18:01:39.473845 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Aug 30 18:01:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:39.487334 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-5aa999dd-d792-469f-ab52-49867aef54ef admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.496391 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-5aa999dd-d792-469f-ab52-49867aef54ef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012967 Aug 30 18:01:39.496975 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Aug 30 18:01:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:39.515366 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.524979 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017015 Aug 30 18:01:39.525909 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Aug 30 18:01:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:01:39.542719 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-cc13f29a-0071-4b2c-85b2-60100db1d33d admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:01:39.557317 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-cc13f29a-0071-4b2c-85b2-60100db1d33d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020829 Aug 30 18:01:39.558247 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Aug 30 18:01:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:07:16.290845 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:16.292190 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Aug 30 18:07:16.292654 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:16.466787 n-d-854119-10 devstack@n-api.service[106655]: DEBUG dbcounter [-] [106655] Writing DB stats nova_api:SELECT=6 {{(pid=106655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:07:16.688173 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:16.691852 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:16.692342 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:16.692777 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:16.693491 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:16.693994 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:16.694526 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:16.739723 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-d98cdef5-02f5-4711-9498-d68c78743525 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.275739 Aug 30 18:07:16.740219 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:07:16 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:07:17.616691 n-d-854119-10 devstack@n-api.service[106656]: DEBUG nova.api.openstack.wsgi [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] Calling method '>' {{(pid=106656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:17.617986 n-d-854119-10 devstack@n-api.service[106656]: INFO nova.api.openstack.requestlog [None req-ae80e001-6b7d-4282-92b9-f60cdfabcd91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Aug 30 18:07:17.618438 n-d-854119-10 devstack@n-api.service[106656]: [pid: 106656|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 18:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:07:17.829701 n-d-854119-10 devstack@n-api.service[106655]: DEBUG nova.api.openstack.wsgi [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Calling method '>' {{(pid=106655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:07:17.833341 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:17.833815 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:17.834250 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:17.835640 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:07:17.836101 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:07:17.836522 n-d-854119-10 devstack@n-api.service[106655]: DEBUG oslo_concurrency.lockutils [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:07:17.859996 n-d-854119-10 devstack@n-api.service[106655]: INFO nova.api.openstack.requestlog [None req-eb6f5aa0-ac92-452d-b62a-1d5912508994 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.094308 Aug 30 18:07:17.860592 n-d-854119-10 devstack@n-api.service[106655]: [pid: 106655|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:07:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:08:05.902001 n-d-854119-10 devstack@n-api.service[106654]: Tue Aug 30 18:08:05 2022 - graceful shutdown triggered... Aug 30 18:08:05.902928 n-d-854119-10 devstack@n-api.service[106655]: Gracefully killing worker 1 (pid: 106655)... Aug 30 18:08:05.902233 n-d-854119-10 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 18:08:05.904058 n-d-854119-10 devstack@n-api.service[106656]: Gracefully killing worker 2 (pid: 106656)... Aug 30 18:08:06.904069 n-d-854119-10 devstack@n-api.service[106654]: worker 1 buried after 1 seconds Aug 30 18:08:06.904069 n-d-854119-10 devstack@n-api.service[106654]: worker 2 buried after 1 seconds Aug 30 18:08:06.904069 n-d-854119-10 devstack@n-api.service[106654]: goodbye to uWSGI. Aug 30 18:08:06.905875 n-d-854119-10 systemd[1]: devstack@n-api.service: Succeeded. Aug 30 18:08:06.906548 n-d-854119-10 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 18:08:06.909643 n-d-854119-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 18:08:06.928768 n-d-854119-10 devstack@n-api.service[122578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 18:08:06 2022] *** Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: nodename: n-d-854119-10 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: machine: x86_64 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: clock source: unix Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: pcre jit disabled Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: detected number of CPU cores: 4 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: current working directory: / Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: detected binary path: /usr/bin/uwsgi-core Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: your processes number limit is 47680 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: your memory page size is 4096 bytes Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: detected max file descriptor number: 2048 Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: lock engine: pthread robust mutexes Aug 30 18:08:06.950395 n-d-854119-10 devstack@n-api.service[122578]: thunder lock: enabled Aug 30 18:08:06.952273 n-d-854119-10 devstack@n-api.service[122578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 18:08:06.952273 n-d-854119-10 devstack@n-api.service[122578]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 18:08:07.000052 n-d-854119-10 devstack@n-api.service[122578]: Python main interpreter initialized at 0x55e6e101d9c0 Aug 30 18:08:07.000052 n-d-854119-10 devstack@n-api.service[122578]: python threads support enabled Aug 30 18:08:07.000052 n-d-854119-10 devstack@n-api.service[122578]: your server socket listen backlog is limited to 100 connections Aug 30 18:08:07.000052 n-d-854119-10 devstack@n-api.service[122578]: your mercy for graceful operations on workers is 90 seconds Aug 30 18:08:07.000676 n-d-854119-10 devstack@n-api.service[122578]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 18:08:07.000676 n-d-854119-10 devstack@n-api.service[122578]: *** Operational MODE: preforking *** Aug 30 18:08:07.001046 n-d-854119-10 devstack@n-api.service[122578]: *** uWSGI is running in multiple interpreter mode *** Aug 30 18:08:07.001046 n-d-854119-10 devstack@n-api.service[122578]: spawned uWSGI master process (pid: 122578) Aug 30 18:08:07.001290 n-d-854119-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 18:08:07.002283 n-d-854119-10 devstack@n-api.service[122578]: spawned uWSGI worker 1 (pid: 122589, cores: 1) Aug 30 18:08:07.002820 n-d-854119-10 devstack@n-api.service[122578]: spawned uWSGI worker 2 (pid: 122590, cores: 1) Aug 30 18:08:07.003046 n-d-854119-10 devstack@n-api.service[122578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 18:08:07.708024 n-d-854119-10 devstack@n-api.service[122589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 18:08:07.753975 n-d-854119-10 devstack@n-api.service[122590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 18:08:08.979320 n-d-854119-10 devstack@n-api.service[122590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 18:08:08.979320 n-d-854119-10 devstack@n-api.service[122590]: from cryptography.utils import int_from_bytes Aug 30 18:08:08.980255 n-d-854119-10 devstack@n-api.service[122590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 18:08:08.980255 n-d-854119-10 devstack@n-api.service[122590]: from cryptography.utils import int_from_bytes Aug 30 18:08:09.073973 n-d-854119-10 devstack@n-api.service[122589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 18:08:09.073973 n-d-854119-10 devstack@n-api.service[122589]: from cryptography.utils import int_from_bytes Aug 30 18:08:09.074758 n-d-854119-10 devstack@n-api.service[122589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 18:08:09.074758 n-d-854119-10 devstack@n-api.service[122589]: from cryptography.utils import int_from_bytes Aug 30 18:08:11.873126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 18:08:11.873770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 18:08:11.874942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 18:08:11.875177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 18:08:11.875638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 18:08:11.876335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.876933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.877537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.878130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.879042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.879631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.880394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.880960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.881515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.882009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.882618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.883232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.883842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.884424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.885072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.885618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.886202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.886847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.887421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.888411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.890195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.890558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.890944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.891529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.892121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.892702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.893318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.893919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.894545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.895134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.896054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.896483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.897296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.897920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.898723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.899327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.899864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.900428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.901024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.901192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 18:08:11.901800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 18:08:11.901902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.902076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 18:08:11.902230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.902637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 18:08:11.902807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 18:08:11.902922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.903193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.903448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.903606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.903772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.904021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.904193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.904466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.904632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.904758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.905034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.905263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.905435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.905660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.905914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.906140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.906429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.906644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.906838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854119-10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.907036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.907299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.907299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.907771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.908015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.908257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.908527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.908527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.908993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.909234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.909234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.909688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.909917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.910183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.910469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.910469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.910862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.911150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.911416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.911643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.914035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.914400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.914400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.914400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.915124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.915372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.915593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.915754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.915754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.916244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.916515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854119-10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.916695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.916845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.916845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.917998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.918480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.918718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.918718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.919199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.919412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.919661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.919882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.919882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.920318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.920545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.920545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.921019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.921263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.921263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.921720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.921973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.922220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.922515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.922515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.924643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.925754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.926649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.927533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.927795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.928038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.928038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.928506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.928771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.928771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.929235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.929464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.929464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.930252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.930521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.930521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.931001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.931215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.931436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.931671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.931671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.932150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.932402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.932402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.932916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.933691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.933691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.934655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.935084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.935084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.935537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.935784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.935784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.936245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.936477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.936477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.936908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.937140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.937381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.937606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.937606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.938064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.938290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.938290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.938770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.939008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.939008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.939458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.939694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.939694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.940129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.940382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.940382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.940847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.941079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.941079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.941555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.942446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.942710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.942978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.942978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.942978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.943933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.943933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.943933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.944624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.944624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.945107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.945416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.945577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.945744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.945744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.946188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.946525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.946525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.946897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.947131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.947131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.947571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.947754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.947910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.948874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.949894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.950136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.950136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.950610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.950851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.951110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.951330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.951330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.951793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.952023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.952280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.952509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.952756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.952966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.953235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.953470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.953736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.954515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.955004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.955234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.955234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.955879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.956125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.956125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.956570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.956799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.956799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.957289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.957538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.957792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.958040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.958040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.958496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.963916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.963916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.965365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.965633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.965633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.966304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.966304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.966791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.967007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.967232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.967232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.967685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.967931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.968161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.968397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.968397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.968845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.969204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.969461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.969697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.969697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.970134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.970404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.970404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.970872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.971072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.971267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.971503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.971734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.971981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.971981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.972446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.972672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.972913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.973153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.973485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.973781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.973781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.977097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.977283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.977519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.977943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.977943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.978450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 18:08:11.978716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.978969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.978969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.979446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.979679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.979921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.980169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.980408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.980408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.980882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.981135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.981135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.981782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.982034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.982034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.982726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.983005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.983264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.983604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.983604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.984090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.984361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.984361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.984845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.985108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.985415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.985670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.985912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.987216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.987216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.987696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.987936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.988209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.988461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.988461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.988949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.989184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.989184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.989904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.990183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.990183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.990682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.990942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.990942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.991459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.991718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.991718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.993140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.993415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.993741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.994005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.994005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.994531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.994794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.994794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.995296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.995557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.995809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.996160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.996160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.997732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.998004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.998004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.998562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.998823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.998823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.999291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.999538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:11.999798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.000072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.000313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.000569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.000814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.001062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.001327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.001592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.001850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.002102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.002102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.002626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.002874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.002874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.003363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.003621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.003621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.004992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.005354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.005518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.005697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.005870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.005870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.006298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.006583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.006583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.007937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.008884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.009967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.010998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.011887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.012774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.013993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.014935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.015906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.016993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.017937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.018966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.019918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.020878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.021981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.022872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.023200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.023321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.023806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.023907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.024153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.024479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.024571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.024817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.025087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.025179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.025645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.025754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.025993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.026274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.026448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.026828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.026969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.027176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.027493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.027628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.027804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.028070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.028202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.028535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.028676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.028814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.029032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.029274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.029417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.029616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.029897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.030039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.030216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.030549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.030695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.030856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.031124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.031266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.031472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.031713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.031852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.032081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.032327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.032473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.032709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.032978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.033116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.033312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.033617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.033758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.034039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.034228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.034388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.034878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.035448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.036089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.036837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.037477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.037612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.037936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.038078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.038476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.038642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.038906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.039023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.039173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.039365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.039688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.039817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.040010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.040531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.041136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.041581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.041763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.041941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.042279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.042540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.042862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.043006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.043203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.043653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.043802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.043940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.044114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.044257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.044485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.044753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.044942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.045109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.045388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.045622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.045964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.046107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.046559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.046695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.046877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.047201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.047344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.047523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.047818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.047980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.048385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.048796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.048992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.049167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.049559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.049718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.049887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.050134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.050286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.050597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.050756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.050903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.051174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.051318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.051488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.051885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.052032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.052252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.052495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.052786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.053064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.053287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.053618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.053752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.053932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.054185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.054321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.054613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.055130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.055300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.055627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.055761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.055940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.056259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.056408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.056573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.056884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.057025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.057197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.057466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.057609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.058907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.059284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.059428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.059641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.059774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.059912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.060140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.060384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.060520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.060755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.060982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.061115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.061389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.061557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.061756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.062067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.062199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.062422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.062747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.062879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.063066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.063382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.063532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.063702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.063990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.064135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.064319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.064568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.064718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.064938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.065172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.065308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.065550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.065781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.065975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.066179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.066415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.066566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.066862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.067005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.067190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.067615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.068509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.068813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.069002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.069192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.069407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.070131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.070299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.070484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.070817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.071013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.071132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.071420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.071539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.071746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.072004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.072156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.072371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.072594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.072735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.073023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.073219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.073378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.073719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.073905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.074046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.074338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.074597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.074844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.075043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.075187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.075459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.075627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.075791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.076045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.076243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.076368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.076631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.076829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.077086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.077436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.077631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.077784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.078984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.079331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.079531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.079846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.079988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.080121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.080361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.080622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.080822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.080992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.081381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.081513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.081513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.081840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.082026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.082178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.082476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.082689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.082841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.083113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.083499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.083704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.084057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.084294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.084532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.084868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.085012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.085309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.085445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.085666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.085928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.086062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.086407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.086624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.086761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.087201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.087337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.087583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.087790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.087975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.088232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.088367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.088535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.088880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.089017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.089148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.089446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.089597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.089778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.090068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.090209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.090480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.090631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.090813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.091146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.091292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.091572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.091732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.091919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.092190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.092330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.092629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.092847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.092990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.093263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.093419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.093596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.093965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.094152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.094294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.094569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.094722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.094901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.095137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.095278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.095508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.095785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.095917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.096153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.096374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.096508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.096756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.097988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.098235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.098407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.098763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.098932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.099211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.099434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.099710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.100207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.100341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.100476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.100630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.100809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.101128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.101245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.101441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.101777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.102313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.102506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.102715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.102986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.103112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.103377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.103573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.103713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.104036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.104176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.104372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.104688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.104819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.105027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.105342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.105474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.105675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.105948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.106104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.106301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.106567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.106700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.106999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.107144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.107309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.107626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.107767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.107938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.108191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.108325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.108544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.108781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.108914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.109333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.109491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.109633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.109822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.109955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.110151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.110407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.110555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.110807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.110965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.111117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.111425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.111527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.111851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.112045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.112173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.112402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.112608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.112752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.113977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.114455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.114628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.115068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.115223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.115591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.115743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.115913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.116180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.116314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.116551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.116756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.116902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.117181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.117377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.117508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.117813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.117957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.118421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.118571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.118762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.119087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.119219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.119529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.119709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.119829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.120981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.121269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.121456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.121591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.121994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.122126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.122247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.122576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.122731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.122919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.123298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.123439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.123569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.123845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.123987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.124174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.124434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.124575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.124849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.125001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.125161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.125466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.125606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.125785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.126102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.126241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.126448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.126752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.126883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.127070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.127336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.127477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.127690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.127921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.128052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.128308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.128498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.128631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.128943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.129074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.129283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.129727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.129901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.130035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.130303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.130500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.130865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.131009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.131635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.131773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.132196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.132335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.132457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.132701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.132897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.133030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.133273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.133478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.133611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.133919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.134146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.134287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.134556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.134762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.134908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.135176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.135367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.135506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.135800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.135986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.136128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.136421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.136597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.136738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.137049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.137189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.137630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.137763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.137986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.138306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.138478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.138659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.138935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.139062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.139295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.139530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.139671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.139966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.140122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.140262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.140519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.140709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.140843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.141146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.141302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.141449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.166051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.166455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.166618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.166618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.167999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.168897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.168983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.168983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.169543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.169795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.169795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.170867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.171890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.172331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.172331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.172600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.172763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.172763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.173947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.174640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.175885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.176181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.176331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.176331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.176887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.180503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.180503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.181048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.181836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.182170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.182660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.182660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.183592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.184952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.185979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.186975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.187438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.188999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.189913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.190911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.191994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.192991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.193929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.194961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.195898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.197780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.198076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.198187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.199754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.199940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.200991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 18:08:12.201592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.201592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.201592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.202146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.202893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.208904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.209193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.209972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.210623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.211222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.211805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.212415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.213029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.213627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.214203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.214843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.215449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.216017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.216582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.217165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.217740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.218324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.219371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.219603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.220064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.220625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.221172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.221792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.222399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.223027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.224009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.224933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.225514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.226090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.226775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.227357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.227975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.228724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.229213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.229815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.230523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.231044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.231645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.232247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.232840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.233434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.234014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.234633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.235209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.235806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.236851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.237466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.238070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.238702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.239344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.239969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.240569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.241131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.241716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.242314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.242946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.243574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.244186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.244811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.245446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.246054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.246697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.247288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.247893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.248580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.249346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.249787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.250387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.250951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.251532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.252132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.252726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.253327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.253914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.254555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.255162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.255758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.256358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.256999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.257640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.258246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.258884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.259480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.260046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.261117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.261743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.262399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.263005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.263617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.264218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.264954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.265440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.265990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.266623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.267217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.267801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.268372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.268965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.269563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.270141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.270855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.271442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.272672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.273309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.273917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.274580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.275217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.275766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.276313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.276910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.277489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.278041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.278672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.279261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.279964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.280438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.280951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.281521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.282095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.282706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.283283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.283890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.284448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.285005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.285577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.286206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.287412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.287412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.287920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.288479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.289080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.289641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.290232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.290862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.291561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.292053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.292653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.293219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.293838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.294431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.295011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.295610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.296345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.296904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.297456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.298023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.298753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.299411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.300425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.301072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.301647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.302455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.302934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.303457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.303984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.304505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.305400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.305940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.306512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.307078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.307641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.308194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.308741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.309287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.309838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.310473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.311052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.311627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.312214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.312784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.313361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.313962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.314620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.315228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.315830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.316444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.317026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.317648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.318220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.318819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.319402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.319999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.320613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.321216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.321803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.322630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.323209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.323807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.324402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.324997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.325611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.326202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.326818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.327437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.328000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.328603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.329253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.329887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.330506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.331079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.331645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.332206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.332797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.333478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.334048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.334647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.335216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.335798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.336373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.336950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.337536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.338117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.338731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.339319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.339870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.340426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.340990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.341562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.342131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.342768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.343358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.343917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.344491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.345065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.345692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.346327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.346990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.347590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.348188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.348817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.349428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.350008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.350647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.351241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.351840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.352444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.353065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.353660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.354260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.354876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.355462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.356057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.356627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.357261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.357894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.358470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.359085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.359692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.360304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.360898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.361482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.362059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.362665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.363247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.363834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.364492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.365079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.365684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.366267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.366913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.367032 n-d-854119-10 devstack@n-api.service[122590]: INFO dbcounter [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Registered counter for database nova_api Aug 30 18:08:12.367521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.368122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.368757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.369374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.369944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.370587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.371186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.371852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.372442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.373075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.373731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.374274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.374886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.375454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 18:08:12.375900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 18:08:12.389980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_db.sqlalchemy.engines [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.398995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writer thread running {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.465993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.context [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122590) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 18:08:12.470373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.470873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.472569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.473385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.473904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.476906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.479325 n-d-854119-10 devstack@n-api.service[122590]: INFO dbcounter [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Registered counter for database nova_cell0 Aug 30 18:08:12.484186 n-d-854119-10 devstack@n-api.service[122590]: INFO dbcounter [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Registered counter for database nova_cell1 Aug 30 18:08:12.493207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_db.sqlalchemy.engines [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.494861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_db.sqlalchemy.engines [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.502167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writer thread running {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.502789 n-d-854119-10 devstack@n-api.service[122589]: INFO dbcounter [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Registered counter for database nova_api Aug 30 18:08:12.511535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writer thread running {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.540367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_db.sqlalchemy.engines [None req-032097de-5623-49c0-97af-050cfa7eedff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.552570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writer thread running {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.664032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.context [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122589) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 18:08:12.672169 n-d-854119-10 devstack@n-api.service[122590]: INFO dbcounter [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Registered counter for database nova_cell0 Aug 30 18:08:12.672414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.673100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.676884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.678318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:08:12.679210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:08:12.681188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_db.sqlalchemy.engines [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.683835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:08:12.687242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writer thread running {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.687950 n-d-854119-10 devstack@n-api.service[122589]: INFO dbcounter [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Registered counter for database nova_cell0 Aug 30 18:08:12.696307 n-d-854119-10 devstack@n-api.service[122589]: INFO dbcounter [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Registered counter for database nova_cell1 Aug 30 18:08:12.710237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_db.sqlalchemy.engines [None req-032097de-5623-49c0-97af-050cfa7eedff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.713438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_db.sqlalchemy.engines [None req-032097de-5623-49c0-97af-050cfa7eedff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.726716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writer thread running {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.730853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writer thread running {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:12.918338 n-d-854119-10 devstack@n-api.service[122589]: INFO dbcounter [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Registered counter for database nova_cell0 Aug 30 18:08:12.930260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_db.sqlalchemy.engines [None req-032097de-5623-49c0-97af-050cfa7eedff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 18:08:12.936697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writer thread running {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 18:08:13.284144 n-d-854119-10 devstack@n-api.service[122590]: WARNING keystonemiddleware.auth_token [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 18:08:13.300198 n-d-854119-10 devstack@n-api.service[122590]: WARNING keystonemiddleware.auth_token [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 18:08:13.476779 n-d-854119-10 devstack@n-api.service[122589]: WARNING keystonemiddleware.auth_token [None req-032097de-5623-49c0-97af-050cfa7eedff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 18:08:13.491706 n-d-854119-10 devstack@n-api.service[122589]: WARNING keystonemiddleware.auth_token [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 18:08:13.835512 n-d-854119-10 devstack@n-api.service[122590]: WARNING keystonemiddleware.auth_token [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 18:08:13.847444 n-d-854119-10 devstack@n-api.service[122590]: WARNING keystonemiddleware.auth_token [None req-3a820cde-81ac-479b-9b17-45d0d764d220 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 18:08:13.858559 n-d-854119-10 devstack@n-api.service[122590]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6e101d9c0 pid: 122590 (default app) Aug 30 18:08:13.879970 n-d-854119-10 devstack@n-api.service[122589]: WARNING keystonemiddleware.auth_token [None req-032097de-5623-49c0-97af-050cfa7eedff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 18:08:13.886420 n-d-854119-10 devstack@n-api.service[122589]: WARNING keystonemiddleware.auth_token [None req-032097de-5623-49c0-97af-050cfa7eedff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 18:08:13.892001 n-d-854119-10 devstack@n-api.service[122589]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6e101d9c0 pid: 122589 (default app) Aug 30 18:09:01.667965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:01.670382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:01.671879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:01.673675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:02.538267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:02.539948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:02.541341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:02.542594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:03.368775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Calling method '.version_select at 0x7f4e587883a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:03.374668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.375157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.375597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.376360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.376804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.377226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.426636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a87de336-f09c-445b-a3c9-4bcdd54babaa tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.775351 Aug 30 18:09:03.427635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1/1] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:09:01 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:03.956908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '.version_select at 0x7f4e5877c1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:03.964965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122590) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 18:09:03.965566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:03.966042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:03.966523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:03.996367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.006034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.006877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.036380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.037292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.037966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.051527 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d725eeb-7488-4f03-a667-4e144c64f748 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.622296 Aug 30 18:09:04.062600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:09:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:04.404819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.410365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.411732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.412713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.414306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.415087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.415991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.436019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.438814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.439500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.440049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.441386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.441956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.442524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.462942 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ebb75adf-96d8-4281-b91f-3ba9424d02d7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.408038 Aug 30 18:09:04.464322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:04.508637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fe443bb-6bae-499a-9e45-839ad02ce406 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.977463 Aug 30 18:09:04.509262 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1/4] 10.222.0.25 () {58 vars in 1164 bytes} [Tue Aug 30 18:09:02 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:09:04.646405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a44974f-b377-4f45-a21d-e1408e37cc19 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Calling method '.version_select at 0x7f4e5866caf0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.651578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a44974f-b377-4f45-a21d-e1408e37cc19 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a44974f-b377-4f45-a21d-e1408e37cc19 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:04.657719 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:09:04.659049 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:04.660035 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 18:09:04.661677 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:04.663020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a44974f-b377-4f45-a21d-e1408e37cc19 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:04.663020 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a44974f-b377-4f45-a21d-e1408e37cc19 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.194947 Aug 30 18:09:04.663020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 4/5] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:04.791373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c770e3e3-206b-420a-b402-f4594bbf7b3a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-103366925", "id": 2052320623, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:04.885389 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c770e3e3-206b-420a-b402-f4594bbf7b3a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.374542 Aug 30 18:09:04.886991 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2/6] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:04.953209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Calling method '.version_select at 0x7f4e585d78b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:04.966938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.969258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.970073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:04.994862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:04.995654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:04.996300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.009359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.009842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.010276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.024889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dbe7ce08-fdb1-4420-8013-a3a407da0646 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.361331 Aug 30 18:09:05.025886 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 5/7] 10.222.0.25 () {60 vars in 1208 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:05.036639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-54e5082c-101a-4028-930e-c2f1ead9400e tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-956367303", "name": "tempest-test_aggregate-949999042"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.045855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4354028c-67f8-40e6-8f97-cfa63e05dbf4 tempest-AZAdminNegativeTestJSON-1945900415 tempest-AZAdminNegativeTestJSON-1945900415-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.048268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4354028c-67f8-40e6-8f97-cfa63e05dbf4 tempest-AZAdminNegativeTestJSON-1945900415 tempest-AZAdminNegativeTestJSON-1945900415-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '97b4eb2ab7fa4f359f06629c5a4f4490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca35e989e1145b78d0cc6449b8e424e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4354028c-67f8-40e6-8f97-cfa63e05dbf4 tempest-AZAdminNegativeTestJSON-1945900415 tempest-AZAdminNegativeTestJSON-1945900415-project] Request method failure captured: Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI8YFrdBL6mE0wRYgwEUuTSI2Nwg0e9X0Hm2FfsQwwW1rqtWt46fobLr-euQGNFieRTgi4Q5UkAWti0msubu4H1S-RqT7Cb0wK1w4seRHtYNPIgzlRfczR9a39Zx5jlRBnOlkAAnJJvfPxYvft8jkdCNJZ_ikAE2yloc2pUheE0BlY Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 3ca35e989e1145b78d0cc6449b8e424e Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1945900415 Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:05.055586 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ca35e989e1145b78d0cc6449b8e424e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ca35e989e1145b78d0cc6449b8e424e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ca35e989e1145b78d0cc6449b8e424e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ca35e989e1145b78d0cc6449b8e424e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AZAdminNegativeTestJSON-1945900415 Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 3ca35e989e1145b78d0cc6449b8e424e Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1945900415 Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AZAdminNegativeTestJSON-1945900415-project Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 97b4eb2ab7fa4f359f06629c5a4f4490 Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AZAdminNegativeTestJSON-1945900415-project Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 18:09:05.056887 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.057574 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 18:09:05.058579 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.060627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4354028c-67f8-40e6-8f97-cfa63e05dbf4 tempest-AZAdminNegativeTestJSON-1945900415 tempest-AZAdminNegativeTestJSON-1945900415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.061485 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4354028c-67f8-40e6-8f97-cfa63e05dbf4 tempest-AZAdminNegativeTestJSON-1945900415 tempest-AZAdminNegativeTestJSON-1945900415-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.172655 Aug 30 18:09:05.062041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:09:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:05.068157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.070907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.071572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.072134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.073387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.073975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.074635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.103952 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00394c32-2190-49f4-8366-270878fdb375 tempest-AZAdminV2TestJSON-639975576 tempest-AZAdminV2TestJSON-639975576-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.040232 Aug 30 18:09:05.105020 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.111673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c2f68c0-2725-4885-8823-aaae4b234d80 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Calling method '.version_select at 0x7f4e586e9ee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.115192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c2f68c0-2725-4885-8823-aaae4b234d80 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c2f68c0-2725-4885-8823-aaae4b234d80 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hosts/n-d-854119-10/reboot HTTP/1.1 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:05.118280 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10'} Aug 30 18:09:05.120631 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.121916 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 18:09:05.123666 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.125412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c2f68c0-2725-4885-8823-aaae4b234d80 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.125412 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c2f68c0-2725-4885-8823-aaae4b234d80 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-854119-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.013773 Aug 30 18:09:05.125412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1191 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/n-d-854119-10/reboot => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:05.125412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3208e4f8-c39d-4cb4-bd1d-71bb1340bea0 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.139888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-54e5082c-101a-4028-930e-c2f1ead9400e tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 1592ce6e-25ad-474e-b2fc-46b2f7e40cad for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:05.163441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3208e4f8-c39d-4cb4-bd1d-71bb1340bea0 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2052320623" status: 202 len: 0 microversion: 2.1 time: 0.041713 Aug 30 18:09:05.164504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:05 2022] DELETE /compute/v2.1/flavors/2052320623 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:05.171263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f48ae11-db2e-428c-bb9e-acfd5886fa56 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Calling method '.version_select at 0x7f4e5862bd30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.231957 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9f48ae11-db2e-428c-bb9e-acfd5886fa56 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f48ae11-db2e-428c-bb9e-acfd5886fa56 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.242792 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'nonexistent_hostname'} Aug 30 18:09:05.243999 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:05.244805 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 18:09:05.245934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f48ae11-db2e-428c-bb9e-acfd5886fa56 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.247060 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f48ae11-db2e-428c-bb9e-acfd5886fa56 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.079261 Aug 30 18:09:05.248516 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:05.261326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44ede631-3b03-4e86-b08a-77d973d20708 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.306064 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-54e5082c-101a-4028-930e-c2f1ead9400e tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.275748 Aug 30 18:09:05.307179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 6/13] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Aug 30 18:09:05 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.328528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-446ac07f-409b-4379-a957-e6a8e77327c9 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Calling method '.version_select at 0x7f4e585a6040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.335132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-446ac07f-409b-4379-a957-e6a8e77327c9 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-446ac07f-409b-4379-a957-e6a8e77327c9 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hosts/n-d-854119-10 HTTP/1.1 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:05.347571 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'n-d-854119-10'} Aug 30 18:09:05.349674 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.351082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 18:09:05.356011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.357533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-446ac07f-409b-4379-a957-e6a8e77327c9 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.357533 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-446ac07f-409b-4379-a957-e6a8e77327c9 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-854119-10" status: 403 len: 109 microversion: 2.1 time: 0.041404 Aug 30 18:09:05.357752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44ede631-3b03-4e86-b08a-77d973d20708 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101349 Aug 30 18:09:05.357752 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:05.358014 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/n-d-854119-10 => generated 109 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:05.369788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80a5d750-b847-4ab1-96c1-7222f5a98637 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.374400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69972fa0-4228-44ec-b87c-28017d80988d tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Calling method '.version_select at 0x7f4e5877c1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.382758 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-69972fa0-4228-44ec-b87c-28017d80988d tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.386475 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80a5d750-b847-4ab1-96c1-7222f5a98637 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.032382 Aug 30 18:09:05.387050 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69972fa0-4228-44ec-b87c-28017d80988d tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:05.387623 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'nonexistent_hostname'} Aug 30 18:09:05.389190 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.389824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.390754 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.391991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69972fa0-4228-44ec-b87c-28017d80988d tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.391991 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69972fa0-4228-44ec-b87c-28017d80988d tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024260 Aug 30 18:09:05.391991 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1191 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:05.399137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63ba9997-fb46-4e5d-b834-d1c09087cf51 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2064134207", "id": 994683236, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.403139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e962869-5a72-4019-90d2-33652cddb5ea tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Calling method '.version_select at 0x7f4e585d79d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.405194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e962869-5a72-4019-90d2-33652cddb5ea tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e962869-5a72-4019-90d2-33652cddb5ea tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hosts/n-d-854119-10/shutdown HTTP/1.1 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:05.407001 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'n-d-854119-10'} Aug 30 18:09:05.411962 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.413693 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 18:09:05.416027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.419989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e962869-5a72-4019-90d2-33652cddb5ea tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.419989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e962869-5a72-4019-90d2-33652cddb5ea tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-854119-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010069 Aug 30 18:09:05.419989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1197 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/n-d-854119-10/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:09:05.423207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63ba9997-fb46-4e5d-b834-d1c09087cf51 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029568 Aug 30 18:09:05.427870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-303aa505-fb60-4ba3-9419-520272ec3744 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.431962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 10/19] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.441335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df7fe8df-92e1-47d1-97a6-126f03f24122 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Calling method '.version_select at 0x7f4e584f0af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.452402 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-df7fe8df-92e1-47d1-97a6-126f03f24122 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df7fe8df-92e1-47d1-97a6-126f03f24122 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.454512 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'nonexistent_hostname'} Aug 30 18:09:05.456749 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:05.458034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 18:09:05.461695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df7fe8df-92e1-47d1-97a6-126f03f24122 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df7fe8df-92e1-47d1-97a6-126f03f24122 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023216 Aug 30 18:09:05.465079 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 11/20] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:05.469374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-753d23f7-d3c0-4700-a24c-1054f79047a7 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.472122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303aa505-fb60-4ba3-9419-520272ec3744 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:05.472953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303aa505-fb60-4ba3-9419-520272ec3744 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:05.473707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303aa505-fb60-4ba3-9419-520272ec3744 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:05.488258 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-753d23f7-d3c0-4700-a24c-1054f79047a7 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.028844 Aug 30 18:09:05.489245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 12/21] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:05.499000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bcb4c85-49a4-43bd-935d-efb75daf0a82 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Calling method '.version_select at 0x7f4e584e64c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.502579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bcb4c85-49a4-43bd-935d-efb75daf0a82 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bcb4c85-49a4-43bd-935d-efb75daf0a82 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hosts/n-d-854119-10/startup HTTP/1.1 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:05.507101 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10'} Aug 30 18:09:05.508391 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.509048 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 18:09:05.511815 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.514883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bcb4c85-49a4-43bd-935d-efb75daf0a82 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.514883 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bcb4c85-49a4-43bd-935d-efb75daf0a82 tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-854119-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.018971 Aug 30 18:09:05.514883 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 13/22] 10.222.0.25 () {58 vars in 1194 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/n-d-854119-10/startup => generated 110 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:05.524134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31dfe5c7-4111-432c-a927-8a53a49db0de tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.558187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31dfe5c7-4111-432c-a927-8a53a49db0de tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/994683236" status: 202 len: 0 microversion: 2.1 time: 0.042156 Aug 30 18:09:05.559734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 14/23] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:05 2022] DELETE /compute/v2.1/flavors/994683236 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:05.569303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bd214ff-2900-4709-bb5e-8f1300f45850 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Calling method '.version_select at 0x7f4e584e6280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.592336 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1bd214ff-2900-4709-bb5e-8f1300f45850 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bd214ff-2900-4709-bb5e-8f1300f45850 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.596019 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'nonexistent_hostname'} Aug 30 18:09:05.597235 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:05.597905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 18:09:05.598896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bd214ff-2900-4709-bb5e-8f1300f45850 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1bd214ff-2900-4709-bb5e-8f1300f45850 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.038760 Aug 30 18:09:05.602238 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 15/24] 10.222.0.25 () {58 vars in 1215 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:05.612927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3369950-cc96-4993-966c-a1d82b069ab1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.648602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3369950-cc96-4993-966c-a1d82b069ab1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045136 Aug 30 18:09:05.650382 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 16/25] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:05.666018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f07550-1830-4df4-839e-3a8e2cc4a878 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Action: 'update', calling method: .version_select at 0x7f4e584aab80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f07550-1830-4df4-839e-3a8e2cc4a878 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-hosts/n-d-854119-10 HTTP/1.1 Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 51 Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.676538 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: {"status": "enable", "maintenance_mode": "invalid"} Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.678003 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance: Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.679062 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.680957 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f07550-1830-4df4-839e-3a8e2cc4a878 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36f07550-1830-4df4-839e-3a8e2cc4a878 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-854119-10" status: 400 len: 199 microversion: 2.1 time: 0.027309 Aug 30 18:09:05.683823 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 17/26] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:09:05 2022] PUT /compute/v2.1/os-hosts/n-d-854119-10 => generated 199 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:05.691412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65c860fa-f3e5-4942-a324-37277eaf599e tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-184533057", "id": 1709513360, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.717515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65c860fa-f3e5-4942-a324-37277eaf599e tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.034039 Aug 30 18:09:05.718117 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 18/27] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:05 2022] POST /compute/v2.1/flavors => generated 428 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.728690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ad7b0d-3bec-4c17-bc98-4db441cfefa6 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Action: 'update', calling method: .version_select at 0x7f4e584f0b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ad7b0d-3bec-4c17-bc98-4db441cfefa6 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-hosts/n-d-854119-10 HTTP/1.1 Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 51 Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.733324 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: {"status": "invalid", "maintenance_mode": "enable"} Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.735830 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance: Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.737336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.741055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ad7b0d-3bec-4c17-bc98-4db441cfefa6 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6ad7b0d-3bec-4c17-bc98-4db441cfefa6 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-854119-10" status: 400 len: 189 microversion: 2.1 time: 0.015323 Aug 30 18:09:05.744129 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 19/28] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:09:05 2022] PUT /compute/v2.1/os-hosts/n-d-854119-10 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:05.745356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1fef6b5d-dc77-449f-8229-9ab6c0bf4cfb tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.774200 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1fef6b5d-dc77-449f-8229-9ab6c0bf4cfb tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1709513360" status: 202 len: 0 microversion: 2.1 time: 0.037549 Aug 30 18:09:05.775166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 20/29] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:05 2022] DELETE /compute/v2.1/flavors/1709513360 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:05.781704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4750345e-b115-4b76-a357-0e3613a5e01d tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Action: 'update', calling method: .version_select at 0x7f4e584aadc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.786105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4750345e-b115-4b76-a357-0e3613a5e01d tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '63beb0adc01f42d3992f518775c01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d2bb8c68ca4cd4a7a40c7aed94e284', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4750345e-b115-4b76-a357-0e3613a5e01d tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Request method failure captured: Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-hosts/n-d-854119-10 HTTP/1.1 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 50 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI6fXeu461NBUEqp36KyoaLUsJUoT5THOST9fleZ_WwquQEx2_dPQXMGWqqrR-Wn2Tc53H5oR2B1d_RfphKwsgcI9Hu39fZvk027sLJ6zejnovN9rtPgX82_U9GyH-0q5HWs2Ksf32x9J6y6zM44B8s5fis31awu1JCogPv82YDFyU Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:05.787829 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2d2bb8c68ca4cd4a7a40c7aed94e284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: d2d2bb8c68ca4cd4a7a40c7aed94e284 Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-27667645 Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63beb0adc01f42d3992f518775c01e3c Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-27667645-project Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 18:09:05.789340 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.790168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 18:09:05.792109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.794028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4750345e-b115-4b76-a357-0e3613a5e01d tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.794028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4750345e-b115-4b76-a357-0e3613a5e01d tempest-HostsAdminNegativeTestJSON-27667645 tempest-HostsAdminNegativeTestJSON-27667645-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-854119-10" status: 403 len: 111 microversion: 2.1 time: 0.012962 Aug 30 18:09:05.794028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 21/30] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:09:05 2022] PUT /compute/v2.1/os-hosts/n-d-854119-10 => generated 111 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:05.795879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-14f4fb97-e941-4231-aa01-8123721f63f6 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.818382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-14f4fb97-e941-4231-aa01-8123721f63f6 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026291 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 22/31] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65bb19ec-c064-4bd9-9a90-1e6a4f51dc11 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Action: 'update', calling method: .version_select at 0x7f4e585f01f0>, body: {"status": null, "maintenance_mode": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65bb19ec-c064-4bd9-9a90-1e6a4f51dc11 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-hosts/n-d-854119-10 HTTP/1.1 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 42 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.830446 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: {"status": null, "maintenance_mode": null} Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 18:09:05.832998 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-d-854119-10', 'body': {'status': None, 'maintenance_mode': None}} Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance: Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi None Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.834241 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.836872 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65bb19ec-c064-4bd9-9a90-1e6a4f51dc11 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65bb19ec-c064-4bd9-9a90-1e6a4f51dc11 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-854119-10" status: 400 len: 127 microversion: 2.1 time: 0.009872 Aug 30 18:09:05.838897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 23/32] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:09:05 2022] PUT /compute/v2.1/os-hosts/n-d-854119-10 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:05.844661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Action: 'update', calling method: .version_select at 0x7f4e584f0a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.848940 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.hosts [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Enabling host nonexistent_hostname. Aug 30 18:09:05.858042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Request method failure captured: Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 50 Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI96-SMGySnbEunbS_mQ2Z82NLPXA1-FbsJwrq-6O60kDs_jcD5L19hSOP5c4Nr4oaIwJhsrrWY0WJnu79ETYSZffgdfMBuT8v3If8sIsCKtGaG_mHcQIabP6Gag-qJTRMKJVi156-jEyJyJvgUxnsfAguyDg9P3RBUvjNzh74t4-I Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:05.860088 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97bb0aec05e141d8bedec43cd3d0d17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97bb0aec05e141d8bedec43cd3d0d17e Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-38431226 Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ef6085ca023e447b8034594f96ce18bf Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HostsAdminNegativeTestJSON-38431226-project-admin Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.863909 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:05.865544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:05.867744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:05.872495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:05.875066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d25cd6e3-3d9a-44b6-8ce5-08a5b741a2d1 tempest-HostsAdminNegativeTestJSON-38431226 tempest-HostsAdminNegativeTestJSON-38431226-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022495 Aug 30 18:09:05.875066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 24/33] 10.222.0.25 () {60 vars in 1211 bytes} [Tue Aug 30 18:09:05 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:05.875066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-59a1a0fe-dcc7-4e62-83f0-57802682eb15 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1102690877", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:05.898062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-59a1a0fe-dcc7-4e62-83f0-57802682eb15 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028378 Aug 30 18:09:05.898685 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 25/34] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:05 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:05.917597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a67e402-4956-471a-a6f1-725bfa14cd40 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.949630 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a67e402-4956-471a-a6f1-725bfa14cd40 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/39430d25-1765-4398-953b-6e08f11149d8" status: 202 len: 0 microversion: 2.1 time: 0.041909 Aug 30 18:09:05.950229 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 26/35] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:05 2022] DELETE /compute/v2.1/flavors/39430d25-1765-4398-953b-6e08f11149d8 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:05.961269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0644ce31-5885-4b81-8334-a445140c4d53 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:05.987088 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0644ce31-5885-4b81-8334-a445140c4d53 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030464 Aug 30 18:09:05.987966 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 27/36] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:06.028376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e696ce01-0b37-4311-bd70-62f1ee7e6940 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1360779239", "id": "172d7d0c-f13f-4e6e-a7cc-839ef32cb5fa", "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:06.057590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e696ce01-0b37-4311-bd70-62f1ee7e6940 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.033582 Aug 30 18:09:06.058833 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 28/37] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:06 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:06.084058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-817d4007-659b-477f-9148-d21a584b742b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.115064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-817d4007-659b-477f-9148-d21a584b742b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/172d7d0c-f13f-4e6e-a7cc-839ef32cb5fa" status: 202 len: 0 microversion: 2.1 time: 0.038662 Aug 30 18:09:06.116155 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 29/38] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:06 2022] DELETE /compute/v2.1/flavors/172d7d0c-f13f-4e6e-a7cc-839ef32cb5fa => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:06.132158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-481419e8-fa92-40b7-bb71-d291efd08310 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.163396 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-481419e8-fa92-40b7-bb71-d291efd08310 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038367 Aug 30 18:09:06.165242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 30/39] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:06.185206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61513ebd-59d8-4596-8cd2-e58dff3bda41 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-936139441", "id": 730099065, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:06.215521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61513ebd-59d8-4596-8cd2-e58dff3bda41 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.034950 Aug 30 18:09:06.216266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 31/40] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:06 2022] POST /compute/v2.1/flavors => generated 410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:06.231951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1dcd891-d636-44b8-a16b-a7b490b31c7b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.258115 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1dcd891-d636-44b8-a16b-a7b490b31c7b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/730099065" status: 200 len: 410 microversion: 2.1 time: 0.033143 Aug 30 18:09:06.258739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 32/41] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:09:06 2022] GET /compute/v2.1/flavors/730099065 => generated 410 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:06.563726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-303aa505-fb60-4ba3-9419-520272ec3744 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.143177 Aug 30 18:09:06.564551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 10/42] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:06.915706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9469cb63-7497-4357-af7e-a83f77fc1d3a tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.953391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9469cb63-7497-4357-af7e-a83f77fc1d3a tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.684679 Aug 30 18:09:06.962592 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 33/43] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:06 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:06.977069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfcc5c9f-f133-4603-8352-25c0a0cfc668 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:06.993334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:07.004374 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfcc5c9f-f133-4603-8352-25c0a0cfc668 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/730099065" status: 202 len: 0 microversion: 2.1 time: 0.034433 Aug 30 18:09:07.005182 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 34/44] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:06 2022] DELETE /compute/v2.1/flavors/730099065 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:07.015537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa2bb6f1-072b-4c71-a855-0b21903d62b3 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.040791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa2bb6f1-072b-4c71-a855-0b21903d62b3 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030394 Aug 30 18:09:07.041390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 35/45] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.060733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf7604cb-46c0-48d1-a076-57029e0fd10a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-195754466", "id": 1812474198, "os-flavor-access:is_public": "False"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:07.084294 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf7604cb-46c0-48d1-a076-57029e0fd10a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.027777 Aug 30 18:09:07.085322 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 36/46] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:07 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.097301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f21b8be6-bcf3-4df5-a139-30c34e531f34 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "1812474198"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:07.124516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f21b8be6-bcf3-4df5-a139-30c34e531f34 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] HTTP exception thrown: Flavor 1812474198 could not be found. Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f21b8be6-bcf3-4df5-a139-30c34e531f34 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Request method failure captured: Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 107 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI8xj21ZF3-8k16ipJHSbpC3QWpZmZYgq7WvDGuLB5QLHINkVA2n0ZHOmoac6mtKHkycK4sik01Y9w-OxARfJvV4gx5YfB3-i242mTAo4Yc5P-gMa4FrqwMI65IDjnFZOUaXySyOyec90KORadxWfnmTe7fIL_DJ6L59kjRM4c6qGY Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 81431199849c43a6b8d683de4705f985 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsAdminTestJSON-1839310695 Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:07.128800 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81431199849c43a6b8d683de4705f985"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81431199849c43a6b8d683de4705f985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81431199849c43a6b8d683de4705f985"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81431199849c43a6b8d683de4705f985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsAdminTestJSON-1839310695 Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 81431199849c43a6b8d683de4705f985 Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1839310695 Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsAdminTestJSON-1839310695-project Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 288df2507cb3484f832de3df99bba988 Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsAdminTestJSON-1839310695-project Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "test", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "1812474198"}} Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:07.130573 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor 1812474198 could not be found. Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '1812474198'}}} Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1812474198 could not be found. Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:07.131360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1812474198 could not be found. Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:07.132551 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1812474198 could not be found. Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f21b8be6-bcf3-4df5-a139-30c34e531f34 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Returning 400 to user: Flavor 1812474198 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f21b8be6-bcf3-4df5-a139-30c34e531f34 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.037280 Aug 30 18:09:07.133642 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 37/47] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:07 2022] POST /compute/v2.1/servers => generated 81 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 30 18:09:07.139560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-911084ad-b25e-4523-9239-210aa665cf94 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.160627 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-911084ad-b25e-4523-9239-210aa665cf94 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1812474198" status: 202 len: 0 microversion: 2.1 time: 0.024800 Aug 30 18:09:07.163681 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 38/48] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:07 2022] DELETE /compute/v2.1/flavors/1812474198 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:07.172119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f54e740-98e3-4884-9209-6f45e27f6559 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.193442 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f54e740-98e3-4884-9209-6f45e27f6559 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025249 Aug 30 18:09:07.194135 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 39/49] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:07.214727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e19aaa9-47fb-43c0-ba3e-1e08588307c1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-417496126", "id": 1484837741, "os-flavor-access:is_public": "False"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:07.239224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e19aaa9-47fb-43c0-ba3e-1e08588307c1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029401 Aug 30 18:09:07.239835 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 40/50] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:07 2022] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.254054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73be4630-0dd4-4b49-b154-4397d5213820 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-759852477", "id": 491809815, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:07.276979 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73be4630-0dd4-4b49-b154-4397d5213820 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027434 Aug 30 18:09:07.278777 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 41/51] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:07 2022] POST /compute/v2.1/flavors => generated 410 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.292655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3dd8797-6df8-42e6-961d-9a2d0033c9a2 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.316935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3dd8797-6df8-42e6-961d-9a2d0033c9a2 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.029898 Aug 30 18:09:07.318264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 42/52] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.331858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4022c3b8-d20f-428a-8991-ec043f240d6e tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.345120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4022c3b8-d20f-428a-8991-ec043f240d6e tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.018429 Aug 30 18:09:07.347659 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 43/53] 10.222.0.25 () {58 vars in 1177 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:07.359494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67efc054-b3c0-402c-b4b9-2ffdff4695b9 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.380580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67efc054-b3c0-402c-b4b9-2ffdff4695b9 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.024899 Aug 30 18:09:07.381269 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 44/54] 10.222.0.25 () {58 vars in 1171 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.406558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6f8bff6-f60d-44cc-a5bb-d67e8b10289d tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.421135 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6f8bff6-f60d-44cc-a5bb-d67e8b10289d tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.027612 Aug 30 18:09:07.432207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 45/55] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:07.438804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca4b688c-81c6-4b2a-a08c-9b22210ce92b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.477254 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca4b688c-81c6-4b2a-a08c-9b22210ce92b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.042930 Aug 30 18:09:07.491230 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 46/56] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.515312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-52879f51-55c5-4be4-be36-b3e82b6c1b73 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.522871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1090334592", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "availability_zone": "tempest-test_az-956367303"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:07.556027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-52879f51-55c5-4be4-be36-b3e82b6c1b73 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.048886 Aug 30 18:09:07.573247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 47/57] 10.222.0.25 () {58 vars in 1175 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.592794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04bfc83d-d045-46a8-8996-8c574b29e42f tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.640537 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04bfc83d-d045-46a8-8996-8c574b29e42f tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.056237 Aug 30 18:09:07.642501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.648975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.650386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:07.653370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:07.655938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 48/58] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.656746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:07.657541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:07.681004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f5cd271-5d1a-469d-b125-69c6290e2447 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.718556 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f5cd271-5d1a-469d-b125-69c6290e2447 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.045479 Aug 30 18:09:07.720005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 49/59] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:07.757822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39c59e4d-9f10-4c8a-a5af-e8cca4d7826b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.793891 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39c59e4d-9f10-4c8a-a5af-e8cca4d7826b tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/491809815" status: 202 len: 0 microversion: 2.1 time: 0.043327 Aug 30 18:09:07.795582 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 50/60] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:07 2022] DELETE /compute/v2.1/flavors/491809815 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:09:07.808977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c807bc11-f321-4f91-bb04-0ce052d2726f tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.866953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c807bc11-f321-4f91-bb04-0ce052d2726f tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064564 Aug 30 18:09:07.868417 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 51/61] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:07.900452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d537da70-f94f-42ae-ab75-5169f302ec8a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:07.931769 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d537da70-f94f-42ae-ab75-5169f302ec8a tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1484837741" status: 202 len: 0 microversion: 2.1 time: 0.037090 Aug 30 18:09:07.932904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 52/62] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:07 2022] DELETE /compute/v2.1/flavors/1484837741 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:07.949425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-236ef12e-dc95-42cd-86a6-376ed84f6c75 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:08.002613 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-236ef12e-dc95-42cd-86a6-376ed84f6c75 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061547 Aug 30 18:09:08.017585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 53/63] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:08.043260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c5c383d-a5c9-45aa-a662-834454fe1c52 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-4939276", "id": 468230128, "os-flavor-access:is_public": "False"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:08.103947 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c5c383d-a5c9-45aa-a662-834454fe1c52 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.069038 Aug 30 18:09:08.115324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 54/64] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:08.564528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b00693a-e270-4191-927e-39afe49c4357 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1798548456", "ram": 512, "vcpus": 1, "disk": 10, "id": 1131003355, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:08.596341 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b00693a-e270-4191-927e-39afe49c4357 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.478888 Aug 30 18:09:08.598234 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 55/65] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:08 2022] POST /compute/v2.1/flavors => generated 416 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:08.609259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36aef42e-f110-4e9b-b905-f58bb1296106 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:08.648057 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36aef42e-f110-4e9b-b905-f58bb1296106 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.047899 Aug 30 18:09:08.649716 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 56/66] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:08 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:09.062168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:09:09.346170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a41c346f-bbf0-48bd-9cfc-51c79e172fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.361353 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-a41c346f-bbf0-48bd-9cfc-51c79e172fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] HTTP exception thrown: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a41c346f-bbf0-48bd-9cfc-51c79e172fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Request method failure captured: Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJBvuZifC_63ynoMhuV8reIcUWJEUR0iYadApk-6ahooN_1wsc_HUu0sFb6aqdP7tYJmIJ1ZGDeGysz_chI_VmMaZnf37Abz5maqMxMUJoIhCHN3q3_MgJ4ZkCnk_zL7P_nN9u3OpvxKbEjutam8uCZlvgo_UG5A5xlyZdhVM5QjQs Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:09.364348 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 86cc16cb45284dadb9748f979225f0cc Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:09.365488 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'id': 'hw:cpu_thread_policy'} Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.366118 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.367248 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.369722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a41c346f-bbf0-48bd-9cfc-51c79e172fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Returning 404 to user: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.370839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a41c346f-bbf0-48bd-9cfc-51c79e172fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] 10.222.0.25 "GET /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.718946 Aug 30 18:09:09.372763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 57/67] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:09:08 2022] GET /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 721 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:09.381886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-35e9cddf-bb5a-4447-8dbf-1275344498f2 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.415755 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-35e9cddf-bb5a-4447-8dbf-1275344498f2 tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.041455 Aug 30 18:09:09.416960 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 58/68] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:09.423151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0322acd3-86c1-4385-ab16-b22b4eb6417c tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.428014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0322acd3-86c1-4385-ab16-b22b4eb6417c tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '86cc16cb45284dadb9748f979225f0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de43e4f242f4bc1a006998ec2cdd059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0322acd3-86c1-4385-ab16-b22b4eb6417c tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Request method failure captured: Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/flavors/1131003355/os-extra_specs HTTP/1.1 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 66 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJBvuZifC_63ynoMhuV8reIcUWJEUR0iYadApk-6ahooN_1wsc_HUu0sFb6aqdP7tYJmIJ1ZGDeGysz_chI_VmMaZnf37Abz5maqMxMUJoIhCHN3q3_MgJ4ZkCnk_zL7P_nN9u3OpvxKbEjutam8uCZlvgo_UG5A5xlyZdhVM5QjQs Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:09.431002 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 86cc16cb45284dadb9748f979225f0cc Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 30 18:09:09.432206 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:09.432859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 18:09:09.433808 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.436539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0322acd3-86c1-4385-ab16-b22b4eb6417c tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.437683 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0322acd3-86c1-4385-ab16-b22b4eb6417c tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] 10.222.0.25 "POST /compute/v2.1/flavors/1131003355/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019416 Aug 30 18:09:09.438495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 59/69] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:09:09 2022] POST /compute/v2.1/flavors/1131003355/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:09.446492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09e60d52-8661-40ae-91e2-5905293b84dd tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.458681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:09:09.459616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:09:09.460832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:09:09.462022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:09:09.463064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:09:09.472554 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09e60d52-8661-40ae-91e2-5905293b84dd tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/468230128" status: 202 len: 0 microversion: 2.1 time: 0.032066 Aug 30 18:09:09.474825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 60/70] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:09 2022] DELETE /compute/v2.1/flavors/468230128 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:09.481754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b9ed571-cb87-4d1d-aff5-e9291658404a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.507914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.509514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.510498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.512399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:09.513624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:09.514682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:09.542685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b9ed571-cb87-4d1d-aff5-e9291658404a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1131003355/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066350 Aug 30 18:09:09.543886 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 61/71] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:09:09 2022] POST /compute/v2.1/flavors/1131003355/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:09:09.549433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-398a88a3-7c5f-4eec-9ed8-6e248ae3da01 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.578924 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-398a88a3-7c5f-4eec-9ed8-6e248ae3da01 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.033194 Aug 30 18:09:09.579876 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 62/72] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:09.588606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Getting quotas for project 62c73e35b266408f98a70776767acea7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:09:09.598755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74640e82-f150-4096-8e94-1d89648ebbd1 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.600371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-74640e82-f150-4096-8e94-1d89648ebbd1 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '86cc16cb45284dadb9748f979225f0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de43e4f242f4bc1a006998ec2cdd059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:09.600825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Getting quotas for user 54f1e81f3b95443bb22f8dba20c40cdc and project 62c73e35b266408f98a70776767acea7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74640e82-f150-4096-8e94-1d89648ebbd1 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Request method failure captured: Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJBvuZifC_63ynoMhuV8reIcUWJEUR0iYadApk-6ahooN_1wsc_HUu0sFb6aqdP7tYJmIJ1ZGDeGysz_chI_VmMaZnf37Abz5maqMxMUJoIhCHN3q3_MgJ4ZkCnk_zL7P_nN9u3OpvxKbEjutam8uCZlvgo_UG5A5xlyZdhVM5QjQs Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:09.603000 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 86cc16cb45284dadb9748f979225f0cc Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:09.604225 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'id': 'hw:numa_nodes'} Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:09.604833 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.605871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74640e82-f150-4096-8e94-1d89648ebbd1 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.610168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74640e82-f150-4096-8e94-1d89648ebbd1 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028835 Aug 30 18:09:09.612855 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 63/73] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:09:09 2022] DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:09.624216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4d8c9f6-4ae9-4c36-aaa6-ab111f0194c2 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2006754564", "id": 305887840, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.624777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:09:09.628527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:09:09.649505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4d8c9f6-4ae9-4c36-aaa6-ab111f0194c2 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.034964 Aug 30 18:09:09.650277 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 64/74] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:09 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:09.661809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c644e5f-b399-4199-a697-5b6e285a5853 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.675891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:09.722306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c644e5f-b399-4199-a697-5b6e285a5853 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1131003355/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069338 Aug 30 18:09:09.724508 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 65/75] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:09:09 2022] POST /compute/v2.1/flavors/1131003355/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:09:09.735347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4335bf42-d3e9-4a50-9ba9-eff175b0c2bc tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.735648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a991692-c9d6-4ea4-b5db-628e8f4ca916 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.884623 Aug 30 18:09:09.748270 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 11/76] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:09:09.749309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be1b34f1-bd00-4538-8bab-ccf710056326 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.762736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be1b34f1-bd00-4538-8bab-ccf710056326 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '86cc16cb45284dadb9748f979225f0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de43e4f242f4bc1a006998ec2cdd059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be1b34f1-bd00-4538-8bab-ccf710056326 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Request method failure captured: Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 22 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJBvuZifC_63ynoMhuV8reIcUWJEUR0iYadApk-6ahooN_1wsc_HUu0sFb6aqdP7tYJmIJ1ZGDeGysz_chI_VmMaZnf37Abz5maqMxMUJoIhCHN3q3_MgJ4ZkCnk_zL7P_nN9u3OpvxKbEjutam8uCZlvgo_UG5A5xlyZdhVM5QjQs Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:09.767261 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6de43e4f242f4bc1a006998ec2cdd059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 6de43e4f242f4bc1a006998ec2cdd059 Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 86cc16cb45284dadb9748f979225f0cc Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: {"hw:numa_nodes": "1"} Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:09.769918 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'flavor_id': '1131003355', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:09.771659 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 18:09:09.774557 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.780804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be1b34f1-bd00-4538-8bab-ccf710056326 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.782843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be1b34f1-bd00-4538-8bab-ccf710056326 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812 tempest-FlavorsExtraSpecsNegativeTestJSON-1384763812-project] 10.222.0.25 "PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.042465 Aug 30 18:09:09.784149 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 12/77] 10.222.0.25 () {60 vars in 1265 bytes} [Tue Aug 30 18:09:09 2022] PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes => generated 124 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:09.805427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d45fa91c-c25d-4c12-b14d-2e19aaf15bfa tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.807207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d45fa91c-c25d-4c12-b14d-2e19aaf15bfa tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:09.811176 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4335bf42-d3e9-4a50-9ba9-eff175b0c2bc tempest-FlavorsAdminTestJSON-1839310695 tempest-FlavorsAdminTestJSON-1839310695-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.083949 Aug 30 18:09:09.814225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 66/78] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:09.823387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1465d41c-52a4-4794-bf9b-0089bea9d66a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.846182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1465d41c-52a4-4794-bf9b-0089bea9d66a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] HTTP exception thrown: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1465d41c-52a4-4794-bf9b-0089bea9d66a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Request method failure captured: Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJDB6F78JexlgbUtaG9gh2lS2c_cYKpGDthbNnnHTCoJLMz3XfvDWxNfDKRHYVy4vItmPZ-R8PEX70LDolYD2cURyzqYhzZNAtlyCboOjboUE8cWSyrHuxWR8etRqc0khGQx3WPPfK1nXunhDltwEHNTiOoowlHJ3LAB0DUG1xgJEI Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:09.848630 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c6991aebae94526acb155bd1501c08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 705af4d412374fdaa72aac74b1c9d1f5 Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:09.851683 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'id': 'hw:cpu_thread_policy'} Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.853110 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.856708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1465d41c-52a4-4794-bf9b-0089bea9d66a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Returning 404 to user: Flavor 1131003355 has no extra specs with key hw:cpu_thread_policy. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.875424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1465d41c-52a4-4794-bf9b-0089bea9d66a tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.039338 Aug 30 18:09:09.875424 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 67/79] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:09:09 2022] DELETE /compute/v2.1/flavors/1131003355/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:09.882776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39150a6b-d37a-4ec4-9680-da8afa1725b1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:09.956217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39150a6b-d37a-4ec4-9680-da8afa1725b1 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/305887840" status: 202 len: 0 microversion: 2.1 time: 0.085990 Aug 30 18:09:09.959874 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 68/80] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:09 2022] DELETE /compute/v2.1/flavors/305887840 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:09.982586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e7dadf5-5adf-43ef-93bd-9d04b1b5826b tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:09.986498 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-5e7dadf5-5adf-43ef-93bd-9d04b1b5826b tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e7dadf5-5adf-43ef-93bd-9d04b1b5826b tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Request method failure captured: Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 27 Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJDB6F78JexlgbUtaG9gh2lS2c_cYKpGDthbNnnHTCoJLMz3XfvDWxNfDKRHYVy4vItmPZ-R8PEX70LDolYD2cURyzqYhzZNAtlyCboOjboUE8cWSyrHuxWR8etRqc0khGQx3WPPfK1nXunhDltwEHNTiOoowlHJ3LAB0DUG1xgJEI Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:09.987919 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c6991aebae94526acb155bd1501c08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 705af4d412374fdaa72aac74b1c9d1f5 Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: {"hw:cpu_policy": "shared"} Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:09.989289 n-d-854119-10 devstack@n-api.service[122589]: exception: Request body and URI mismatch Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:09.990129 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e7dadf5-5adf-43ef-93bd-9d04b1b5826b tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:09.991476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e7dadf5-5adf-43ef-93bd-9d04b1b5826b tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025836 Aug 30 18:09:09.998708 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 69/81] 10.222.0.25 () {60 vars in 1265 bytes} [Tue Aug 30 18:09:09 2022] PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:09:10.002652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d45fa91c-c25d-4c12-b14d-2e19aaf15bfa tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:10.006535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b3b698e-f108-44ee-91fe-30b2e46a8833 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:10.032290 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d45fa91c-c25d-4c12-b14d-2e19aaf15bfa tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1242 microversion: 2.1 time: 0.237101 Aug 30 18:09:10.035524 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b3b698e-f108-44ee-91fe-30b2e46a8833 tempest-FlavorsAdminTestJSON-34099078 tempest-FlavorsAdminTestJSON-34099078-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.035177 Aug 30 18:09:10.038645 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 70/82] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:10.047221 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 13/83] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:09 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1242 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:10.067651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-160270fd-b32b-49da-ac42-0b28c84f682f tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-160270fd-b32b-49da-ac42-0b28c84f682f tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Request method failure captured: Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 49 Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJDB6F78JexlgbUtaG9gh2lS2c_cYKpGDthbNnnHTCoJLMz3XfvDWxNfDKRHYVy4vItmPZ-R8PEX70LDolYD2cURyzqYhzZNAtlyCboOjboUE8cWSyrHuxWR8etRqc0khGQx3WPPfK1nXunhDltwEHNTiOoowlHJ3LAB0DUG1xgJEI Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:10.077581 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c6991aebae94526acb155bd1501c08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c6991aebae94526acb155bd1501c08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0c6991aebae94526acb155bd1501c08c Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 705af4d412374fdaa72aac74b1c9d1f5 Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 30 18:09:10.079362 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '1131003355', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance: Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 30 18:09:10.080134 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.081879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-160270fd-b32b-49da-ac42-0b28c84f682f tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-160270fd-b32b-49da-ac42-0b28c84f682f tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.039782 Aug 30 18:09:10.083429 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 71/84] 10.222.0.25 () {60 vars in 1265 bytes} [Tue Aug 30 18:09:10 2022] PUT /compute/v2.1/flavors/1131003355/os-extra_specs/hw:numa_nodes => generated 117 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:10.092751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edcc150a-0bef-4e9c-87e6-119612f19c27 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:10.134223 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edcc150a-0bef-4e9c-87e6-119612f19c27 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1131003355" status: 202 len: 0 microversion: 2.1 time: 0.045639 Aug 30 18:09:10.134898 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 14/85] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:10 2022] DELETE /compute/v2.1/flavors/1131003355 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:10.144908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75e28518-3ce0-4d78-833c-6c49695facbc tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:10.186312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-75e28518-3ce0-4d78-833c-6c49695facbc tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666 tempest-FlavorsExtraSpecsNegativeTestJSON-1109440666-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046269 Aug 30 18:09:10.187506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 72/86] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:11.081017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3fff51b1-e3e8-4e79-b9da-bc7580df6280 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:11.084459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3fff51b1-e3e8-4e79-b9da-bc7580df6280 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:11.328288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3fff51b1-e3e8-4e79-b9da-bc7580df6280 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:11.359127 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3fff51b1-e3e8-4e79-b9da-bc7580df6280 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1242 microversion: 2.1 time: 0.293184 Aug 30 18:09:11.359691 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 15/87] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:11 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1242 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:12.400881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:12.403862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:12.427150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:12.427929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:12.428763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:12.430365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:12.431128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:12.432884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:14.376412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:14.410853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e110ed18-a852-4dd0-a5cc-a554be73e445 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1290 microversion: 2.1 time: 2.019264 Aug 30 18:09:14.412797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 73/88] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:12 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1290 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:15.453467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:15.470955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:15.520060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:15.527036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:15.528676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:15.533519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:15.538126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:15.545900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:16.139469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:16.247723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:16.273409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1185a9e1-02ff-48a8-93b7-4434a04d7172 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.841649 Aug 30 18:09:16.287308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 16/89] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:15 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:16.773064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b36ed533-fa6f-479e-978d-c3bdf3f5802b tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-871989478", "id": 445241135, "os-flavor-access:is_public": "False"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:16.843260 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b36ed533-fa6f-479e-978d-c3bdf3f5802b tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.710938 Aug 30 18:09:16.845133 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 74/90] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:16 2022] POST /compute/v2.1/flavors => generated 427 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:16.872125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4925531-6920-41fd-ba57-86a9d14c8c02 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "297e2c10792f46f3b2e9988c2579ade8"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:17.122710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-227963835", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:17.244440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:09:17.925550 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4925531-6920-41fd-ba57-86a9d14c8c02 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445241135/action" status: 200 len: 96 microversion: 2.1 time: 1.061186 Aug 30 18:09:17.937179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 75/91] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:09:16 2022] POST /compute/v2.1/flavors/445241135/action => generated 96 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:09:17.944188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:17.945416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:17.966027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:17.968256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:17.968946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:17.971171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:17.974696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:17.977665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:18.327303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:09:18.328563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:09:18.329282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:09:18.330246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:09:18.331314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:09:18.355076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:18.355754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:18.356291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:18.358094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:18.359781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:18.361277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:18.395032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Getting quotas for project 93894963a8184b2e9299def30242caa9. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:09:18.404916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Getting quotas for user 24f233fe35c249f0965c48297369f4ab and project 93894963a8184b2e9299def30242caa9. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:09:18.423984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:09:18.426674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:09:18.493079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:18.516511 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1a4737e-57ac-43f4-bc23-2743de764197 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.577706 Aug 30 18:09:18.519090 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 76/92] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:17 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:18.565220 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91fca32d-1d46-4519-b32f-b3d4ef6995fd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013198 Aug 30 18:09:18.567487 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 17/93] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:09:19.194935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Action: 'update', calling method: .version_select at 0x7f4e57b56af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:19.390919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-298a9604-e486-487e-a2dc-269a277f365e tempest-FlavorsAccessTestJSON-468337158 tempest-FlavorsAccessTestJSON-468337158-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:19.461599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-298a9604-e486-487e-a2dc-269a277f365e tempest-FlavorsAccessTestJSON-468337158 tempest-FlavorsAccessTestJSON-468337158-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.939982 Aug 30 18:09:19.478942 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 77/94] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:18 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:19.523338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22d77c76-8df6-4d5f-af0d-2071848befdf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:19.524291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22d77c76-8df6-4d5f-af0d-2071848befdf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:19.744642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22d77c76-8df6-4d5f-af0d-2071848befdf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:19.807660 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22d77c76-8df6-4d5f-af0d-2071848befdf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1219 microversion: 2.1 time: 0.300785 Aug 30 18:09:19.809839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 78/95] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:19 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1219 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:19.845783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5209988-a05f-44e9-96a4-c6b1e962ff5b tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "297e2c10792f46f3b2e9988c2579ade8"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:20.052640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.056734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.058413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:20.061765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.073913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.075965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:20.166902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:20.312243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e236e41-87f2-4f78-b957-0ff0e263bccf tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1" status: 200 len: 148 microversion: 2.57 time: 1.742532 Aug 30 18:09:20.322551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 18/96] 10.222.0.25 () {62 vars in 1303 bytes} [Tue Aug 30 18:09:18 2022] PUT /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1 => generated 148 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:20.344705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:20.356822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:20.373934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.375311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.376461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:20.377645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:20.378661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:20.387525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.042811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:21.048688 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5209988-a05f-44e9-96a4-c6b1e962ff5b tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445241135/action" status: 200 len: 21 microversion: 2.1 time: 1.236094 Aug 30 18:09:21.061295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 79/97] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:09:19 2022] POST /compute/v2.1/flavors/445241135/action => generated 21 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:09:21.074632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55123b4b-6619-4e1d-9649-93e118f1d98f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.739438 Aug 30 18:09:21.091469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 19/98] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:20 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:21.102589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Calling method '.version_select at 0x7f4e583c3b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:21.113661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:21.118711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:21.142887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.146910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.148768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.160333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.160333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.160333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.319024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:21.354801 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ed720d6-f4d7-4177-b3d2-804a224c77f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1223 microversion: 2.1 time: 0.258322 Aug 30 18:09:21.369307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 20/99] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:21 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:21.729780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faee7667-0179-490a-8e86-21e78224d35e", "tag": "342e1858-8080-46e3-8e83-f5e0d9ea3716"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:21.769822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.779421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.783310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.784502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.788963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.789522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.793701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.798977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.800004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.843336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Creating event network-changed:342e1858-8080-46e3-8e83-f5e0d9ea3716 for instance faee7667-0179-490a-8e86-21e78224d35e on n-h1-854119-10 Aug 30 18:09:21.850474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:09:21.851798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-702b4271-27d4-4c56-b73e-758c985c6c48 req-e22fec4e-eed8-4c91-aabd-612e8848a466 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:09:21.856345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.857512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.859035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.863211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:21.864271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:21.866702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:21.895287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.rpcapi [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 18:09:21.899465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] Releasing lock "compute-rpcapi-router" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:09:21.932521 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58454d85-2fe9-4e52-9580-f7a065edf536 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574702 Aug 30 18:09:21.934171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 21/100] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:21.943898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b3cbeba-1162-405e-bbb8-511d5c2884f5 tempest-FlavorsAccessTestJSON-468337158 tempest-FlavorsAccessTestJSON-468337158-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:21.985250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b3cbeba-1162-405e-bbb8-511d5c2884f5 tempest-FlavorsAccessTestJSON-468337158 tempest-FlavorsAccessTestJSON-468337158-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049375 Aug 30 18:09:21.986557 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 22/101] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:22.018595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dc4b4c4-e3ce-4619-91d7-7f3253cf7689 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:22.073661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dc4b4c4-e3ce-4619-91d7-7f3253cf7689 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/445241135" status: 202 len: 0 microversion: 2.1 time: 0.058858 Aug 30 18:09:22.080428 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 23/102] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:09:22 2022] DELETE /compute/v2.1/flavors/445241135 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:22.091966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f426780-aa71-4aa8-8eed-452ffa11b458 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:22.098787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9afdbf19-a791-42b0-92b3-8fdb822832e2 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1/detail" status: 200 len: 463 microversion: 2.57 time: 1.028358 Aug 30 18:09:22.103686 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 80/103] 10.222.0.25 () {60 vars in 1304 bytes} [Tue Aug 30 18:09:21 2022] GET /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1/detail => generated 463 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:22.146318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:22.148114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:22.167221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:22.168800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:22.170302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:22.172096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:22.173540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:22.174796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:22.195746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f426780-aa71-4aa8-8eed-452ffa11b458 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.112626 Aug 30 18:09:22.201163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 24/104] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:22.239288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-173ef151-8044-4fcd-b572-c447c17111f4 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1986968632", "id": 2115705955, "os-flavor-access:is_public": "False"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:22.321541 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-173ef151-8044-4fcd-b572-c447c17111f4 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.086792 Aug 30 18:09:22.334490 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 25/105] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:22 2022] POST /compute/v2.1/flavors => generated 431 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:22.345653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-988b447e-677b-46d5-bb77-5d80ab2acb78 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:22.411176 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-988b447e-677b-46d5-bb77-5d80ab2acb78 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2115705955/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.073989 Aug 30 18:09:22.412557 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 26/106] 10.222.0.25 () {58 vars in 1209 bytes} [Tue Aug 30 18:09:22 2022] GET /compute/v2.1/flavors/2115705955/os-flavor-access => generated 21 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:09:22.426204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:22.428803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:22.448723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:22.455350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:22.456308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:22.457246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:22.458036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:22.458924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:22.939014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:22.962937 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c55fc493-1d9f-44fe-9029-1cea3926734f tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.856227 Aug 30 18:09:22.990503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 81/107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:22 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:23.022100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95c96568-e1b8-4c40-b696-3af7c22f0ae3 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:23.064098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:23.103444 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6781e802-9a8b-4e00-b4f3-d1ed3f94e07a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1271 microversion: 2.1 time: 0.688578 Aug 30 18:09:23.104923 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 27/108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:22 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1271 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:23.147853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95c96568-e1b8-4c40-b696-3af7c22f0ae3 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2115705955" status: 202 len: 0 microversion: 2.1 time: 0.155449 Aug 30 18:09:23.159785 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 82/109] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:09:22 2022] DELETE /compute/v2.1/flavors/2115705955 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:09:23.172565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Action: 'update', calling method: .version_select at 0x7f4e5833f040>, body: {"quota_set": {"ram": "2048"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:23.917450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48fcddbe-09e1-408a-8169-41293bf0bbf2 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-335512540", "id": 1500777156, "os-flavor-access:is_public": "True"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:23.990858 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48fcddbe-09e1-408a-8169-41293bf0bbf2 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.882976 Aug 30 18:09:24.006383 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 28/110] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:09:23 2022] POST /compute/v2.1/flavors => generated 467 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:24.010081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48385d7a-73e5-4504-8c06-6d3d5f82c805 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.053928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48385d7a-73e5-4504-8c06-6d3d5f82c805 tempest-FlavorsAccessTestJSON-1127129799 tempest-FlavorsAccessTestJSON-1127129799-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.058280 Aug 30 18:09:24.055310 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 29/111] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:23 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:24.097806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.098370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.099292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.100291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.102771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.104494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.185328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.186808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.187419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.188620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.189253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.189855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.287253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e57aff280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.292110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.292697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.293976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.365157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.367489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.370144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.378312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcd5e993-171c-4f26-8e62-b85328cf5391 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1?user_id=109338ebfabb4e4f90d76a94d859055e" status: 200 len: 148 microversion: 2.57 time: 1.216760 Aug 30 18:09:24.382278 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 83/112] 10.222.0.25 () {62 vars in 1384 bytes} [Tue Aug 30 18:09:23 2022] PUT /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1?user_id=109338ebfabb4e4f90d76a94d859055e => generated 148 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:24.406217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.407223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:24.411368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.412351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.412978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.427322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.432742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.433794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.436312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.438304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.439103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.440861 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f618538-b286-4c3c-b364-bea5197cf468 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.383688 Aug 30 18:09:24.442644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 30/113] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:24.894031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdbbb743-288f-456a-b2da-e25bd74a70e6 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.900083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:24.913449 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdbbb743-288f-456a-b2da-e25bd74a70e6 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] 10.222.0.25 "GET /compute/v2.1/flavors/1500777156" status: 200 len: 467 microversion: 2.61 time: 0.466489 Aug 30 18:09:24.918273 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 31/114] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/flavors/1500777156 => generated 467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:24.922489 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-947a998a-ebb2-4059-b1a5-67532f0732d0 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.535894 Aug 30 18:09:24.923373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 84/115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:24.936675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.936675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:24.945359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dde005f1-9f1d-44c6-a3c4-210c2423e891 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] Calling method '.version_select at 0x7f4e58331c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:24.948953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.949628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.950175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:24.950997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:24.951578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:24.954496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.251922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:25.277012 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc175579-21e1-4314-bc09-873b1a829f30 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1277 microversion: 2.1 time: 0.347825 Aug 30 18:09:25.281888 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 32/116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:25.300714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e57a9a040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.309396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.310412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.311198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.348327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.349072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.350247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.366112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.367237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.367932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.377618 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6db6fd5d-12a2-463e-a010-7c1e0db18aa5 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.094026 Aug 30 18:09:25.379441 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 33/117] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:25.385568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b86d2cc-cbeb-46e3-b287-14bf5ba294f2 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] Action: 'update', calling method: .version_select at 0x7f4e58bc0d30>, body: {"flavor": {"description": "new"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:25.474052 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b86d2cc-cbeb-46e3-b287-14bf5ba294f2 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1500777156" status: 200 len: 468 microversion: 2.61 time: 0.089468 Aug 30 18:09:25.476763 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 34/118] 10.222.0.25 () {62 vars in 1219 bytes} [Tue Aug 30 18:09:25 2022] PUT /compute/v2.1/flavors/1500777156 => generated 468 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:25.506285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e57b56e50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.522807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.523902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.524697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.577953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.579153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.580032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.601372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.602309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.603435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.616181 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-980eb1bc-bd8d-40f1-a82c-14514c639d57 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.137592 Aug 30 18:09:25.626719 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 35/119] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:25.635220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-296d4b2c-ae10-49b8-befc-d3f68f399573 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.652756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dde005f1-9f1d-44c6-a3c4-210c2423e891 tempest-QuotasAdminTestV257-1983682956 tempest-QuotasAdminTestV257-1983682956-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1?user_id=109338ebfabb4e4f90d76a94d859055e" status: 200 len: 190 microversion: 2.57 time: 0.713385 Aug 30 18:09:25.659980 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 85/120] 10.222.0.25 () {60 vars in 1364 bytes} [Tue Aug 30 18:09:24 2022] GET /compute/v2.1/os-quota-sets/838306b626e04b4189c7739eaa5e2ff1?user_id=109338ebfabb4e4f90d76a94d859055e => generated 190 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:25.689538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e5826d670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.691921 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-296d4b2c-ae10-49b8-befc-d3f68f399573 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.063118 Aug 30 18:09:25.700830 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 36/121] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:25.723125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9047127-2472-401b-b336-9590e04b4d79 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.745492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122589) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 18:09:25.748565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.749697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.756372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.908563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.909137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.909758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.917635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9047127-2472-401b-b336-9590e04b4d79 tempest-FlavorsV261TestJSON-1357465188 tempest-FlavorsV261TestJSON-1357465188-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.203550 Aug 30 18:09:25.927976 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 37/122] 10.222.0.25 () {60 vars in 1166 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:25.954434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22d68462-7be9-427c-8941-caa9bd291ce7 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.291987 Aug 30 18:09:25.977407 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 86/123] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:25.977407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.977407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:25.991381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:25.993664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.993901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44a380b5-3b3f-4354-9037-a74ebb89a42b tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:25.994253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.994766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:25.995935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:25.996427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:25.996864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.084509 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44a380b5-3b3f-4354-9037-a74ebb89a42b tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1500777156" status: 202 len: 0 microversion: 2.61 time: 0.144363 Aug 30 18:09:26.092399 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 38/124] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Aug 30 18:09:25 2022] DELETE /compute/v2.1/flavors/1500777156 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:09:26.113008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edb2ec09-0d70-41f9-8a42-d330e809e356 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e57c17b80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.125209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb2ec09-0d70-41f9-8a42-d330e809e356 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.126025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb2ec09-0d70-41f9-8a42-d330e809e356 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.126806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb2ec09-0d70-41f9-8a42-d330e809e356 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.169919 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edb2ec09-0d70-41f9-8a42-d330e809e356 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.075778 Aug 30 18:09:26.170879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 39/125] 10.222.0.25 () {58 vars in 1179 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:26.176959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c17dd9a3-5475-4a19-baf0-5423128f9d11 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.207113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c17dd9a3-5475-4a19-baf0-5423128f9d11 tempest-FlavorsV261TestJSON-1803738592 tempest-FlavorsV261TestJSON-1803738592-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.034540 Aug 30 18:09:26.211193 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 40/126] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:26.236231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e57ae8820>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.246145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.248216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.250478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.321029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.324268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.329680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.389160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.390223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.391056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.418225 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cea8486-3a38-4f4e-a87f-7d1412c13197 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.203044 Aug 30 18:09:26.424204 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 41/127] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:26.458462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.463750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:26.509368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.510220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.517946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.532166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.533242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.535648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.877092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:26.889615 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5990d5bd-0af3-4bf4-8933-17861cfecd9b tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.929937 Aug 30 18:09:26.907232 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 87/128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:25 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:26.927067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e5826d550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:26.937337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.944554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.949949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:26.989835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:26.991924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:26.993984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.018067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47da952c-1369-417c-a7f7-a3a2bdc35631 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.108191 Aug 30 18:09:27.023753 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 88/129] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:27.043748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e58280dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:27.049984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.052798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.053574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.093295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.098382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.100832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.126311 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ff6772d-55ca-4d87-b5c9-0ecbabf2a3f3 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.091999 Aug 30 18:09:27.129638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 89/130] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:27 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:27.141794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Calling method '.version_select at 0x7f4e582805e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:27.148373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.150979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.153243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.190721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.191936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.196140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.232955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.233802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.235652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.258750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:09:27.259539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dc4d975-c010-4838-88f9-0071b860a765 tempest-HypervisorAdminTestJSON-882935323 tempest-HypervisorAdminTestJSON-882935323-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:09:27.264235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.264798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.265241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.266011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.266510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.266937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.298720 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.compute.rpcapi [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 18:09:27.299797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] Releasing lock "compute-rpcapi-router" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:09:27.362214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d6d8acf-3428-4c9e-bb90-995cd7491693 None None] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.224287 Aug 30 18:09:27.363820 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 90/131] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:09:27 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:27.553798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:27.591234 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e8213252-8d00-4547-afb4-4b132e6e214b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 1.155238 Aug 30 18:09:27.601966 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 42/132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:26 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:27.926296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:27.932349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:27.983441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.987963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.989328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:27.991548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:27.997825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:27.998519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:28.600469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:28.627531 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f64d290c-664e-480b-84ce-a0e108da51cd tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.715097 Aug 30 18:09:28.629643 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 91/133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:27 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:28.629826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:28.633518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:28.685047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:28.689295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:28.691051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:28.695525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:28.698442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:28.703057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:29.680690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:29.686384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:29.726809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:29.728242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:29.729463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:29.733209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:29.734138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:29.734975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:29.840595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:29.845194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:29.853462 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5000cb41-00d1-4b14-ae60-478aa22da047 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 1.238451 Aug 30 18:09:29.865086 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 43/134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:28 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:30.416707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:30.453849 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff3010b6-8313-45c2-b37d-035c87cc4815 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.786160 Aug 30 18:09:30.460016 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 92/135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:29 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:30.888141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:30.888828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:30.891881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=24 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:30.909338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:30.911282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:30.917635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:30.926621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:30.932496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:30.935820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:31.284584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afb60d7-9359-4d84-a9a4-b2411844a185", "tag": "89063c12-98cc-4760-879b-8800141cea74"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:31.312856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:31.313423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:31.313967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:31.365722 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] Creating event network-changed:89063c12-98cc-4760-879b-8800141cea74 for instance 2afb60d7-9359-4d84-a9a4-b2411844a185 on n-h2-854119-10 Aug 30 18:09:31.384254 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ca71081a-5d91-4def-9ac6-fbc6518ac96b req-3c0b73f4-68e4-4554-9239-187349ed5f72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103335 Aug 30 18:09:31.387618 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 93/136] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:31.489733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:31.493231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:31.498699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:31.524950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:31.527065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:31.530095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:31.532415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:31.538540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:31.541432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:31.581222 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41283f15-6b30-42fa-b444-dfbe34980cc2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.696244 Aug 30 18:09:31.582610 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 44/137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:30 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:32.042188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:32.077798 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56e2764f-0243-41d5-b7f4-f73a6e985a55 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.601566 Aug 30 18:09:32.080294 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 94/138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:31 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:32.629158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:32.630074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:32.632269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:32.655354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:32.656731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:32.657880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:32.659918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:32.661957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:32.662784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:33.103955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:33.105427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:33.119721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:33.121363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:33.122080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:33.124494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:33.125671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:33.129089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:33.140031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=82 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:33.236117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:33.270631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e91588d6-55e4-4e6f-9d5e-6bb95c913ca3 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.644628 Aug 30 18:09:33.285629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 45/139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:32 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:33.512926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:33.542765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-59a9fb29-d374-4427-8c23-0d81cc6a327d tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.443027 Aug 30 18:09:33.543673 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 95/140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:33 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:34.320812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:34.325032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:34.367944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:34.392215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:34.392215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:34.392215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:34.392215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:34.392845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:34.592008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:34.592822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:34.607447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:34.608763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:34.611709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:34.615172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:34.616466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:34.618942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:34.834250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:34.871668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5502377-bf2f-4345-86fd-8545fa69741e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.543931 Aug 30 18:09:34.890850 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 46/141] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:34 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:34.909975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:34.925256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-230a0678-50b6-411b-ae38-362d1088a328 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.338220 Aug 30 18:09:34.925974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 96/142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:34 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:35.497165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faee7667-0179-490a-8e86-21e78224d35e", "name": "network-vif-plugged", "status": "completed", "tag": "342e1858-8080-46e3-8e83-f5e0d9ea3716"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:35.516166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:35.517723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:35.518957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:35.542296 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] Creating event network-vif-plugged:342e1858-8080-46e3-8e83-f5e0d9ea3716 for instance faee7667-0179-490a-8e86-21e78224d35e on n-h1-854119-10 Aug 30 18:09:35.552486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-43a1f1b0-83e1-4692-8a96-703ba8c78c67 req-b6e9abec-83c1-4f2c-8c35-ef02591a6f0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458386 Aug 30 18:09:35.554071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 47/143] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:35.920857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:35.923062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:35.935455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=20 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:35.939844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:35.941709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:35.943139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:35.944856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:35.958402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:35.958896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:35.960758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:35.963377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:35.990267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:35.991652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:35.992894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:35.994525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:35.995682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:36.001976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:36.367108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:36.396986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.484296 Aug 30 18:09:36.399241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 97/144] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:35 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:36.403071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:36.406529 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ea77b83-37c3-4c2d-937c-9b18253fbccf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004805 Aug 30 18:09:36.408074 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 98/145] 10.222.0.25 () {56 vars in 886 bytes} [Tue Aug 30 18:09:36 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 18:09:36.544027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:36.557503 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed7181b5-2863-474c-bbbb-a85d4f566d12 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.607577 Aug 30 18:09:36.558621 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 48/146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:35 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:37.440055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:37.442288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:37.455573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=9 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:37.476072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:37.476963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:37.477727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:37.478973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:37.479744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:37.484898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:37.588453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:37.593558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:37.630415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:37.636346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:37.638537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:37.640828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:37.646101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:37.651454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:37.972005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:37.982426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-947b79b8-f175-4283-b04b-a283f6697077 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1338 microversion: 2.1 time: 0.404687 Aug 30 18:09:37.983959 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 49/147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:37 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:38.014202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:38.027426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1fe468c-a2ba-48da-b3cc-d6f4fb1d10bb tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.594764 Aug 30 18:09:38.028687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 99/148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:37 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:38.252229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Calling method '.version_select at 0x7f4e57a43040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.270295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.273232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.275226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.286213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1308120988", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:38.341385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.345425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.346712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.397344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.398754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.400395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.417126 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-94888855-17d0-4a6b-b1e8-43e7279af20a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.431001 Aug 30 18:09:38.419054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 50/149] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:38.445398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Calling method '.version_select at 0x7f4e57a43c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.450935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.452572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.454068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.464893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:09:38.465743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:09:38.473077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:09:38.476682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:09:38.479084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:09:38.506100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:38.510147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.511975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.513279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.532741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.534201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.540805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.543442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.544724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.548291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.608470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.610854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.612135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.632748 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ac93adc-ffbf-44c8-bf0e-fada81e792f2 tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-854119-10/servers" status: 200 len: 197 microversion: 2.1 time: 0.198731 Aug 30 18:09:38.635365 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 51/150] 10.222.0.25 () {58 vars in 1215 bytes} [Tue Aug 30 18:09:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-10/servers => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:38.641918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Getting quotas for project beb149780c5049f8a3b7aefe224cca76. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:09:38.655320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Getting quotas for user b4bbd17002db46c1bd704c5006886d1c and project beb149780c5049f8a3b7aefe224cca76. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:09:38.655944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Calling method '.version_select at 0x7f4e57a43790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.666937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.667547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.668005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.699123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:09:38.711172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.712416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.714912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.724171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:09:38.762149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.764646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.765411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.778897 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a2aa75c-0648-494c-989e-18ee6f9a507a tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.129421 Aug 30 18:09:38.786547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 52/151] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:38.796541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Calling method '.version_select at 0x7f4e57a434c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:38.801212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.802010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.802729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.828086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:38.829057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:38.831009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:38.839690 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b381223-059f-4f1e-8930-cc21d6586a4d tempest-HypervisorAdminUnderV252Test-277724077 tempest-HypervisorAdminUnderV252Test-277724077-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-854119-10/search" status: 200 len: 105 microversion: 2.1 time: 0.047962 Aug 30 18:09:38.841399 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 53/152] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Aug 30 18:09:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-10/search => generated 105 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:38.885487 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34ee8d8a-fb2d-49e3-9372-eb44e616e532 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.854201 Aug 30 18:09:38.887996 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 100/153] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:09:38.900329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:38.903393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:39.017509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:39.019273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:39.036214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:39.037713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:39.039616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:39.040679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:39.043010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:39.045663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:39.480374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.516451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.524645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.567697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-90530032-5622-4c3f-910f-0788734d745f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "PUT /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1359 microversion: 2.75 time: 0.671899 Aug 30 18:09:39.568371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.588187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 54/154] 10.222.0.25 () {62 vars in 1297 bytes} [Tue Aug 30 18:09:38 2022] PUT /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1359 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:39.593766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:39.594885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:39.602300 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a46a6f7e-6e6f-43b3-be5e-13864743c9d5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1488 microversion: 2.1 time: 0.588659 Aug 30 18:09:39.617252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:39.621227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:39.622692 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 101/155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:39 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1488 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:39.624854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:39.629711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:39.635895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:39.642659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:39.664532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:39.665577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:39.907813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.919056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.921728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:39.934738 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d8e06ed-824c-49ba-975f-3a8212c291bb tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1359 microversion: 2.75 time: 0.303565 Aug 30 18:09:39.946909 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 102/156] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:39 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:39.973923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:39.979328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:40.007922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.015949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.017454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.019526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.020370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.021026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.355171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:40.365228 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75e3af36-d477-4ee8-a93a-8890e322da5e tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.775519 Aug 30 18:09:40.374211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 55/157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:39 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:40.969535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:40.975338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:40.995593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.996605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:40.997785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:40.998778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:40.999439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.000051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.168673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25d8c6f0-1685-4ee2-9419-3547b903fca5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1641 microversion: 2.1 time: 1.214928 Aug 30 18:09:41.171055 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 103/158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:39 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1641 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:41.201784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:41.204495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:41.240251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.241476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.242151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.243383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.244138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.249141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.319131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:09:41.808108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:41.828257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:41.830522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:41.843734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1b0b8dd-6c09-4aba-877c-fbf30df12e0c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1411 microversion: 2.75 time: 0.880888 Aug 30 18:09:41.845003 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f03b1418-ab15-4d2b-bcb1-e01f22da834c tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "DELETE /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 204 len: 0 microversion: 2.1 time: 0.649707 Aug 30 18:09:41.847036 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 56/159] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:40 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1411 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:41.847850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 104/160] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:41 2022] DELETE /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:09:41.865505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:41.866289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:41.883647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.884776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.889340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.890384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.891169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.891765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.898060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:41.900057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:41.948468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.950024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.951496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:41.954484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:41.955921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:41.957616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:42.320404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:42.347206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e7e7834-7b92-4b14-9568-db7f766933b5 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1494 microversion: 2.1 time: 0.485932 Aug 30 18:09:42.349140 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 105/161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:41 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:42.527330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:42.572431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98848588-4316-4f05-8069-243978c74f32 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.722927 Aug 30 18:09:42.577942 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 57/162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:41 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:42.912817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:42.915705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:42.933311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:42.938212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:42.939507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:42.942514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:42.943428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:42.944695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:43.138557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:43.154890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:43.156988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:43.166836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3368969-2be9-4cf7-8a8c-ef8370d44d92 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1417 microversion: 2.75 time: 0.267074 Aug 30 18:09:43.168241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 106/163] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:42 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1417 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:43.384380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:43.388459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:43.414062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:43.414881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:43.415688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:43.416745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:43.417660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:43.418227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:43.653751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:43.673538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8acd922e-78fb-41c7-9942-7b4c635d605a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1494 microversion: 2.1 time: 0.306532 Aug 30 18:09:43.676455 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 107/164] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:43 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1494 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:43.694260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:43.696395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:43.713315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:43.714544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:43.715266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:43.716732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:43.717465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:43.718163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.010618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Calling method '.version_select at 0x7f4e579bd8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.017439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.018634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.023187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.047597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.053666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.055560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.056628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.059976 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00cb3706-e49b-4814-bea3-731ed2ab57cd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.381669 Aug 30 18:09:44.061064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 108/165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:43 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:44.083746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.085814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.087441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.100556 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7caffb40-9f08-4546-9b33-00144017c848 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.790328 Aug 30 18:09:44.102543 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 58/166] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:44.223903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.225716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:44.239699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.241032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.242110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.243977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.245100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.246284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.382927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f868c03-8a24-4a3d-b772-4d054970557c tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Calling method '.version_select at 0x7f4e57996e50>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.386874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4f868c03-8a24-4a3d-b772-4d054970557c tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '186b66f1b1594ea4afb978994b483ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62065ac4ccaf4e45a74bd988cc10d48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f868c03-8a24-4a3d-b772-4d054970557c tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Request method failure captured: Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/n-h1-854119-10/search HTTP/1.1 Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJlNUmqC_FeXvej1LLSCzaeJP7_w2HJBn4OrGIuFiltOHgGvPcSmyGYi7KOFZIBv2sw6o0X2PC7Jq1eZxBva11slqbep-EpvWbimu1yn0QVCyyvViItN_G97Vczxs0edU4eInUUQy-vOzjsZ6VMq6NVPb_0V7jXtl9BMgDKbq1FNtE Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 62065ac4ccaf4e45a74bd988cc10d48e Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:44.391277 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 62065ac4ccaf4e45a74bd988cc10d48e Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 186b66f1b1594ea4afb978994b483ecd Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 18:09:44.394144 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'n-h1-854119-10'} Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:44.395670 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 18:09:44.398189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.402186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f868c03-8a24-4a3d-b772-4d054970557c tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:44.403380 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f868c03-8a24-4a3d-b772-4d054970557c tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h1-854119-10/search" status: 403 len: 117 microversion: 2.1 time: 0.291432 Aug 30 18:09:44.406921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 109/167] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-854119-10/search => generated 117 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:44.417380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Calling method '.version_select at 0x7f4e57884f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.420704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.421280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.421929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.465610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.477597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.479918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.498115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48c84f56-6151-4e93-ba03-7d1d8b67a441 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1417 microversion: 2.75 time: 0.283133 Aug 30 18:09:44.511643 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 59/168] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1417 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:44.593592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Request method failure captured: Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJn41IEFgHBKpP5cnF8Q3rlrnbIQOJG5RSQ27ZFw-R-cx6EjjCpcFfSxTHuMU9PtAxC57yYCcGFYXz-togJE9tTwxhndZXEWmSbgm3rrZcv1dHSq1DECBbhjaOIDgzN5YzhBGi48yIhBT-Z4iqdyQo4HELlJsk8kCZ3H--fEZ6XfoE Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 4694ac7eae7a4df386a02de5bc656a6d Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:44.595117 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 4694ac7eae7a4df386a02de5bc656a6d Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: a780a19b53994c11b041b2b9e76df192 Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 18:09:44.596919 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.597886 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.599186 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.599186 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:44.599186 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:44.599186 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 18:09:44.599186 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.600536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:44.601472 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3597ad5-e1d1-42b7-b828-422028c6fd35 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.191678 Aug 30 18:09:44.602103 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 110/169] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:09:44.612721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Calling method '.version_select at 0x7f4e57a43310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.614684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.615170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.615597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.631915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.632389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.633014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.646307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.646831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.647261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.655989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aff4925f-45b9-4c51-aefb-a7fdb0f33e42 tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.048298 Aug 30 18:09:44.656578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 60/170] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:44.667810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b1c7cd6-3c09-4179-9003-16ed8a849152 tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Calling method '.version_select at 0x7f4e58345e50>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.670011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b1c7cd6-3c09-4179-9003-16ed8a849152 tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '186b66f1b1594ea4afb978994b483ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62065ac4ccaf4e45a74bd988cc10d48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b1c7cd6-3c09-4179-9003-16ed8a849152 tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Request method failure captured: Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJlNUmqC_FeXvej1LLSCzaeJP7_w2HJBn4OrGIuFiltOHgGvPcSmyGYi7KOFZIBv2sw6o0X2PC7Jq1eZxBva11slqbep-EpvWbimu1yn0QVCyyvViItN_G97Vczxs0edU4eInUUQy-vOzjsZ6VMq6NVPb_0V7jXtl9BMgDKbq1FNtE Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 62065ac4ccaf4e45a74bd988cc10d48e Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:44.671843 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62065ac4ccaf4e45a74bd988cc10d48e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 62065ac4ccaf4e45a74bd988cc10d48e Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056 Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 186b66f1b1594ea4afb978994b483ecd Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 18:09:44.673290 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1'} Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:44.674059 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 18:09:44.675206 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.677114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b1c7cd6-3c09-4179-9003-16ed8a849152 tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:44.678150 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b1c7cd6-3c09-4179-9003-16ed8a849152 tempest-HypervisorAdminNegativeUnderV252Test-1524573056 tempest-HypervisorAdminNegativeUnderV252Test-1524573056-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014246 Aug 30 18:09:44.688619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Calling method '.version_select at 0x7f4e57a434c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.690660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.691137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.691567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.694736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 111/171] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:44.705403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:44.706184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:44.709788 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] HTTP exception thrown: No hypervisor matching '686b9f7d-3be7-4882-9293-83316c04950a' could be found. Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Request method failure captured: Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hypervisors/686b9f7d-3be7-4882-9293-83316c04950a/servers HTTP/1.1 Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJn41IEFgHBKpP5cnF8Q3rlrnbIQOJG5RSQ27ZFw-R-cx6EjjCpcFfSxTHuMU9PtAxC57yYCcGFYXz-togJE9tTwxhndZXEWmSbgm3rrZcv1dHSq1DECBbhjaOIDgzN5YzhBGi48yIhBT-Z4iqdyQo4HELlJsk8kCZ3H--fEZ6XfoE Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 4694ac7eae7a4df386a02de5bc656a6d Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:44.716249 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4694ac7eae7a4df386a02de5bc656a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 4694ac7eae7a4df386a02de5bc656a6d Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480 Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a780a19b53994c11b041b2b9e76df192 Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: exception: No hypervisor matching '686b9f7d-3be7-4882-9293-83316c04950a' could be found. Aug 30 18:09:44.717564 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '686b9f7d-3be7-4882-9293-83316c04950a'} Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '686b9f7d-3be7-4882-9293-83316c04950a' could be found. Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.718251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '686b9f7d-3be7-4882-9293-83316c04950a' could be found. Aug 30 18:09:44.719286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:44.721874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.722245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] Returning 404 to user: No hypervisor matching '686b9f7d-3be7-4882-9293-83316c04950a' could be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:44.723460 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a06608d-f389-4d84-b432-00d6f60d787d tempest-HypervisorAdminNegativeUnderV252Test-1611864480 tempest-HypervisorAdminNegativeUnderV252Test-1611864480-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/686b9f7d-3be7-4882-9293-83316c04950a/servers" status: 404 len: 123 microversion: 2.1 time: 0.038670 Aug 30 18:09:44.724318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.725007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:44.726590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:44.731909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 61/172] 10.222.0.25 () {58 vars in 1281 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/os-hypervisors/686b9f7d-3be7-4882-9293-83316c04950a/servers => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:44.732407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:44.733113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.017464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:45.056373 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a04c96a0-e648-4d92-8ed2-a9e2a31ffa4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1452 microversion: 2.1 time: 0.353882 Aug 30 18:09:45.057710 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 112/173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:44 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1452 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:45.101912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:45.104166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:45.117673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.118947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.122336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.125840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.128543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.129617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.293198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faee7667-0179-490a-8e86-21e78224d35e", "name": "network-vif-deleted", "tag": "342e1858-8080-46e3-8e83-f5e0d9ea3716"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:45.306140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.307050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.307740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.327999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] Creating event network-vif-deleted:342e1858-8080-46e3-8e83-f5e0d9ea3716 for instance faee7667-0179-490a-8e86-21e78224d35e on n-h1-854119-10 Aug 30 18:09:45.340003 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0753f26a-4d36-4ee3-a85a-6f94cf2646ca req-244971ea-1759-4842-a445-01f472e34019 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055120 Aug 30 18:09:45.341457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 113/174] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:45.529330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:45.530721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:45.538747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.539360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.539985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.540861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.541389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.541903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.852987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:45.859912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:45.883091 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5af8be4a-3109-47a3-ade4-55b51e66947d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.788549 Aug 30 18:09:45.885025 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 62/175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:45 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:45.895063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afb60d7-9359-4d84-a9a4-b2411844a185", "name": "network-vif-plugged", "status": "completed", "tag": "89063c12-98cc-4760-879b-8800141cea74"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:45.914132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:45.915527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:45.916527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:45.947830 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] Creating event network-vif-plugged:89063c12-98cc-4760-879b-8800141cea74 for instance 2afb60d7-9359-4d84-a9a4-b2411844a185 on n-h2-854119-10 Aug 30 18:09:45.960561 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4ae3c1fe-55d3-4939-a2ca-0180423f66c4 req-a376dced-4ae5-4291-953b-dfc5e1f34b3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072327 Aug 30 18:09:45.962518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 63/176] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:46.056051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:46.072367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:46.076335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:46.086796 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-562efe33-2b2d-47d7-a7fb-6b13cc2347c9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1438 microversion: 2.75 time: 0.562659 Aug 30 18:09:46.088491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:46.088903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 114/177] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:45 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1438 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:46.091857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:46.118149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:46.122308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:46.137809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.138781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.139412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.141321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.142093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.142925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.146926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.152828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.155274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.161977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.162947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.166133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.403777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:09:46.404697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:09:46.405685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:09:46.406631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:09:46.407613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:09:46.478016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:46.688984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:46.719265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.722164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.725696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.729671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.732855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.734119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.853963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:46.854849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:46.855628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:46.856444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lazy-loading 'fault' on Instance uuid faee7667-0179-490a-8e86-21e78224d35e {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:09:46.951400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f1e81f3b95443bb22f8dba20c40cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c73e35b266408f98a70776767acea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:46.977686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc96c1bb-e152-4b16-aa6e-06d1fa1dde4e tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 200 len: 1328 microversion: 2.1 time: 0.900921 Aug 30 18:09:46.979233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 64/178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:46 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 1328 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:09:46.989775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:46.997804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:47.037681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:47.038590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:47.039388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:47.061867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:47.063083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:47.064584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:47.151234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.163657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.166332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.177909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8fa01084-d357-4dfb-b76a-f1b969427dae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "POST /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0/action" status: 202 len: 1495 microversion: 2.75 time: 1.063491 Aug 30 18:09:47.180810 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 115/179] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:09:46 2022] POST /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0/action => generated 1495 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 30 18:09:47.205672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:47.207038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:47.214432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:47.215271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:47.216025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:47.217053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:47.217786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:47.218449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:47.409726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.465041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.471323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.516852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6eaa694-2fce-465f-b13f-7ca7a17d54a3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.315951 Aug 30 18:09:47.518178 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 116/180] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:47 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:09:47.521937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:47.551289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-000ba7d7-2073-4d7e-b1b8-1e80a89ac7b6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1319 microversion: 2.1 time: 0.570071 Aug 30 18:09:47.552264 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 65/181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:46 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:48.008638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:48.010976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:48.052939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.053760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.054896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.060959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.062427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.068580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.136653 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] HTTP exception thrown: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Request method failure captured: Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e HTTP/1.1 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI7smRYxW8LqxF7JINnfaNpIzOXHleY_VDCTH6PA0JfAPtNPOK6RD4NE6OxIZgG0UW1BTrgIpKDWZ7zkgB9O1SFunmIGS9SxV33gUMnddg5JcCfTGXfWmVxpJ_hU3TGow1d-58zW-73_OXjov4-lIrvORNQUoya450m-WhjKzg9d80 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:48.146174 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62c73e35b266408f98a70776767acea7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62c73e35b266408f98a70776767acea7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 54f1e81f3b95443bb22f8dba20c40cdc Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:09:48.148789 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'faee7667-0179-490a-8e86-21e78224d35e'} Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:48.150052 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:09:48.153356 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:48.159982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Returning 404 to user: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:48.165778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5447a04-7263-4cc4-aef5-4abe9a49ad16 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 404 len: 111 microversion: 2.1 time: 0.163225 Aug 30 18:09:48.169116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 117/182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:47 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:48.184437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e5ef6312-c830-4e6e-80bd-e7f71e5f1d40 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:48.241761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ef6312-c830-4e6e-80bd-e7f71e5f1d40 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.242609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ef6312-c830-4e6e-80bd-e7f71e5f1d40 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.243324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ef6312-c830-4e6e-80bd-e7f71e5f1d40 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.549023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:48.551967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:48.588197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:48.596340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.598770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.601302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.604282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.606119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.610072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.765258 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e5ef6312-c830-4e6e-80bd-e7f71e5f1d40 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.589033 Aug 30 18:09:48.777769 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 66/183] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:48.777769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:48.777769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:48.796196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.796793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.798023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.798995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:48.799527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:48.801256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:48.974200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:49.002194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:49.006149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:49.035276 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-875e84ac-bb36-4468-8a65-4aa3c02d0c7e tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.493735 Aug 30 18:09:49.037381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 118/184] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:48 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:09:49.066235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61275604-75a9-46a9-90da-578ed3f1bbe6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:49.123582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:49.177317 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61275604-75a9-46a9-90da-578ed3f1bbe6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.133218 Aug 30 18:09:49.183436 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 119/185] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:49.222072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-960462bf-7708-40fa-bb1d-6dda19dcf881 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-265075771"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:49.252522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-960462bf-7708-40fa-bb1d-6dda19dcf881 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid d615411e-529a-4b82-b060-8fbb7f2835d3 for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:49.328553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:49.356084 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d3102440-c463-4848-9558-a9490874bcf5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1469 microversion: 2.1 time: 0.587645 Aug 30 18:09:49.405811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 67/186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:48 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1469 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:49.416484 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-960462bf-7708-40fa-bb1d-6dda19dcf881 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.214012 Aug 30 18:09:49.417984 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 120/187] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:49.441451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1156df3-78e3-4f70-a6cd-efafa0774ec5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:49.479298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1156df3-78e3-4f70-a6cd-efafa0774ec5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:49.480221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1156df3-78e3-4f70-a6cd-efafa0774ec5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:49.481215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1156df3-78e3-4f70-a6cd-efafa0774ec5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:49.495043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:49.914815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:50.243002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:50.243858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:50.258187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.258726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.259167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.269330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.271840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.272295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.386393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:09:50.552877 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1156df3-78e3-4f70-a6cd-efafa0774ec5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 1.119401 Aug 30 18:09:50.556239 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 121/188] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:50.571365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:50.573180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:50.598772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.600731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.603275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.607815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.611108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.611108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.689018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf99abb5-4e41-439e-85e2-2830b75c842d tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 204 len: 0 microversion: 2.1 time: 1.280735 Aug 30 18:09:50.690691 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 68/189] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:09:49 2022] DELETE /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 0 bytes in 1284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:09:50.699402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c42f87b-47f3-4dbb-8918-418a683725a2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:50.717113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c42f87b-47f3-4dbb-8918-418a683725a2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.022333 Aug 30 18:09:50.718630 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 69/190] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:09:50 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:50.729927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:50.731795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:50.743771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.745027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.746461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.753392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.754461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.755238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:50.842436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:50.856674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:50.858736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:50.878282 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a251ad68-2872-40a0-b293-b88a3cc85929 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.319163 Aug 30 18:09:50.879403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 122/191] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:50 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:50.886167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01bb015a-03fc-4640-a8cf-7ce326b582d4 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:50.898899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb015a-03fc-4640-a8cf-7ce326b582d4 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:50.900183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb015a-03fc-4640-a8cf-7ce326b582d4 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:50.900183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb015a-03fc-4640-a8cf-7ce326b582d4 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.098379 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01bb015a-03fc-4640-a8cf-7ce326b582d4 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.217619 Aug 30 18:09:51.100600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 123/192] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:51.118845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66ec600a-e380-44b4-8d96-743ae24f6b33 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:51.156751 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66ec600a-e380-44b4-8d96-743ae24f6b33 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.048755 Aug 30 18:09:51.160824 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 124/193] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:51.172371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5d5bec1-1eea-4b84-a926-be393f80a489 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-656377057"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:51.177157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-d5d5bec1-1eea-4b84-a926-be393f80a489 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 8f03e87a-4cac-44b3-9a37-329ad18edd2b for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:51.231577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5d5bec1-1eea-4b84-a926-be393f80a489 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061463 Aug 30 18:09:51.232682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 125/194] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:51.253017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c58dd6b9-e2f7-4ba3-a6c0-e8ca606f94e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:51.280979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c58dd6b9-e2f7-4ba3-a6c0-e8ca606f94e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.287022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c58dd6b9-e2f7-4ba3-a6c0-e8ca606f94e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.287643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c58dd6b9-e2f7-4ba3-a6c0-e8ca606f94e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.290414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:51.339496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a893356-4de9-45d4-aec7-c9a538176061 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1475 microversion: 2.1 time: 0.618411 Aug 30 18:09:51.340777 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 70/195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:50 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1475 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:51.625507 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c58dd6b9-e2f7-4ba3-a6c0-e8ca606f94e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.374994 Aug 30 18:09:51.625507 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 126/196] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:51.652333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:51.698059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.698618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.699296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.810546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-854119-10. Aug 30 18:09:51.910394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:51.911222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:51.921027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.921785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.922787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.924074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:51.924763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:51.925399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 40 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:51.954932 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: {"add_host": {"host": "n-h1-854119-10"}} Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:51.957435 n-d-854119-10 devstack@n-api.service[122590]: exception: Aggregate 3 already has host n-h1-854119-10. Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-854119-10'}}} Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:09:51.959074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854119-10-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 18:09:51.961209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 18:09:51.963440 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:09:51.968232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854119-10-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 18, 9, 51, 784191), 'updated_at': None, 'host': 'n-h1-854119-10', 'aggregate_id': 3}] Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:51.970223 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-854119-10. Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.972256 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-854119-10. Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:51.974682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:51.976947 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-854119-10. Aug 30 18:09:51.976947 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:51.980780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-854119-10. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:51.982069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d99c9f62-dc33-484f-91a0-a63ebffddc57 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 96 microversion: 2.1 time: 0.348444 Aug 30 18:09:51.986044 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 71/197] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 96 bytes in 353 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 30 18:09:51.999073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b30dca7-3d9d-496c-849c-cd0a324184e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:52.025704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b30dca7-3d9d-496c-849c-cd0a324184e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:52.027446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b30dca7-3d9d-496c-849c-cd0a324184e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:52.028104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b30dca7-3d9d-496c-849c-cd0a324184e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:52.154688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:52.171876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:52.176190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:52.191744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93615442-2604-46ef-9ca3-b37c15c45866 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.285817 Aug 30 18:09:52.193074 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 127/198] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:51 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:52.251257 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b30dca7-3d9d-496c-849c-cd0a324184e3 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.259362 Aug 30 18:09:52.253506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 72/199] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:09:52.279648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c3d6baf-0cc0-406a-8d0f-8ff372c9ed8f tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:52.350327 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c3d6baf-0cc0-406a-8d0f-8ff372c9ed8f tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.087181 Aug 30 18:09:52.353023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 73/200] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:52 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:52.368106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0219c821-8a19-4631-b7ab-f30bdd52f0f6 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1308423481"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:52.390157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-0219c821-8a19-4631-b7ab-f30bdd52f0f6 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 97d12087-e24e-4339-89e5-3dc1b245f88b for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:52.485267 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0219c821-8a19-4631-b7ab-f30bdd52f0f6 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126347 Aug 30 18:09:52.489835 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 74/201] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:52.506791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:52.518025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:52.540301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:52.559584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:52.560866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:52.563014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:52.564249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:52.566397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:53.020331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a55e9a4-2683-4ecf-ae17-d7d9689d203f tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e577bbca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2132075092", "description": "tempest-description-2035324692"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:53.316993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:53.347477 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a26a3c8-6fb2-4b76-b8e9-9fbf5d6cb1a1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1475 microversion: 2.1 time: 0.852039 Aug 30 18:09:53.348976 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 75/202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:52 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1475 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:53.370013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a141be06-6d4d-4285-802d-aed884d3676f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1485849168"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:53.387932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-a141be06-6d4d-4285-802d-aed884d3676f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 330caa59-92c7-46f4-b826-33b2cf6662c7 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:53.398823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:53.480856 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a141be06-6d4d-4285-802d-aed884d3676f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.129923 Aug 30 18:09:53.488635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 76/203] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:54.043093 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a55e9a4-2683-4ecf-ae17-d7d9689d203f tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.848526 Aug 30 18:09:54.044347 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 128/204] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:09:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:54.049788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:54.050850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:54.070136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:54.071010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:54.071625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:54.072572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:54.073219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:54.073814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:54.275108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:54.291483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:54.298171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:54.311687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-357b4b8a-5703-4166-896a-df849895f570 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.266019 Aug 30 18:09:54.315948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 129/205] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:54 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:54.343212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9e04212-240f-418c-a28c-2c1052b762bd tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:54.375057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9e04212-240f-418c-a28c-2c1052b762bd tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:54.375595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9e04212-240f-418c-a28c-2c1052b762bd tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:54.376074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9e04212-240f-418c-a28c-2c1052b762bd tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:54.714325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b9e04212-240f-418c-a28c-2c1052b762bd tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.395987 Aug 30 18:09:54.733235 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 130/206] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:54 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:54.733719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-932a3256-a419-4c19-b2ab-8351b59569f6 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:54.741615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-932a3256-a419-4c19-b2ab-8351b59569f6 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:54.750724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-601b746a-3e50-410a-b755-7dbc40a5e426 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e58217700>, body: {"security_group_rule": {"parent_group_id": "706cebb1-220e-410e-8d82-98292b85da67", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-932a3256-a419-4c19-b2ab-8351b59569f6 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 40 Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:54.752320 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: {"add_host": {"host": "n-h1-854119-10"}} Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:54.754961 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-854119-10'}}} Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:54.755857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 18:09:54.756916 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:54.762197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-932a3256-a419-4c19-b2ab-8351b59569f6 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:54.766606 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-932a3256-a419-4c19-b2ab-8351b59569f6 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 1.271537 Aug 30 18:09:54.769071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 77/207] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 1280 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:54.799852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:54.800839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:54.809259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:54.810197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:54.810958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:54.811977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:54.812857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:54.813485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:55.169241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:55.183296 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-102bb130-35e8-47d0-a97c-f349268ea430 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1433 microversion: 2.1 time: 0.411082 Aug 30 18:09:55.197959 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 78/208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:54 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1433 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:55.197959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afb60d7-9359-4d84-a9a4-b2411844a185", "name": "network-vif-deleted", "tag": "89063c12-98cc-4760-879b-8800141cea74"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:55.229915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:55.246408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:55.247182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:55.296790 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] Creating event network-vif-deleted:89063c12-98cc-4760-879b-8800141cea74 for instance 2afb60d7-9359-4d84-a9a4-b2411844a185 on n-h2-854119-10 Aug 30 18:09:55.304980 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f81c738c-a9bc-48a8-83c6-aa2d8905510b req-28676d89-aa6c-44fa-97a0-106854c5526d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119066 Aug 30 18:09:55.321753 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 79/209] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:55.334123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0334cc1-f54d-4d88-a9f9-fb5e96682d83 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:55.376344 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0334cc1-f54d-4d88-a9f9-fb5e96682d83 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 460 microversion: 2.1 time: 0.043637 Aug 30 18:09:55.377316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-601b746a-3e50-410a-b755-7dbc40a5e426 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.660334 Aug 30 18:09:55.386533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 80/210] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:09:55 2022] GET /compute/v2.1/os-aggregates => generated 460 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:55.395123 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 131/211] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:09:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:55.400300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5153060c-54c7-4c84-ac61-4cef064c75ac tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:55.424877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:55.433974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:55.461377 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5153060c-54c7-4c84-ac61-4cef064c75ac tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.072431 Aug 30 18:09:55.467482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:55.468991 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 81/212] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:55.482508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:55.483484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c188ff79-507d-4dc0-94c7-9274ff2b1d17 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:55.484849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:55.491341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:55.495023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:55.499423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:55.507546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c188ff79-507d-4dc0-94c7-9274ff2b1d17 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:55.508072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c188ff79-507d-4dc0-94c7-9274ff2b1d17 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:55.508766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c188ff79-507d-4dc0-94c7-9274ff2b1d17 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:55.698335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:55.742589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:55.746922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:55.767087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acc6deac-cd0f-407e-91cc-5314ff51b53b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.369668 Aug 30 18:09:55.774424 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 132/213] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:55 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:55.784887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d1f7f71-eb22-4023-bdaf-607d6686fbbb tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e57780550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1529207089", "description": "tempest-description-1698871499"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:55.856560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c188ff79-507d-4dc0-94c7-9274ff2b1d17 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.385543 Aug 30 18:09:55.892518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 82/214] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:55.911422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d24c867-3408-443a-a99b-cec3100cb039 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1576532654"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:55.927544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-8d24c867-3408-443a-a99b-cec3100cb039 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 2e1b57bb-6778-4a59-a48e-406d6f8c6699 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:55.978633 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d24c867-3408-443a-a99b-cec3100cb039 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084306 Aug 30 18:09:55.979962 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 83/215] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:56.360640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d1f7f71-eb22-4023-bdaf-607d6686fbbb tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.584512 Aug 30 18:09:56.362797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 133/216] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:09:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:56.388833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfc08343-056f-463d-bcac-4eefd86b8484 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:56.424747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4668c92e-b465-4af9-ab84-e9a81b370512 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:56.428362 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4668c92e-b465-4af9-ab84-e9a81b370512 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4668c92e-b465-4af9-ab84-e9a81b370512 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin] Request method failure captured: Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJzBAdY2mwYnytzbbMz2LTRhg_Q5VhsKRsDqQ3khtfSfWauvMKImlNC9g-7xc1VAuL0dmlZEgojZI5yDRGjQ2FZC1Z5aXKYQZksZypWIMFJPyaoZnTJHg5FhwBgnEFdzngqwTJyeh7Cs7Eh1O_dhK_p8YOGDOLMGmiQ1g1hnJ1wRcA Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 69fffab166c1472cb69f0342c291e2ac Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:56.457553 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fffab166c1472cb69f0342c291e2ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69fffab166c1472cb69f0342c291e2ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69fffab166c1472cb69f0342c291e2ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69fffab166c1472cb69f0342c291e2ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 69fffab166c1472cb69f0342c291e2ac Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 2be76ab8c49b40b58aa9b6c8ef6120bf Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:56.460206 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid timestamp for date invalid_time Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'invalid_time'} Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:56.461793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 30 18:09:56.464334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.479631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4668c92e-b465-4af9-ab84-e9a81b370512 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:56.480272 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfc08343-056f-463d-bcac-4eefd86b8484 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.111461 Aug 30 18:09:56.481193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4668c92e-b465-4af9-ab84-e9a81b370512 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361 tempest-InstanceUsageAuditLogNegativeTestJSON-936506361-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.498931 Aug 30 18:09:56.483311 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 134/217] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:56.494584 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 84/218] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Aug 30 18:09:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 513 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:09:56.505770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-234090142"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:56.509509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:56.514532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:56.533617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:56.536101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:56.537140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:56.539043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:56.540102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:56.541206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:56.570117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:56.571538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:56.575227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:56.608984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:56.612597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:56.613715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:56.647478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:56.653020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-234090142 could not be found. Aug 30 18:09:56.653446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:56.655503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:56.656564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lazy-loading 'fault' on Instance uuid 2afb60d7-9359-4d84-a9a4-b2411844a185 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 57 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:56.662595 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: {"add_host": {"host": "tempest-nonexist_host-234090142"}} Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:56.665261 n-d-854119-10 devstack@n-api.service[122589]: exception: Compute host tempest-nonexist_host-234090142 could not be found. Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-234090142'}}} Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-234090142' is not mapped to any cell Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.667722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 30 18:09:56.670423 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-234090142 could not be found. Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-234090142 could not be found. Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:56.675471 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-234090142 could not be found. Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-234090142 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:56.680539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8cec2ba0-640a-4e6f-a459-fc066a4e8a02 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 110 microversion: 2.1 time: 0.187022 Aug 30 18:09:56.684841 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 135/219] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:56 2022] POST /compute/v2.1/os-aggregates/6/action => generated 110 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:56.708986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77a0492e-6160-48e0-9ac7-7825201594b0 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e5823c790>, body: {"security_group_rule": {"parent_group_id": "a95964a4-4b7c-4ac8-a407-cae6e02f8956", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:56.804884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:56.817392 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96c98020-d10e-4ece-bcac-426497f97763 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 200 len: 1309 microversion: 2.1 time: 0.318480 Aug 30 18:09:56.819568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 85/220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:56 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:09:56.828271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aff4389e-fd9c-4696-b3e6-1b1cea4cba93 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-617965646"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:56.835623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-aff4389e-fd9c-4696-b3e6-1b1cea4cba93 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 16ca37f0-8ca6-4847-9088-d1c9f1ccd275 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:56.907426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aff4389e-fd9c-4696-b3e6-1b1cea4cba93 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.084543 Aug 30 18:09:56.911071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 86/221] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:57.160624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb34227c-2b0c-4b51-a079-08bbdcd4fd80 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.165454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb34227c-2b0c-4b51-a079-08bbdcd4fd80 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '91867a7518614ac28528c6ab7a31aadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f54d815b14aeb8441c4d0bf4870ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb34227c-2b0c-4b51-a079-08bbdcd4fd80 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Request method failure captured: Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJxwUO2lEoHhCciAONxCDumEYGGn6J7KPzfbepoFWgh3Z_mP-h-AGWD4cKNqGYA65w3wnxsEQf4-sKbJW8PuLasIOAXCkO8iFwTfgbUNMiK4Jzv7ME0wpCRsCx3lvfdIHoM3loJV3_jdm2a659l2ioZoDLWb32hNuu45pg7Qy-ymak Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 573f54d815b14aeb8441c4d0bf4870ab Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:57.168865 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 573f54d815b14aeb8441c4d0bf4870ab Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 91867a7518614ac28528c6ab7a31aadc Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project Aug 30 18:09:57.171400 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:57.172476 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 18:09:57.175172 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.177487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb34227c-2b0c-4b51-a079-08bbdcd4fd80 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:57.178596 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb34227c-2b0c-4b51-a079-08bbdcd4fd80 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.265141 Aug 30 18:09:57.180493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 87/222] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:09:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:57.191265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb8bb20e-ed41-46aa-b04c-f3eea1d9a842 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.257343 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb8bb20e-ed41-46aa-b04c-f3eea1d9a842 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.074851 Aug 30 18:09:57.264689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 88/223] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:57.274114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.275564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:57.288625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.295595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.296301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.302644 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-77a0492e-6160-48e0-9ac7-7825201594b0 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.615899 Aug 30 18:09:57.303714 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 136/224] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:09:56 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:57.316485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.316485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.316485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.325290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03278a32-e765-4a9a-b6d5-8fd6afc99f54 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:57.359025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03278a32-e765-4a9a-b6d5-8fd6afc99f54 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.360419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03278a32-e765-4a9a-b6d5-8fd6afc99f54 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.362070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03278a32-e765-4a9a-b6d5-8fd6afc99f54 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.500375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:57.522995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:57.524951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:57.535301 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fcd1fdf9-d32e-4899-8995-fcb4fccc4c0d tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.268241 Aug 30 18:09:57.537079 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 89/225] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:57 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:57.568322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f425983-703a-4ca4-bec6-3867bcbd7001 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.571781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6f425983-703a-4ca4-bec6-3867bcbd7001 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '91867a7518614ac28528c6ab7a31aadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f54d815b14aeb8441c4d0bf4870ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f425983-703a-4ca4-bec6-3867bcbd7001 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Request method failure captured: Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2018:09:57 HTTP/1.1 Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJxwUO2lEoHhCciAONxCDumEYGGn6J7KPzfbepoFWgh3Z_mP-h-AGWD4cKNqGYA65w3wnxsEQf4-sKbJW8PuLasIOAXCkO8iFwTfgbUNMiK4Jzv7ME0wpCRsCx3lvfdIHoM3loJV3_jdm2a659l2ioZoDLWb32hNuu45pg7Qy-ymak Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 573f54d815b14aeb8441c4d0bf4870ab Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:57.575060 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_573f54d815b14aeb8441c4d0bf4870ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 573f54d815b14aeb8441c4d0bf4870ab Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 91867a7518614ac28528c6ab7a31aadc Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project Aug 30 18:09:57.577521 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2022-08-30 18:09:57'} Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:57.578756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 18:09:57.581109 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.585193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f425983-703a-4ca4-bec6-3867bcbd7001 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:57.586895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f425983-703a-4ca4-bec6-3867bcbd7001 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381 tempest-InstanceUsageAuditLogNegativeTestJSON-2081214381-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 18:09:57" status: 403 len: 128 microversion: 2.1 time: 0.047889 Aug 30 18:09:57.588049 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 90/226] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:09:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2018%3A09%3A57 => generated 128 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:57.599709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0046a39b-e55c-431f-8d6a-ea9e84377f88 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0046a39b-e55c-431f-8d6a-ea9e84377f88 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 283 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:57.651378 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:57.653945 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:57.655162 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:57.656275 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.660417 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.662166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:57.662166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:57.662166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:09:57.662166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.670698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0046a39b-e55c-431f-8d6a-ea9e84377f88 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:57.672929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0046a39b-e55c-431f-8d6a-ea9e84377f88 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.082744 Aug 30 18:09:57.679440 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 91/227] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Aug 30 18:09:57 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:57.741041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2237024-45eb-42f9-b3f8-c10d27992d7b tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e57874670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-741504954", "description": "tempest-description-797617618"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:57.850149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-03278a32-e765-4a9a-b6d5-8fd6afc99f54 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.530776 Aug 30 18:09:57.851294 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 137/228] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:57.888773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e45c65df-b027-437e-a696-dabb83c9cd54 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e45c65df-b027-437e-a696-dabb83c9cd54 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 27 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:09:57.897870 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: {"aggregate": {"name": ""}} Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:57.911093 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '' Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:57.913087 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:09:57.915744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:57.921584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e45c65df-b027-437e-a696-dabb83c9cd54 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:57.927495 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e45c65df-b027-437e-a696-dabb83c9cd54 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.061786 Aug 30 18:09:57.930027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 138/229] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:57 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:09:57.945576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:57.947369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:57.980039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.982026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.983403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:57.984742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:57.985787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:57.994068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.025663 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 HTTP/1.1 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:09:58.029893 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:09:58.032673 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2afb60d7-9359-4d84-a9a4-b2411844a185'} Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:58.034418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:09:58.036842 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.039032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:58.039032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3b35f80-0c45-4955-b958-9be30b1d7bea tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 404 len: 111 microversion: 2.1 time: 0.100678 Aug 30 18:09:58.043143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 139/230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:09:57 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:58.065631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0bbd845-482b-41bd-aa54-93cfe81eefc1 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.089537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0bbd845-482b-41bd-aa54-93cfe81eefc1 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:58.090420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0bbd845-482b-41bd-aa54-93cfe81eefc1 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:58.091487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0bbd845-482b-41bd-aa54-93cfe81eefc1 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:58.222685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2237024-45eb-42f9-b3f8-c10d27992d7b tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.540761 Aug 30 18:09:58.223689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 92/231] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:09:57 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:58.252825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-675524e7-4602-4efd-9a24-b0704a9b1c4b tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1957881836"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.262214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-675524e7-4602-4efd-9a24-b0704a9b1c4b tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-675524e7-4602-4efd-9a24-b0704a9b1c4b tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 60 Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:09:58.274828 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: {"aggregate": {"name": "tempest-test_aggregate-1957881836"}} Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:58.277458 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1957881836'}}} Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:09:58.278863 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:09:58.280800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 18:09:58.285869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:58.285869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-675524e7-4602-4efd-9a24-b0704a9b1c4b tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:58.285869 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-675524e7-4602-4efd-9a24-b0704a9b1c4b tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.052260 Aug 30 18:09:58.290308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 93/232] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:09:58.298207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28084615-e43a-46d0-ac06-f1b858945304 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e5758fe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-609282723", "description": "tempest-description-1946915977"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.470944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0bbd845-482b-41bd-aa54-93cfe81eefc1 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.418652 Aug 30 18:09:58.474176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 140/233] 10.222.0.25 () {60 vars in 1191 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:58.501387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f898f188-7b62-4519-9c12-bdd29f8dc243 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-789264280"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.522569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-f898f188-7b62-4519-9c12-bdd29f8dc243 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid ea668092-468e-4eb0-91d0-50c8530afa65 for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:58.635365 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f898f188-7b62-4519-9c12-bdd29f8dc243 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.156897 Aug 30 18:09:58.640115 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 141/234] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:58.663197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99d8c0ff-3fc7-4296-b576-390fdcc27e51 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:58.727312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99d8c0ff-3fc7-4296-b576-390fdcc27e51 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.083309 Aug 30 18:09:58.730199 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 142/235] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:58 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:58.741542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1849811990", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:58.887936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:09:58.973390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28084615-e43a-46d0-ac06-f1b858945304 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.680065 Aug 30 18:09:58.974826 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 94/236] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:58.985612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:58.989485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:09:59.033950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.038218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.041271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:59.042609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.043450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.044206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:59.306611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:59.369410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:09:59.369826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:09:59.370613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:09:59.371178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:09:59.371762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:09:59.389193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.393271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.397286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:59.398462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:09:59.399278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:09:59.399744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:09:59.411151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:59.427112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:09:59.443215 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-726ca704-f325-43a1-8994-b03422cc51f0 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.466244 Aug 30 18:09:59.444412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Getting quotas for project 93894963a8184b2e9299def30242caa9. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:09:59.447407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:09:59.450837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Getting quotas for user 24f233fe35c249f0965c48297369f4ab and project 93894963a8184b2e9299def30242caa9. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:09:59.455609 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 95/237] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:09:58 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:09:59.460894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-789264280"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:59.464506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 2205eb7a-a285-441e-9b91-d8a68016ffc8 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:59.514908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-789264280 already exists. Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 59 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:09:59.520854 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: {"aggregate": {"name": "tempest-test_aggregate-789264280"}} Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:09:59.523441 n-d-854119-10 devstack@n-api.service[122590]: exception: Aggregate tempest-test_aggregate-789264280 already exists. Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-789264280'}}} Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 30 18:09:59.525447 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-789264280 already exists. Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:09:59.533382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-789264280 already exists. Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-789264280 already exists. Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-789264280 already exists. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:09:59.535802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6791f97-8b05-46cd-b11d-df512cf442e0 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.070177 Aug 30 18:09:59.541113 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 96/238] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:59 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:09:59.541113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b074608e-0c85-4a16-b300-dac9d503ec53 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-78884853"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:59.541384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:09:59.543246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-b074608e-0c85-4a16-b300-dac9d503ec53 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Generated uuid 90cd5cfa-e59c-4d2f-8ff8-4b1ccc34eadf for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:59.550781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:09:59.613205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b074608e-0c85-4a16-b300-dac9d503ec53 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.41 time: 0.083061 Aug 30 18:09:59.628369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 97/239] 10.222.0.25 () {62 vars in 1205 bytes} [Tue Aug 30 18:09:59 2022] POST /compute/v2.1/os-aggregates => generated 244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:09:59.638089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a6f49f7-da33-4c7a-808a-5cc5e05993d3 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-697108451"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:59.647954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-9a6f49f7-da33-4c7a-808a-5cc5e05993d3 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 0e7c0ff8-59cb-46da-a486-50449c5f79a7 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:09:59.698957 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a6f49f7-da33-4c7a-808a-5cc5e05993d3 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067167 Aug 30 18:09:59.701592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 98/240] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:09:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:09:59.726572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d529601-e8bb-4787-aa1e-5f2d3cfca894 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e57aff670>, body: {"security_group_rule": {"parent_group_id": "df819c62-ad4d-44b1-9df2-2a36aef4ea84", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9bdc4afe-209a-4f77-a96c-baf6af861824"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:09:59.742278 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3763d77-d7aa-4c46-ab3c-30d6dd033583 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009327 Aug 30 18:09:59.749603 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 143/241] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:09:59.772774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-372c6211-a4d0-4339-b4e4-3394c2dbb052 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:09:59.824918 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-372c6211-a4d0-4339-b4e4-3394c2dbb052 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.073266 Aug 30 18:09:59.830965 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 144/242] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:09:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:09:59.837847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf316313-a915-4881-9b8b-b1584b4b4b58 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-40958955"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:00.109994 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf316313-a915-4881-9b8b-b1584b4b4b58 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 297 microversion: 2.41 time: 0.277560 Aug 30 18:10:00.122506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 145/243] 10.222.0.25 () {62 vars in 1210 bytes} [Tue Aug 30 18:09:59 2022] PUT /compute/v2.1/os-aggregates/9 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:00.128290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-de125a4c-898c-4de1-a1a9-b8477273cbb7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.177289 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-de125a4c-898c-4de1-a1a9-b8477273cbb7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053349 Aug 30 18:10:00.182515 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 146/244] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:00 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:00.200478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa37ba50-0937-499e-9a75-5854d93cf247 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.201510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa37ba50-0937-499e-9a75-5854d93cf247 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:00.487489 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d529601-e8bb-4787-aa1e-5f2d3cfca894 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.781117 Aug 30 18:10:00.489647 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 99/245] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:09:59 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:00.494855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa35c301-2904-41df-94c5-f7b38f781cd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1274379310"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:00.498405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-aa35c301-2904-41df-94c5-f7b38f781cd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 1c0d5d2d-62aa-4d73-ba11-2e86c151d2fb for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:00.540462 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa35c301-2904-41df-94c5-f7b38f781cd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049059 Aug 30 18:10:00.548278 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 100/246] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:00.554664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe15466a-bbb5-4d05-b2f9-9b591f5971d6 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.564389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe15466a-bbb5-4d05-b2f9-9b591f5971d6 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 297 microversion: 2.41 time: 0.014362 Aug 30 18:10:00.565174 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 101/247] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 18:10:00 2022] GET /compute/v2.1/os-aggregates/9 => generated 297 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:00.578605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e44c916f-2462-4c82-b065-71d57200d1c2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.592701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e44c916f-2462-4c82-b065-71d57200d1c2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e44c916f-2462-4c82-b065-71d57200d1c2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Request method failure captured: Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI-OmRafV3vgytidzaHYKw2idbINxnbW9g0k1j7wMLckIceaip6ONxK8_G4fWk-6YNLK3DAUiYEoFLAgCzoVAlYaLj10_GIv-MJOZCTCZ2dZgnRsovZs8mXXM8mCgYXO3zwUyd-TG4k_uSxImx2b3DimUqwvAhCutiGKYLcqLWd_7I Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:10:00.596724 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e01d6080df74d73883a24903c2c1181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 425a3885bb654fb5930cd4b578258d35 Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: exception: Aggregate 10 could not be found. Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '10'} Aug 30 18:10:00.599433 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:00.601071 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Aug 30 18:10:00.603448 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.605478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e44c916f-2462-4c82-b065-71d57200d1c2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:00.605478 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e44c916f-2462-4c82-b065-71d57200d1c2 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.033536 Aug 30 18:10:00.606611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 102/248] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:00 2022] GET /compute/v2.1/os-aggregates/10 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:00.628415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.630296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:00.641188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fa37ba50-0937-499e-9a75-5854d93cf247 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.644861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:00.645946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:00.646907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:00.649352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:00.650370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:00.651312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:00.669303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa37ba50-0937-499e-9a75-5854d93cf247 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1220 microversion: 2.1 time: 0.483985 Aug 30 18:10:00.671038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 147/249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:00 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1220 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:00.711611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff307698-c68e-4ee2-8437-cbfc1470ce0f tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e577d1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1601687158", "description": "tempest-description-306406722"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:00.802866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.824786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.828998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.851952 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2ee3848-8b4b-421a-95c8-f3c340595078 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.242810 Aug 30 18:10:00.864573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 103/250] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:00 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:00.887158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b560064-deb0-403a-bae6-755533a81792 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:00.895345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b560064-deb0-403a-bae6-755533a81792 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b560064-deb0-403a-bae6-755533a81792 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:00.901467 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 18:10:00.904371 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '11'} Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:00.905959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 18:10:00.909848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:00.913909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b560064-deb0-403a-bae6-755533a81792 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:00.915926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b560064-deb0-403a-bae6-755533a81792 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 403 len: 116 microversion: 2.1 time: 0.047950 Aug 30 18:10:00.917666 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 104/251] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:00 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:00.928635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-031f519f-0eeb-4203-9cca-f20343694b75 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:00.962272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-031f519f-0eeb-4203-9cca-f20343694b75 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:00.966214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-031f519f-0eeb-4203-9cca-f20343694b75 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:00.968017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-031f519f-0eeb-4203-9cca-f20343694b75 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:00.984907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:01.474050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-031f519f-0eeb-4203-9cca-f20343694b75 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 313 microversion: 2.41 time: 0.553202 Aug 30 18:10:01.476614 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 105/252] 10.222.0.25 () {62 vars in 1232 bytes} [Tue Aug 30 18:10:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:01.512617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ec91d2e-306f-4f2f-a653-284f530594c7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:01.595466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5ec91d2e-306f-4f2f-a653-284f530594c7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ec91d2e-306f-4f2f-a653-284f530594c7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Request method failure captured: Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI-OmRafV3vgytidzaHYKw2idbINxnbW9g0k1j7wMLckIceaip6ONxK8_G4fWk-6YNLK3DAUiYEoFLAgCzoVAlYaLj10_GIv-MJOZCTCZ2dZgnRsovZs8mXXM8mCgYXO3zwUyd-TG4k_uSxImx2b3DimUqwvAhCutiGKYLcqLWd_7I Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:10:01.611000 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e01d6080df74d73883a24903c2c1181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 425a3885bb654fb5930cd4b578258d35 Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: exception: Aggregate 10 could not be found. Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '10'} Aug 30 18:10:01.612514 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:01.613272 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:01.614441 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:01.616246 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:01.616246 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:01.616246 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:01.616246 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Aug 30 18:10:01.616246 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:01.616818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ec91d2e-306f-4f2f-a653-284f530594c7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:01.626782 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ec91d2e-306f-4f2f-a653-284f530594c7 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.141957 Aug 30 18:10:01.627918 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 106/253] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 78 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:01.649966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e2d4c6e-d08f-441b-815b-56ec0de0c383 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:01.757500 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e2d4c6e-d08f-441b-815b-56ec0de0c383 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.127647 Aug 30 18:10:01.760574 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 107/254] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:01 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:01.773847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d2aaf18-b812-4b42-8748-b405241a92b2 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:01.803104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2aaf18-b812-4b42-8748-b405241a92b2 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:01.803809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2aaf18-b812-4b42-8748-b405241a92b2 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:01.804896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2aaf18-b812-4b42-8748-b405241a92b2 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:01.834126 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff307698-c68e-4ee2-8437-cbfc1470ce0f tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.142588 Aug 30 18:10:01.836514 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 148/255] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:10:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:01.854902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b6add8a-0a68-4697-867a-16fdf3c6bbfa tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-482944783", "name": "tempest-test_aggregate-678237268"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:01.992119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-3b6add8a-0a68-4697-867a-16fdf3c6bbfa tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 2052dfc7-1f07-4c42-9ad8-9e47a2e3eb1b for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:02.118891 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b6add8a-0a68-4697-867a-16fdf3c6bbfa tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.276352 Aug 30 18:10:02.120134 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 149/256] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Aug 30 18:10:01 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:02.127678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.128300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:02.140649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d2aaf18-b812-4b42-8748-b405241a92b2 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 297 microversion: 2.41 time: 0.376771 Aug 30 18:10:02.145430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:02.146861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:02.147571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:02.148550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:02.149044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:02.149468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:02.161804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 108/257] 10.222.0.25 () {62 vars in 1232 bytes} [Tue Aug 30 18:10:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 297 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:02.174645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8085ab09-25c4-4fff-8827-1c80c40c444c tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.207440 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8085ab09-25c4-4fff-8827-1c80c40c444c tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8085ab09-25c4-4fff-8827-1c80c40c444c tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:10:02.210814 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: exception: Aggregate -1 could not be found. Aug 30 18:10:02.213108 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '-1'} Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:02.214472 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:02.216475 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8085ab09-25c4-4fff-8827-1c80c40c444c tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:02.219069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8085ab09-25c4-4fff-8827-1c80c40c444c tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050157 Aug 30 18:10:02.223405 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 109/258] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:02 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:02.243809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd0be105-f98e-43dc-b819-21a4568184ef tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e575824c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1167240257", "description": "tempest-description-1683001236"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:02.319559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:02.333433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce0ee775-c558-47a9-a7c0-b21a208ef17f tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1272 microversion: 2.1 time: 0.211889 Aug 30 18:10:02.337496 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 150/259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:02 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:02.347459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.348178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:02.359198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:02.359794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:02.360309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:02.361190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:02.361836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:02.362724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:02.483090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:02.500262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:02.505173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:02.520432 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0bd3f9d-c706-4af3-b366-8dcf378dfefa tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.181547 Aug 30 18:10:02.524182 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 151/260] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:02 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:02.536879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd3006c8-4f77-4962-9f44-bdebfbf2cde6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.621438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd3006c8-4f77-4962-9f44-bdebfbf2cde6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.086236 Aug 30 18:10:02.624353 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 152/261] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:02 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:02.647102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba1a8edb-8c82-41d6-9e84-cdc513da9fe4 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.738640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba1a8edb-8c82-41d6-9e84-cdc513da9fe4 tempest-AggregatesAdminTestV241-977436362 tempest-AggregatesAdminTestV241-977436362-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.107828 Aug 30 18:10:02.744912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 153/262] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:10:02 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:02.789048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a6150db-fb7f-4722-a12e-702773b58ac2 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1575489053"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:02.803629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-5a6150db-fb7f-4722-a12e-702773b58ac2 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid fe9b1455-aa89-437d-a90d-23a44b299e7d for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:02.877594 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a6150db-fb7f-4722-a12e-702773b58ac2 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.129077 Aug 30 18:10:02.894041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 154/263] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:02.922679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd3a8048-24e4-4ff2-a98d-94facfcf9d49 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:02.994480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dd3a8048-24e4-4ff2-a98d-94facfcf9d49 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd3a8048-24e4-4ff2-a98d-94facfcf9d49 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Request method failure captured: Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI-OmRafV3vgytidzaHYKw2idbINxnbW9g0k1j7wMLckIceaip6ONxK8_G4fWk-6YNLK3DAUiYEoFLAgCzoVAlYaLj10_GIv-MJOZCTCZ2dZgnRsovZs8mXXM8mCgYXO3zwUyd-TG4k_uSxImx2b3DimUqwvAhCutiGKYLcqLWd_7I Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:10:03.001397 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e01d6080df74d73883a24903c2c1181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 425a3885bb654fb5930cd4b578258d35 Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: exception: Aggregate 12 could not be found. Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '12'} Aug 30 18:10:03.003725 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.005098 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 30 18:10:03.007112 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.008954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd3a8048-24e4-4ff2-a98d-94facfcf9d49 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:03.008954 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd3a8048-24e4-4ff2-a98d-94facfcf9d49 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.103941 Aug 30 18:10:03.018557 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 155/264] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:02 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:03.039793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d13d36a0-7130-4efb-ae8a-d6a5f74797bc tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.045545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d13d36a0-7130-4efb-ae8a-d6a5f74797bc tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d13d36a0-7130-4efb-ae8a-d6a5f74797bc tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:03.050391 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 18:10:03.052647 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '13'} Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:03.054254 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.055973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d13d36a0-7130-4efb-ae8a-d6a5f74797bc tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:03.057474 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d13d36a0-7130-4efb-ae8a-d6a5f74797bc tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/13" status: 403 len: 114 microversion: 2.1 time: 0.034356 Aug 30 18:10:03.067838 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 156/265] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/os-aggregates/13 => generated 114 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:03.081717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86b9f057-42b1-4401-87f8-14924078626a tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.111833 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-86b9f057-42b1-4401-87f8-14924078626a tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86b9f057-42b1-4401-87f8-14924078626a tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Request method failure captured: Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI-OmRafV3vgytidzaHYKw2idbINxnbW9g0k1j7wMLckIceaip6ONxK8_G4fWk-6YNLK3DAUiYEoFLAgCzoVAlYaLj10_GIv-MJOZCTCZ2dZgnRsovZs8mXXM8mCgYXO3zwUyd-TG4k_uSxImx2b3DimUqwvAhCutiGKYLcqLWd_7I Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:10:03.115292 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e01d6080df74d73883a24903c2c1181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e01d6080df74d73883a24903c2c1181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2e01d6080df74d73883a24903c2c1181 Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1233655425 Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 425a3885bb654fb5930cd4b578258d35 Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminTestJSON-1233655425-project-admin Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: exception: Aggregate 12 could not be found. Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '12'} Aug 30 18:10:03.117214 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:03.118408 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.121189 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86b9f057-42b1-4401-87f8-14924078626a tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86b9f057-42b1-4401-87f8-14924078626a tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.048149 Aug 30 18:10:03.124144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 157/266] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:03 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:03.136003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9526c169-9473-4f35-8e13-23c78da51ddc tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.187692 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9526c169-9473-4f35-8e13-23c78da51ddc tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.057360 Aug 30 18:10:03.200130 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 158/267] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:03 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:03.211322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4e3c24c-06c4-449f-8511-4fce1acddaa9 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-805453712"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:03.222694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-b4e3c24c-06c4-449f-8511-4fce1acddaa9 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 9c866204-b7c2-49da-a12c-7c5bc7822e32 for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:03.277352 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4e3c24c-06c4-449f-8511-4fce1acddaa9 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074335 Aug 30 18:10:03.289008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 159/268] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:03.299635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcd22dd1-c966-4531-af0f-400cc3976315 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.313288 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dcd22dd1-c966-4531-af0f-400cc3976315 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcd22dd1-c966-4531-af0f-400cc3976315 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:10:03.316908 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: exception: Aggregate -1 could not be found. Aug 30 18:10:03.319588 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '-1'} Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.322093 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 18:10:03.324981 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.328830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcd22dd1-c966-4531-af0f-400cc3976315 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:03.338654 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcd22dd1-c966-4531-af0f-400cc3976315 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043708 Aug 30 18:10:03.346866 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 160/269] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:03.364944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f1b4b2e-e2eb-451e-a6ee-0e1924e5d281 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.406120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f1b4b2e-e2eb-451e-a6ee-0e1924e5d281 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.059204 Aug 30 18:10:03.407527 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 161/270] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:03.427533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-093be937-2820-4545-ba60-d8dbd24bd14e tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.433712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-093be937-2820-4545-ba60-d8dbd24bd14e tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-093be937-2820-4545-ba60-d8dbd24bd14e tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:03.440569 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 18:10:03.443028 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:03.444242 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:03.445683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-093be937-2820-4545-ba60-d8dbd24bd14e tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:03.451047 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-093be937-2820-4545-ba60-d8dbd24bd14e tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.037633 Aug 30 18:10:03.451047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 162/271] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:03.466437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.467507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:03.480834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:03.481799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:03.482636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:03.483976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:03.484771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:03.485660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:03.488786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd0be105-f98e-43dc-b819-21a4568184ef tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.262749 Aug 30 18:10:03.490819 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 110/272] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:10:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:03.505004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a3bd12f-6d6a-4910-8197-a8fb3ea4302f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:03.558288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=85,nova_api:DELETE=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:03.592326 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a3bd12f-6d6a-4910-8197-a8fb3ea4302f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.099257 Aug 30 18:10:03.603874 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 111/273] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:10:03 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:03.603874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f050d52b-67ca-48ef-a318-61b64aa974de tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-975817257"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:03.625661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-f050d52b-67ca-48ef-a318-61b64aa974de tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid 9f06bed6-8eb7-46d6-8fd5-1de23740d154 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:03.628381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:03.651872 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11aa25ca-cef1-4d9c-bba3-5972ffc517b2 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1278 microversion: 2.1 time: 0.199034 Aug 30 18:10:03.653022 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 163/274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:03.683912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cec38638-679c-47fe-8806-ffe9d502e3f1 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e577808b0>, body: {"security_group_rule": {"parent_group_id": "60f3d9c8-04de-41eb-8d04-956fa516ef51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a004cfad-5f21-4e7a-bfe6-13e45c4e9baf"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:03.708103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f050d52b-67ca-48ef-a318-61b64aa974de tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111413 Aug 30 18:10:03.710284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 112/275] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:03.719852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:03.722237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:03.734426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:03.735592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:03.736855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:03.738575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:03.739861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:03.740881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:04.005284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:04.051409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:04.062070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:04.080999 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49ed416e-d3fd-4b9a-ac9c-dac0a811988b tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.368201 Aug 30 18:10:04.082179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 113/276] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:03 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:04.110394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8bb7bc22-05a9-4594-abdd-eeb0a883c1e8 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:04.139923 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8bb7bc22-05a9-4594-abdd-eeb0a883c1e8 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.051296 Aug 30 18:10:04.141177 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 114/277] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:04 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:04.164628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ae265f8-bfb0-4953-bf76-f21e42dbbbd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:04.207269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ae265f8-bfb0-4953-bf76-f21e42dbbbd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:04.208431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ae265f8-bfb0-4953-bf76-f21e42dbbbd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:04.213982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ae265f8-bfb0-4953-bf76-f21e42dbbbd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:04.740919 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ae265f8-bfb0-4953-bf76-f21e42dbbbd9 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 243 microversion: 2.1 time: 0.590535 Aug 30 18:10:04.756154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 115/278] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:10:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 243 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:04.780852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c513cde1-b4ce-4d21-aec7-97c2f16e6211 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:04.792408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cec38638-679c-47fe-8806-ffe9d502e3f1 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.124171 Aug 30 18:10:04.794271 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 164/279] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:10:03 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:04.801623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:04.808275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:04.834633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:04.835618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:04.836486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:04.837886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:04.838857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:04.840183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:04.850543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:04.865132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c513cde1-b4ce-4d21-aec7-97c2f16e6211 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.106884 Aug 30 18:10:04.866426 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 116/280] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:04 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:04.890156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b02f556-8f05-4b5a-9bbe-65eb77c9c289 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:04.911084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b02f556-8f05-4b5a-9bbe-65eb77c9c289 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '113679ae50fb4c368d1cc7c8c77d7967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8d3972ec748159ca4d3625c67ffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b02f556-8f05-4b5a-9bbe-65eb77c9c289 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Request method failure captured: Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 43 Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI726-k9olvaa99G8GBuNgKj__0th_c_bDZ-q4tE9bImvofNSp7Wc-DhCuwLCIDkvV-Vi2BuZUekSKlPTkuIgeo2ojYXvXYv5Cw8DWWoLpHA0A5qf6PclQnXy0jmv_wunp3W2HTaTd4XBF6f4pHQ-DrGSAKxkZPT-9pqem-dDinAeM Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:04.920426 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10b8d3972ec748159ca4d3625c67ffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 10b8d3972ec748159ca4d3625c67ffca Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-439994181 Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 113679ae50fb4c368d1cc7c8c77d7967 Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-439994181-project Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: {"remove_host": {"host": "n-h1-854119-10"}} Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:04.923097 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h1-854119-10'}}} Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:04.924842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 18:10:04.927244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:04.930056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b02f556-8f05-4b5a-9bbe-65eb77c9c289 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:04.930056 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b02f556-8f05-4b5a-9bbe-65eb77c9c289 tempest-AggregatesAdminNegativeTestJSON-439994181 tempest-AggregatesAdminNegativeTestJSON-439994181-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.058149 Aug 30 18:10:04.930056 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 117/281] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:10:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:04.942822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b5ecfc2-0d04-4fb2-be24-9399bfaf3a41 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e57582a60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:05.042737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:05.103459 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ae96448-81f3-463b-b4f6-599a01d6bf47 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1278 microversion: 2.1 time: 0.294227 Aug 30 18:10:05.104460 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 165/282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:04 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1278 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:05.117536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23174601-a9aa-4434-baed-0593e85104c6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609369491", "availability_zone": "tempest-test_az-39143621"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:05.133997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-23174601-a9aa-4434-baed-0593e85104c6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid 6de2639b-9157-43a6-b6c1-50dee7e1428d for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:05.217261 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23174601-a9aa-4434-baed-0593e85104c6 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.110526 Aug 30 18:10:05.228794 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 166/283] 10.222.0.25 () {60 vars in 1165 bytes} [Tue Aug 30 18:10:05 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:05.231316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fbec4c3-5e2b-4bd4-98a6-0433b308a7cb tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:05.263473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fbec4c3-5e2b-4bd4-98a6-0433b308a7cb tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:05.264274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fbec4c3-5e2b-4bd4-98a6-0433b308a7cb tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:05.265021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fbec4c3-5e2b-4bd4-98a6-0433b308a7cb tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:05.595377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fbec4c3-5e2b-4bd4-98a6-0433b308a7cb tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 227 microversion: 2.1 time: 0.372946 Aug 30 18:10:05.613099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 167/284] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:10:05 2022] POST /compute/v2.1/os-aggregates/15/action => generated 227 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:05.637025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:05.638832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:05.668361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:05.669200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:05.669907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:05.671103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:05.671900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:05.672565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:05.930989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:05.976895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:05.980576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:06.009363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04299c91-99ae-4f03-8bf1-2e271aa76a34 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.393399 Aug 30 18:10:06.011266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 168/285] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:05 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:06.021403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7155ff0-324d-4319-b3c2-359e9b183daf tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609369491_new", "availability_zone": "tempest-test_az-39143621_new"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:06.036867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:06.120390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7155ff0-324d-4319-b3c2-359e9b183daf tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:06.121742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7155ff0-324d-4319-b3c2-359e9b183daf tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:06.123005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7155ff0-324d-4319-b3c2-359e9b183daf tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:06.221254 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7155ff0-324d-4319-b3c2-359e9b183daf tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 332 microversion: 2.1 time: 0.207087 Aug 30 18:10:06.222874 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 169/286] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:10:06 2022] PUT /compute/v2.1/os-aggregates/16 => generated 332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:06.238135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2cea531-8ee2-4909-9884-2f9704a4b7bd tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:06.321729 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2cea531-8ee2-4909-9884-2f9704a4b7bd tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.094754 Aug 30 18:10:06.323163 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 170/287] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:06 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:06.350126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:06.352161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:06.373007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:06.380162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:06.381019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:06.382777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:06.390215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:06.391324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:06.651133 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4b5ecfc2-0d04-4fb2-be24-9399bfaf3a41 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a004cfad-5f21-4e7a-bfe6-13e45c4e9baf" status: 202 len: 0 microversion: 2.1 time: 1.720406 Aug 30 18:10:06.655499 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 118/288] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:04 2022] DELETE /compute/v2.1/os-security-groups/a004cfad-5f21-4e7a-bfe6-13e45c4e9baf => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:06.668280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a981072-4e98-434d-b453-1d83d6420685 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:06.709527 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a981072-4e98-434d-b453-1d83d6420685 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 335 microversion: 2.1 time: 0.043502 Aug 30 18:10:06.727289 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 119/289] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:10:06 2022] GET /compute/v2.1/os-aggregates => generated 335 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:06.749178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8e72485-0729-4837-a4e6-05d895f46348 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1670150806"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:06.758920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-a8e72485-0729-4837-a4e6-05d895f46348 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Generated uuid b2482861-6636-48db-b593-9e63f16b37fc for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:06.780660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:06.845110 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8e72485-0729-4837-a4e6-05d895f46348 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.115859 Aug 30 18:10:06.849488 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 120/290] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:06.859940 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-194e1e6b-fbf9-438e-a813-84258004e197 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1278 microversion: 2.1 time: 0.529616 Aug 30 18:10:06.864794 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 171/291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:06 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1278 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:06.870688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f964fce-5f90-4cff-b8e1-ede8c4d9b6f0 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e575a8940>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:06.891151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5507a3aa-8eec-4f42-9b8c-ddfd3a63ea4f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.001419 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5507a3aa-8eec-4f42-9b8c-ddfd3a63ea4f tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.129930 Aug 30 18:10:07.008556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 172/292] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:06 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:07.022001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:07.047221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.048343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.049623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.086749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.089414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.090545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.110983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.compute.aggregates [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 18:10:07.112254 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Request method failure captured: Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 42 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI_-u3NrTiYKN3ueXcdlKs6UBHatocF4ecHywxsy8zzsvyGUBXX0FXY_SBLgol6yh7OSIBIwcWaYgDXCcjAXvB3t5UpunRBkkhQjWw_RoIjaMVK7dopCq6Io47DsYD8Vu64h0MgQQ_AGXJSE_MuLYh0MSXOHaW3bpsfOd8Dc10iML8 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:10:07.127609 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c1d3a3997024e2c92f0ed9325878d6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 3c1d3a3997024e2c92f0ed9325878d6b Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-875513522 Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 095c88a2beb04bec94a78bdde34680f7 Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: {"remove_host": {"host": "nonexist_host"}} Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:07.130161 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot remove host nonexist_host in aggregate 17 Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 18:10:07.131783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 30 18:10:07.134231 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.136877 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Aug 30 18:10:07.141990 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.146524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:07.150056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05cb4e88-5fcc-4a50-bdae-408add8292e7 tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.136876 Aug 30 18:10:07.151898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 173/293] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:10:07 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:10:07.164472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b61dcaf-575c-41a3-b526-39d68bd36a58 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1517959327"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:07.173626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.aggregate [None req-6b61dcaf-575c-41a3-b526-39d68bd36a58 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Generated uuid adf6a314-05cc-46f1-b400-dc4ca2534cda for aggregate {{(pid=122589) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:10:07.202292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b61dcaf-575c-41a3-b526-39d68bd36a58 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047815 Aug 30 18:10:07.210106 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 174/294] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:10:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:07.238306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.238950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:07.254903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.257147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.257628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.258408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.258876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.261026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.437552 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f964fce-5f90-4cff-b8e1-ede8c4d9b6f0 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/60f3d9c8-04de-41eb-8d04-956fa516ef51" status: 200 len: 247 microversion: 2.1 time: 0.581405 Aug 30 18:10:07.438939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 121/295] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:10:06 2022] GET /compute/v2.1/os-security-groups/60f3d9c8-04de-41eb-8d04-956fa516ef51 => generated 247 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:07.477187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e205b12-887a-44cd-9245-d1a123fb29de tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.510592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:07.547526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:07.571776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:07.587424 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e205b12-887a-44cd-9245-d1a123fb29de tempest-AggregatesAdminNegativeTestJSON-875513522 tempest-AggregatesAdminNegativeTestJSON-875513522-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.132602 Aug 30 18:10:07.589269 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 122/296] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:07 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:07.606526 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da70c46b-2ec7-4939-85ef-8e9dc996db53 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.394027 Aug 30 18:10:07.607554 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 175/297] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:07 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:07.619018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-800b099b-5a9b-41c3-83c5-cf989fc65e57 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.653322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43c07656-879a-42c0-b882-4a3ffd903851 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e577d3940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-956284960", "description": "tempest-description-30671660"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:07.663526 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-800b099b-5a9b-41c3-83c5-cf989fc65e57 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.072092 Aug 30 18:10:07.666964 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 123/298] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:10:07 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:07.688082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4e3ff8f-2f87-41a2-9175-a7c2efc904f5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.813746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4e3ff8f-2f87-41a2-9175-a7c2efc904f5 tempest-AggregatesAdminTestJSON-1233655425 tempest-AggregatesAdminTestJSON-1233655425-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.130340 Aug 30 18:10:07.819262 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 124/299] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:07 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:07.836928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.837852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:07.857702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.863958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.864854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.865991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.875596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.876247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.919135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] HTTP exception thrown: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Request method failure captured: Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e HTTP/1.1 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlI7smRYxW8LqxF7JINnfaNpIzOXHleY_VDCTH6PA0JfAPtNPOK6RD4NE6OxIZgG0UW1BTrgIpKDWZ7zkgB9O1SFunmIGS9SxV33gUMnddg5JcCfTGXfWmVxpJ_hU3TGow1d-58zW-73_OXjov4-lIrvORNQUoya450m-WhjKzg9d80 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:07.927911 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62c73e35b266408f98a70776767acea7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62c73e35b266408f98a70776767acea7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 54f1e81f3b95443bb22f8dba20c40cdc Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:07.929523 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'faee7667-0179-490a-8e86-21e78224d35e'} Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:07.930190 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:07.931286 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:07.937460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Returning 404 to user: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:07.941158 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64d00e41-5e57-4bc6-aae8-0c596002363a tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "DELETE /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 404 len: 111 microversion: 2.1 time: 0.118890 Aug 30 18:10:07.945884 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 125/300] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:10:07 2022] DELETE /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:07.967253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:07.969374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:07.991977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.992770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.993376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:07.994277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:07.995180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:07.995763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:08.195086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43c07656-879a-42c0-b882-4a3ffd903851 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.570727 Aug 30 18:10:08.198511 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 176/301] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:10:07 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:08.231383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:08.233622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] [instance: faee7667-0179-490a-8e86-21e78224d35e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:08.268697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:08.269655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:08.270470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:08.271840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:08.273033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:08.274164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:08.308950 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] HTTP exception thrown: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Request method failure captured: Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e HTTP/1.1 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlI7smRYxW8LqxF7JINnfaNpIzOXHleY_VDCTH6PA0JfAPtNPOK6RD4NE6OxIZgG0UW1BTrgIpKDWZ7zkgB9O1SFunmIGS9SxV33gUMnddg5JcCfTGXfWmVxpJ_hU3TGow1d-58zW-73_OXjov4-lIrvORNQUoya450m-WhjKzg9d80 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:08.311160 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/62c73e35b266408f98a70776767acea7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/62c73e35b266408f98a70776767acea7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_62c73e35b266408f98a70776767acea7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 62c73e35b266408f98a70776767acea7 Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-940765663 Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 54f1e81f3b95443bb22f8dba20c40cdc Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AggregatesAdminTestJSON-940765663-project Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:08.313745 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'faee7667-0179-490a-8e86-21e78224d35e'} Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:08.315042 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. Aug 30 18:10:08.316909 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:08.318877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] Returning 404 to user: Instance faee7667-0179-490a-8e86-21e78224d35e could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:08.318877 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb4d68b9-2fc5-4588-8b16-fb4bf96abed3 tempest-AggregatesAdminTestJSON-940765663 tempest-AggregatesAdminTestJSON-940765663-project] 10.222.0.25 "GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e" status: 404 len: 111 microversion: 2.1 time: 0.100996 Aug 30 18:10:08.318877 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 177/302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:08 2022] GET /compute/v2.1/servers/faee7667-0179-490a-8e86-21e78224d35e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:08.783070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-303898084", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:08.985050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:10:09.266325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:09.282921 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0816e0f-483b-424e-8253-a278f3dbe79a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 1.333640 Aug 30 18:10:09.283532 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 126/303] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:07 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:09.309337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-647533c2-cde6-4e28-b5d9-87ae58b27b3c tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e575f6ca0>, body: {"security_group_rule": {"parent_group_id": "5d642214-55df-4d20-bcb1-f4ae27afb068", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:10.312139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:10:10.312933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:10:10.314253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:10:10.315990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:10:10.316469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:10:10.345704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:10.346679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:10.347326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:10.348316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:10.349975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:10.350769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:10.443165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Getting quotas for project c9c0d6bfbe664dab9895c9f526a0cf73. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:10:10.468354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Getting quotas for user 05d787b142d543d8b9b09d99084d3823 and project c9c0d6bfbe664dab9895c9f526a0cf73. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:10:10.527106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:10:10.532275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:10:10.672821 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8af303fd-0576-44f8-ba12-4ecec5092228 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.355257 Aug 30 18:10:10.693932 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 178/304] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:10:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:10:10.702640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:10.703548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:10.713908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:10.715514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:10.716266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:10.717284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:10.717986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:10.719112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:10.955844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-647533c2-cde6-4e28-b5d9-87ae58b27b3c tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.663293 Aug 30 18:10:10.957414 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 127/305] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:10:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:10.966327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:10.977340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:10.979612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:10.984903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:10.993124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:11.003709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:11.004973 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3078a281-022f-4a52-a835-1ca453bf1a9f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.308460 Aug 30 18:10:11.005890 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 179/306] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:10 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:11.009706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:11.014060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:11.023392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:11.024239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:11.025026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:11.042328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38069ded-f951-453a-8079-fd3052130436 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:11.043838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38069ded-f951-453a-8079-fd3052130436 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:11.243907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38069ded-f951-453a-8079-fd3052130436 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:11.263425 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38069ded-f951-453a-8079-fd3052130436 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1218 microversion: 2.1 time: 0.251081 Aug 30 18:10:11.265946 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 180/307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:11 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:11.292503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5855cfdf-237d-49ac-9c40-b677dcb59857 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Action: 'create', calling method: .version_select at 0x7f4e57733dc0>, body: {"security_group_rule": {"parent_group_id": "5d642214-55df-4d20-bcb1-f4ae27afb068", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:11.830740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:11.839676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bea0012-2600-4ba9-9eb8-7cc1a973d976 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 0.878912 Aug 30 18:10:11.840261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 128/308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:10 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:11.862918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dd8acf-c1aa-4f0a-a72e-3e9d56da009c", "tag": "ec9eb790-0e36-481c-bb58-b0336e916028"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:11.902028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:11.910943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:11.911373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:11.952448 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] Creating event network-changed:ec9eb790-0e36-481c-bb58-b0336e916028 for instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c on n-h1-854119-10 Aug 30 18:10:11.971632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7aab714e-f1d6-478b-9bb4-c33e0fec56de req-47b9754f-7f42-445a-8d1f-7aa408feffde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114546 Aug 30 18:10:11.977154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 129/309] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:12.049100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:12.049902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:12.080967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.081465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.081903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:12.082736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.083262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.083685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:12.278490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:12.314533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:12.320879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:12.333963 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50f32557-fbaf-4e13-a90f-480fac652f5c tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.289689 Aug 30 18:10:12.335211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 130/310] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:12 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:10:12.380971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:12.390473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:12.458368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.459247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.459707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:12.460472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.465144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.465620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:12.698590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:12.714902 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0fb555c3-edc8-4304-befe-9512ffa33539 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1214 microversion: 2.1 time: 0.374113 Aug 30 18:10:12.715538 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 131/311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:12 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:12.882627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:12.883799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:12.892259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.893274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.894129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:12.895041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:12.895684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:12.896268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.214808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:13.237522 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4fb4b3e-ac49-4ff8-b532-0d3695506ef5 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 0.360908 Aug 30 18:10:13.240967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 132/312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:12 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:13.557267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5855cfdf-237d-49ac-9c40-b677dcb59857 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 2.275903 Aug 30 18:10:13.559696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 181/313] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:10:11 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:13.570642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e57874670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.591089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.594710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:13.601251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.602759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.603802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.607545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.609215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.611133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.640208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.642205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.646732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.648075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.651040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.653505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.690789 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-467a156a-b103-4054-a251-e0922b1e99c4 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.447673 Aug 30 18:10:13.695178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 133/314] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:13.713867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d5de12a-d11c-48da-861f-f1627f26e7b1 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e575f6e50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.821157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:13.836208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:13.840096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:13.876620 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d5de12a-d11c-48da-861f-f1627f26e7b1 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5d642214-55df-4d20-bcb1-f4ae27afb068" status: 200 len: 662 microversion: 2.1 time: 0.179479 Aug 30 18:10:13.877593 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 134/315] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/os-security-groups/5d642214-55df-4d20-bcb1-f4ae27afb068 => generated 662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:13.885382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e57589d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.897446 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00e59fa6-18a2-44ed-beb2-ea01af825dd3 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1447 microversion: 2.75 time: 0.334565 Aug 30 18:10:13.901713 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 182/316] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1447 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:13.904570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.911516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.912411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.913482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.916097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.916815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.921446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:13.924148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:13.945828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.950386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.959265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:13.963465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:13.964273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:13.964904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.018653 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e5ad1637-b79a-4882-90ef-8fadf84699c6 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.138813 Aug 30 18:10:14.029442 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 135/317] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:14.038793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-083f72d4-97dd-4f47-bb43-c40295f5c5cf tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e575a8dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:14.506761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:14.574014 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63bb8a37-5daa-4199-8a04-9854abb308f7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1278 microversion: 2.1 time: 0.664537 Aug 30 18:10:14.575539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 183/318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:13 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1278 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:14.588494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e576a24c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:14.597213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.598850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.600164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.603095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.604325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.605513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.701633 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f64250e0-adeb-47a9-a365-582548f07d14 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.123814 Aug 30 18:10:14.703129 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 184/319] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Aug 30 18:10:14 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:14.718695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:14.719313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:14.738707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.741852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.742672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.744047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.745911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.747902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.912431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-083f72d4-97dd-4f47-bb43-c40295f5c5cf tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/ae8e7be8-4e61-4101-8363-7f112130efea" status: 202 len: 0 microversion: 2.1 time: 0.881086 Aug 30 18:10:14.913936 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 136/320] 10.222.0.25 () {58 vars in 1287 bytes} [Tue Aug 30 18:10:14 2022] DELETE /compute/v2.1/os-security-group-rules/ae8e7be8-4e61-4101-8363-7f112130efea => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:14.919112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e57589f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:14.926803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.928452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.929716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:14.932306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:14.935058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:14.935887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.005233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-829238f7-187c-4abf-b10d-529298cfff51 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.087392 Aug 30 18:10:15.011971 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 137/321] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:10:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:15.026456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec28dec2-3d9e-427b-be9e-f68da9796d64 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e575f6f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.236436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:15.251023 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a927670e-0d56-41ba-a5cd-6dfea8803163 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 0.546472 Aug 30 18:10:15.257621 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 185/322] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:14 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:15.266916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.273827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:15.300102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.307225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.315864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.321629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.322281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.322985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.488709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:15.502219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:15.507067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:15.517266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9751333b-83c8-47c8-b5c8-274df42eff02 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1465 microversion: 2.75 time: 0.257274 Aug 30 18:10:15.518171 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 186/323] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:15 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1465 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:15.525286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e57731dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.530317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.531814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.532653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.534005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.534730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.535360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.626603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-501e56d3-2198-40e7-b604-93c4ea3fc235 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.104393 Aug 30 18:10:15.635338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 187/324] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:10:15 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:15.641062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.649053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:15.663868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.664704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.665750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.666759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.667432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.669561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.901881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:15.922117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae0830b9-2487-4e12-9a68-593b11325340 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1276 microversion: 2.1 time: 0.285202 Aug 30 18:10:15.922940 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 188/325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:15 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:15.929168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e577339d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:15.943540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.945059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.946698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:15.948083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:15.956210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:15.956976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.030560 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f4b101d-bbcb-46d2-847c-d3a49cc93d3e tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.106317 Aug 30 18:10:16.041223 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 189/326] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:10:15 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:16.047855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e577d3f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:16.074248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.076077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.076830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.133637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.135099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.138746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.219122 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f6bb4542-67bc-4fdb-a747-62f303addbd8 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-854119-10" status: 200 len: 603 microversion: 2.1 time: 0.176305 Aug 30 18:10:16.224859 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 190/327] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:10:16 2022] GET /compute/v2.1/os-hosts/n-h1-854119-10 => generated 603 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:16.246283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Calling method '.version_select at 0x7f4e576a2550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:16.256904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.267378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.268038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.306156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.306720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.307615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.333712 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1396e65-4d71-4e09-ab46-8109571b5b15 tempest-HostsAdminTestJSON-869875037 tempest-HostsAdminTestJSON-869875037-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-854119-10" status: 200 len: 471 microversion: 2.1 time: 0.101980 Aug 30 18:10:16.334384 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 191/328] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:10:16 2022] GET /compute/v2.1/os-hosts/n-h2-854119-10 => generated 471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:16.351641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:16.353541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:16.385182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.389706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.391319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.393549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.396582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.400441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.919938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec28dec2-3d9e-427b-be9e-f68da9796d64 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5d642214-55df-4d20-bcb1-f4ae27afb068" status: 202 len: 0 microversion: 2.1 time: 1.906419 Aug 30 18:10:16.922105 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 138/329] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:15 2022] DELETE /compute/v2.1/os-security-groups/5d642214-55df-4d20-bcb1-f4ae27afb068 => generated 0 bytes in 1909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:16.937563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:16.938656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:16.951292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.952442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.953148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:16.954231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:16.955531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:16.956361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:17.091890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:17.107469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:17.117805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:17.138491 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7978d5c-8b91-4a08-a1b8-bdae630c01dc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1453 microversion: 2.75 time: 0.208738 Aug 30 18:10:17.152082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 139/330] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:16 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:17.165786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e5758f670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:17.365347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:10:17.366211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Neutron security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:10:17.367420 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] HTTP exception thrown: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.367420 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Request method failure captured: Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/a004cfad-5f21-4e7a-bfe6-13e45c4e9baf HTTP/1.1 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJvaEuOeYxnvJ5diPqTu49qdNAtgC7rMbuVb-1L41TDy2dDwLtdWmrqbxgmlgmbTM2N0cAXIWVeqXK1cRrFr8TyJxRQ2HrlYrvsDeTVQJg2vIK2fzQkFPUwPRxIjV9TLlOTsRNLYkircWBO5WwR-G1J3HjVvE6ZBSzwNHBmc1j_QMg Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a6815d20ce8348969a7399e287400f37 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1446072427 Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:17.392163 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6815d20ce8348969a7399e287400f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6815d20ce8348969a7399e287400f37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6815d20ce8348969a7399e287400f37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6815d20ce8348969a7399e287400f37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1446072427 Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a6815d20ce8348969a7399e287400f37 Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1446072427 Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesTestJSON-1446072427-project Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 652406872a9f4d239bff424cb728c852 Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1446072427-project Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.393619 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'a004cfad-5f21-4e7a-bfe6-13e45c4e9baf'} Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:10:17.394387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:10:17.395361 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.396290 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Returning 404 to user: Security group a004cfad-5f21-4e7a-bfe6-13e45c4e9baf does not exist Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-9dd16b5a-2bf3-4f15-af6d-ecab4f644c57'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:17.397399 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c4c9b66-cd08-41cc-b976-87d1adb99c39 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a004cfad-5f21-4e7a-bfe6-13e45c4e9baf" status: 404 len: 194 microversion: 2.1 time: 0.252092 Aug 30 18:10:17.399011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 140/331] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:17 2022] DELETE /compute/v2.1/os-security-groups/a004cfad-5f21-4e7a-bfe6-13e45c4e9baf => generated 194 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:17.425713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:17.434129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:17.456032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:17.456546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:17.456956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:17.457521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:17.457703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:17.458169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:17.458626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:17.470285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bc099aa3-6d08-4811-9c82-623f0573ae2b tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 1.134610 Aug 30 18:10:17.478369 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 192/332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:16 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:17.498426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3213665-d5c4-4466-92bd-67dbece59170 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e577808b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:18.084431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:18.140601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9478abc1-53f4-4090-91fc-1f71ac5a8b80 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1276 microversion: 2.1 time: 0.736824 Aug 30 18:10:18.148710 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 141/333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:17 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1276 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:18.183782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:18.187803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:18.206893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.207597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.208186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.209568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.210196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.211312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.586874 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3213665-d5c4-4466-92bd-67dbece59170 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/60f3d9c8-04de-41eb-8d04-956fa516ef51" status: 202 len: 0 microversion: 2.1 time: 1.105484 Aug 30 18:10:18.588783 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 193/334] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:17 2022] DELETE /compute/v2.1/os-security-groups/60f3d9c8-04de-41eb-8d04-956fa516ef51 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:18.638943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:18.663853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:18.684996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:18.700002 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33b572c4-b4d0-431a-9433-9d0e218bd1d9 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1438 microversion: 2.75 time: 0.532541 Aug 30 18:10:18.704698 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 142/335] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:18 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1438 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:18.714522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:18.715379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:18.732596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.733599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.734300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.735474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:18.736923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:18.738836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:18.849871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6fcca681-8519-43ae-9fc1-9f8849a06964 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1768909792", "id": 209779244, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:18.987830 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6fcca681-8519-43ae-9fc1-9f8849a06964 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.397482 Aug 30 18:10:18.996824 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 194/336] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:10:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:19.010674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fda9ddb8-b9a7-48bb-bb15-d7c22974cf22 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e579a4040>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:19.764110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:19.770274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fda9ddb8-b9a7-48bb-bb15-d7c22974cf22 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9bdc4afe-209a-4f77-a96c-baf6af861824" status: 202 len: 0 microversion: 2.1 time: 0.772079 Aug 30 18:10:19.776102 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 195/337] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:18 2022] DELETE /compute/v2.1/os-security-groups/9bdc4afe-209a-4f77-a96c-baf6af861824 => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:19.874523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc9f6aaa-81e4-4122-af15-b88f5b00cebd tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 1.153852 Aug 30 18:10:19.879072 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 143/338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:18 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:19.893526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8672bce-f92a-4c9d-93bf-f19e1498aca9 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:20.516768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:20.542507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:20.546937 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8672bce-f92a-4c9d-93bf-f19e1498aca9 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/209779244/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.666189 Aug 30 18:10:20.548199 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 144/339] 10.222.0.25 () {62 vars in 1262 bytes} [Tue Aug 30 18:10:19 2022] POST /compute/v2.1/flavors/209779244/os-extra_specs => generated 62 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:20.567018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:20.583203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:20.584358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:20.592401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.597427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.603443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.610007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.613865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.614608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.633401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.634746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.635841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.637471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:20.638580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:20.639761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:20.985852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:21.058169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:10:21.065091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:10:21.070586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:10:21.075674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:10:21.076577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:10:21.278511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=16 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:21.523065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:21.539697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:21.540494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:21.544632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:21.545707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:21.546438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:21.547120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:21.577410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:21.614744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50debeb4-cb23-402c-bf15-0f602a687b83 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 1.056726 Aug 30 18:10:21.628054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 145/340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:20 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:21.704851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd8acf-c1aa-4f0a-a72e-3e9d56da009c", "name": "network-vif-plugged", "status": "completed", "tag": "ec9eb790-0e36-481c-bb58-b0336e916028"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:21.778596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:21.787849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:21.789243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:21.883592 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] Creating event network-vif-plugged:ec9eb790-0e36-481c-bb58-b0336e916028 for instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c on n-h1-854119-10 Aug 30 18:10:21.901202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-207f76e1-466c-42b2-9acc-f9d5d180c8d7 req-32d7bd17-c492-4495-bc64-81000b488571 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220209 Aug 30 18:10:21.932637 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 146/341] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:21.958310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97492a02-99c1-48cd-8e6b-a1c88e3685bb tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e5758f9d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:22.026666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:22.385381 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d28d2a71-deb4-4435-98c5-33d8d950fe60 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0/action" status: 202 len: 1944 microversion: 2.75 time: 2.612088 Aug 30 18:10:22.386676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 196/342] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:10:19 2022] POST /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0/action => generated 1944 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 18:10:22.391846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e85f2a36-124e-4b33-8080-d37e277cac49 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:22.517421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e85f2a36-124e-4b33-8080-d37e277cac49 tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/209779244" status: 202 len: 0 microversion: 2.86 time: 0.128985 Aug 30 18:10:22.531538 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 197/343] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Aug 30 18:10:22 2022] DELETE /compute/v2.1/flavors/209779244 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:10:22.545948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:22.549687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:22.586883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:22.589231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:22.590206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:22.594389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:22.598703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:22.599859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:23.292995 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97492a02-99c1-48cd-8e6b-a1c88e3685bb tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/df819c62-ad4d-44b1-9df2-2a36aef4ea84" status: 202 len: 0 microversion: 2.1 time: 1.355017 Aug 30 18:10:23.294826 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 147/344] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:21 2022] DELETE /compute/v2.1/os-security-groups/df819c62-ad4d-44b1-9df2-2a36aef4ea84 => generated 0 bytes in 1361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:23.315625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:23.320917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:23.351764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=84,nova_api:DELETE=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:23.359357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:23.362101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:23.362916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:23.369379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:23.373371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:23.374507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:23.681324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:23.742447 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e805409-47dc-463c-be5c-bad4ad57be24 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1320 microversion: 2.1 time: 1.210286 Aug 30 18:10:23.748087 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 198/345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:22 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1320 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:23.791850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5cdd17ca-19ec-401f-a264-c6486cc82dfa tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:23.920569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5cdd17ca-19ec-401f-a264-c6486cc82dfa tempest-FlavorMetadataValidation-1864384235 tempest-FlavorMetadataValidation-1864384235-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.158564 Aug 30 18:10:23.946210 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 199/346] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:10:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:23.965930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:23.979375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:23.997647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.005804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.006568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.007801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.009020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.011874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.110804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:24.283277 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-895eb521-afcd-44a7-9c1f-96e95fb2dae0 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.986034 Aug 30 18:10:24.291678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 148/347] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:23 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:24.298648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57a73666-8812-4273-acc0-68475eaff618 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e575a83a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:24.709807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:24.727224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5fcc2c80-613b-42a7-a464-9e4fe1136c7c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 0.779522 Aug 30 18:10:24.729508 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 200/348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:23 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:24.742484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdff2654-b3dc-423e-ad30-e87fed671aed", "tag": "db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:24.792334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.798634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.799707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.845230 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] Creating event network-changed:db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0 for instance fdff2654-b3dc-423e-ad30-e87fed671aed on n-h1-854119-10 Aug 30 18:10:24.898092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c0203162-2724-4f76-8cda-e3bb16bdeb51 req-11db4b69-7ceb-48c6-bfc9-e80a2c8ce964 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163697 Aug 30 18:10:24.902456 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 201/349] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:24.940597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:24.941762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:24.957521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:24.963004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.971537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.972250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:24.978490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:24.980816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:24.981505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:25.490706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57a73666-8812-4273-acc0-68475eaff618 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a95964a4-4b7c-4ac8-a407-cae6e02f8956" status: 202 len: 0 microversion: 2.1 time: 1.197255 Aug 30 18:10:25.491683 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 149/350] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:24 2022] DELETE /compute/v2.1/os-security-groups/a95964a4-4b7c-4ac8-a407-cae6e02f8956 => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:25.510445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:25.512133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:25.538619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:25.539895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:25.541017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:25.551939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:25.555933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:25.560287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:25.654649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:25.978581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:26.282915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:26.292035 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dedaa431-cc88-4777-8d85-b4ab7e27d8c0 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1470 microversion: 2.1 time: 1.385375 Aug 30 18:10:26.299326 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 202/351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:24 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1470 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:26.322919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68e4d2c2-6f77-411e-a099-66e202a9eb55 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] Calling method '.version_select at 0x7f4e57550a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:26.638278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:26.770628 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a6ad2af-f7dc-490c-8771-a5ac0d63d85e tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 1.276378 Aug 30 18:10:26.778981 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 150/352] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:25 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:26.802422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:26.808253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:26.834654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.839379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.840603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:26.844929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:26.849617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:26.850810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:27.799263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:27.812668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f226f5d-0ddc-4769-8274-a395b12b9b7b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 1.031674 Aug 30 18:10:27.845749 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 151/353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:26 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:27.862069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:27.870865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:27.898319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:27.908670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:27.909297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:27.912212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:27.912914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:27.914877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.235536 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ffeb3fc1-a055-4f8b-8995-29d70736c413 tempest-DeleteServersAdminTestJSON-1372613665 tempest-DeleteServersAdminTestJSON-1372613665-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c/action" status: 202 len: 0 microversion: 2.1 time: 0.387933 Aug 30 18:10:28.251252 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 152/354] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:10:27 2022] POST /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:28.277865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:28.281075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:28.308684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.314794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.317557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68e4d2c2-6f77-411e-a099-66e202a9eb55 tempest-SecurityGroupRulesTestJSON-1446072427 tempest-SecurityGroupRulesTestJSON-1446072427-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/706cebb1-220e-410e-8d82-98292b85da67" status: 202 len: 0 microversion: 2.1 time: 2.016476 Aug 30 18:10:28.319949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.321138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.324950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 203/355] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:10:26 2022] DELETE /compute/v2.1/os-security-groups/706cebb1-220e-410e-8d82-98292b85da67 => generated 0 bytes in 2022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:28.330290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.333095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.659151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:28.729578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-37ec4841-e603-48ce-a32c-564e2c2fed72 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.476473 Aug 30 18:10:28.741703 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 153/356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:28 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:28.778399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:28.779372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:28.808995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.809924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.810731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:28.812011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:28.812880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:28.813653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.016320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.025713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.027884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.029839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lazy-loading 'fault' on Instance uuid 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:29.452911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Calling method '.version_select at 0x7f4e576a6820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:29.463805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.479940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.483573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.600156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.602053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.603150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.692989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.693885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.694713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.723112 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2060817c-d197-4626-b8fd-bd3962f06183 tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 1.399116 Aug 30 18:10:29.724213 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 204/357] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:10:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:29.814536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:29.837958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:29.900624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.902213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.903327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:29.904808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:29.924661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:29.925984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:30.565494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:30.578148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24d691c3-a974-43c2-8728-cd7e1a00a7ee tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1453 microversion: 2.1 time: 1.817256 Aug 30 18:10:30.581565 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 154/358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:28 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1453 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:30.593673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Calling method '.version_select at 0x7f4e57396ca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:30.621074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:30.621981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:30.622870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:30.691783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:30.695714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:30.696544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:30.716565 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c22a7f9c-be44-4558-8025-083842d04c7e tempest-HypervisorAdminV228Test-769961491 tempest-HypervisorAdminV228Test-769961491-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.133302 Aug 30 18:10:30.717954 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 155/359] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:10:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:30.744488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:30.745522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:30.786702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:30.793713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:30.794603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:30.799830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:30.802683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:30.809211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:30.934776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:30.978919 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa67db3d-8f7e-42e9-815c-9f20af10ad60 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 1.226044 Aug 30 18:10:30.981015 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 205/360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:29 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:31.015123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:31.016020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:31.055995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:31.056896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:31.057694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:31.059059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:31.059904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:31.060671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:31.244082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:10:31.311814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:31.401186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e485d919-a981-4b34-81f1-a22d3e8a6e79 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.679542 Aug 30 18:10:31.418941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 156/361] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:30 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:31.588123 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe275f2b-6100-4e1e-8e95-c7236ddd0919 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 204 len: 0 microversion: 2.1 time: 0.602812 Aug 30 18:10:31.589152 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 206/362] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:10:30 2022] DELETE /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:10:31.604377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:31.605414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:31.644198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:31.645059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:31.645833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:31.647205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:31.664936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:31.666181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:31.808584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:31.812979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:31.813753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:31.823237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lazy-loading 'fault' on Instance uuid 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:32.019335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:32.020760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:32.043692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:32.057510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:32.057510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:32.057510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:32.057510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:32.058271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:32.861460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:32.889082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-27dd3e64-276e-4076-af3d-fc90a9337223 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1459 microversion: 2.1 time: 1.291819 Aug 30 18:10:32.892289 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 157/363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:31 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1459 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:32.904236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:32.905968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:32.926895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:32.928208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:32.929790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:32.931533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:32.932590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:32.933525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:33.524001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:33.621114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c883902-1316-4d42-88a5-ec6ce780a9f9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 1.603120 Aug 30 18:10:33.630392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 207/364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:32 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:33.797131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdff2654-b3dc-423e-ad30-e87fed671aed", "name": "network-vif-plugged", "status": "completed", "tag": "db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:33.877857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:33.885298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:33.892660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:33.893411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:33.983126 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] Creating event network-vif-plugged:db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0 for instance fdff2654-b3dc-423e-ad30-e87fed671aed on n-h1-854119-10 Aug 30 18:10:34.029052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-02615b8a-fad6-473a-acc7-eff9e2477ec6 req-f6124306-d0d6-461c-b041-d7c347e9c5f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225904 Aug 30 18:10:34.039112 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 208/365] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:34.085152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-266f8ad2-f8a8-4241-b729-561759b21c77 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 1.190471 Aug 30 18:10:34.093711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 158/366] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:32 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:34.108393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:34.118453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:34.188680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:34.189613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:34.190405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:34.208222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:34.209186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:34.216567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:34.447146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:34.448698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:34.451240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:34.455040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lazy-loading 'fault' on Instance uuid 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:34.664730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:34.665350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:34.688459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:34.690250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:34.690746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:34.691517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:34.691985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:34.696230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:35.293396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:35.307895 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2de480e3-767b-4b9e-9b4d-9f00b7e20b0a tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1459 microversion: 2.1 time: 1.264112 Aug 30 18:10:35.313535 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 209/367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:34 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1459 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:35.337174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:35.339653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:35.376115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:35.381494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:35.382326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:35.390855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:35.392145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:35.395563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:35.689984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:35.772313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-883f2944-8aac-4c0f-85ee-ade0d5d70469 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.456267 Aug 30 18:10:35.775445 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 210/368] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:35 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:36.114380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:36.127352 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ccfcb19d-5c67-49bb-91b9-475fa7ba343d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1318 microversion: 2.1 time: 1.466769 Aug 30 18:10:36.128491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 159/369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:34 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1318 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:36.355419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:36.360241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:36.388776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.389290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.389738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.390761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.399307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.402044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.493087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd8acf-c1aa-4f0a-a72e-3e9d56da009c", "name": "network-vif-deleted", "tag": "ec9eb790-0e36-481c-bb58-b0336e916028"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:36.532171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.545106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.546874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.549635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lazy-loading 'fault' on Instance uuid 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:36.574166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.587283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.588147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.663697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f233fe35c249f0965c48297369f4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93894963a8184b2e9299def30242caa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:36.688422 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-624ee81d-8b86-48c5-bdc0-604ea02605d6 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 200 len: 1417 microversion: 2.1 time: 0.335973 Aug 30 18:10:36.705919 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] Creating event network-vif-deleted:ec9eb790-0e36-481c-bb58-b0336e916028 for instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c on n-h1-854119-10 Aug 30 18:10:36.709116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 211/370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:36 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 1417 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:36.728817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-28425400-bd83-404f-9f02-8f0c7e4536df req-7f85e586-24c6-4b46-bd28-b824c499377f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264085 Aug 30 18:10:36.746853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 160/371] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:10:36.803442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:36.804882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:36.833481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.837557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.840010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:36.846088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:36.851582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:36.854870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:37.040089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:37.181911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:37.182867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:37.205822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:37.209689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:37.210628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:37.213716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:37.219186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:37.220322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:37.379580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:37.478523 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-81a9a695-3447-4640-bbf7-1f2fc2aa5364 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.679139 Aug 30 18:10:37.482772 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 212/372] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:36 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:38.474869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:38.487186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3c8dc5c-6af5-46bc-8912-337aabc10c8b tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-970044488", "ram": 512, "vcpus": 1, "disk": 10, "id": 1604047186, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:38.505826 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2e6ab8d-9037-4c4b-bded-bebcfad7f7ed tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1468 microversion: 2.1 time: 1.329694 Aug 30 18:10:38.513020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 161/373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:37 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1468 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:38.540413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:38.542445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:38.554010 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3c8dc5c-6af5-46bc-8912-337aabc10c8b tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.060817 Aug 30 18:10:38.565215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 213/374] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:10:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:38.582260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.583440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.584766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.589648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.591922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.593937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.601642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:38.602271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:38.627647 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c HTTP/1.1 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:38.631882 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:38.634695 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '74dd8acf-c1aa-4f0a-a72e-3e9d56da009c'} Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:38.636010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:38.638579 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:38.646564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:38.646564 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b4c237e-f4ba-43a6-a956-abcc8809e806 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 404 len: 111 microversion: 2.1 time: 0.128114 Aug 30 18:10:38.646564 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 162/375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:38 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:38.654226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.654901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.659592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.660518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.661010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.661481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.898202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2039971118", "block_migration": true, "disk_over_commit": false}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:38.912308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:38.947296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.956674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.959407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:38.965812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:38.967549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:38.973474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.031109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:39.077367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d014563-1c6a-4ecd-a467-4b20020744eb tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1931 microversion: 2.75 time: 0.509426 Aug 30 18:10:39.094825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 214/376] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:38 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1931 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:39.106002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37f6e217-5616-402a-b57d-e441683a5ff4 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:39.164296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37f6e217-5616-402a-b57d-e441683a5ff4 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067513 Aug 30 18:10:39.171249 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 215/377] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:10:39 2022] POST /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:39.179781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:39.181158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:39.195990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:39.196828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:39.197890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.199326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:39.200107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:39.200938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.246374 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c HTTP/1.1 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:39.248737 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.249985 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '74dd8acf-c1aa-4f0a-a72e-3e9d56da009c'} Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:39.250908 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.252243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.257920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:39.259207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca75f5cc-fbf5-4089-b92d-3afd510dd2f9 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 404 len: 111 microversion: 2.1 time: 0.085956 Aug 30 18:10:39.260367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 216/378] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:10:39 2022] DELETE /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:39.565238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7ad639c1-798b-49dd-8b13-be7cea5293db tempest-FlavorsExtraSpecsTestJSON-226002749 tempest-FlavorsExtraSpecsTestJSON-226002749-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:39.608568 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7ad639c1-798b-49dd-8b13-be7cea5293db tempest-FlavorsExtraSpecsTestJSON-226002749 tempest-FlavorsExtraSpecsTestJSON-226002749-project] 10.222.0.25 "GET /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.346476 Aug 30 18:10:39.609503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 217/379] 10.222.0.25 () {58 vars in 1203 bytes} [Tue Aug 30 18:10:39 2022] GET /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:39.638005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:39.659465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:39.728146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:39.733489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:39.736668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.738111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:39.751472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:39.755988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:39.889549 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c HTTP/1.1 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:39.893350 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.896097 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '74dd8acf-c1aa-4f0a-a72e-3e9d56da009c'} Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:39.897668 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. Aug 30 18:10:39.899976 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:39.920305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 74dd8acf-c1aa-4f0a-a72e-3e9d56da009c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:39.921570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f34c1c9-c07a-4e75-8bac-a032b36ecfd1 tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c" status: 404 len: 111 microversion: 2.1 time: 0.290870 Aug 30 18:10:39.929235 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 218/380] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:39 2022] GET /compute/v2.1/servers/74dd8acf-c1aa-4f0a-a72e-3e9d56da009c => generated 111 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:39.963856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-768b07fb-c145-480e-bc06-b88e5190f5da tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:40.088775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lazy-loading 'flavor' on Instance uuid fdff2654-b3dc-423e-ad30-e87fed671aed {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:40.178576 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-768b07fb-c145-480e-bc06-b88e5190f5da tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.239764 Aug 30 18:10:40.194569 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 219/381] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:10:39 2022] POST /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:40.249795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.254760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:40.309275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.311359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.314990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.316598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.323264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.326653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.407064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 HTTP/1.1 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:40.410500 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.413225 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2afb60d7-9359-4d84-a9a4-b2411844a185'} Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:40.414689 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.418771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.427876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:40.433674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e6fb76a-9d6b-4620-a476-2e03584e543d tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 404 len: 111 microversion: 2.1 time: 0.234936 Aug 30 18:10:40.443498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 220/382] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:10:40 2022] DELETE /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:40.482193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.488605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:40.528414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Going to try to live migrate instance to tempest-host-2039971118 {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:10:40.538647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.546414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.552919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.561810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] HTTP exception thrown: Compute host tempest-host-2039971118 could not be found. Aug 30 18:10:40.567038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.568812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.570490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Request method failure captured: Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed/action HTTP/1.1 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 107 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJ_LIyiS2d56cYIvEIddJb4CqnSlDB3pXjioUeAdCAhdrtmWsZBPAa36ZF4gdYDPXQmAJoEGl2LnpiDKYdYvOWg_6vb8ubjL3698ncHRiC5AAYcablkD749SNQHCjTbE-K2QVH-6-ieSn3cv7s_JGyn8ADUXV2EEeYqQc7bBygZCFQ Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f35191b9c30e4cc28c4ddc7654017717 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:10:40.597612 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f35191b9c30e4cc28c4ddc7654017717 Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationNegativeTest-1991184011-project-admin Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 0eb266a7d9cf4d678453e200b46b13fc Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationNegativeTest-1991184011-project-admin Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: {"os-migrateLive": {"host": "tempest-host-2039971118", "block_migration": true, "disk_over_commit": false}} Aug 30 18:10:40.600228 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: exception: Compute host tempest-host-2039971118 could not be found. Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fdff2654-b3dc-423e-ad30-e87fed671aed', 'body': {'os-migrateLive': {'host': 'tempest-host-2039971118', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:10:40.603389 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2039971118 could not be found. Aug 30 18:10:40.605438 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2039971118 could not be found. Aug 30 18:10:40.607766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2039971118 could not be found. Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Returning 400 to user: Compute host tempest-host-2039971118 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-583031ee-1b5a-4c4d-86d7-ccf370f853fb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed/action" status: 400 len: 100 microversion: 2.1 time: 1.953985 Aug 30 18:10:40.610606 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 163/383] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Aug 30 18:10:38 2022] POST /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed/action => generated 100 bytes in 1955 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:10:40.614793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c335abd-3d59-412e-8905-2744c06c2edf tempest-FlavorsExtraSpecsTestJSON-226002749 tempest-FlavorsExtraSpecsTestJSON-226002749-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.630889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c335abd-3d59-412e-8905-2744c06c2edf tempest-FlavorsExtraSpecsTestJSON-226002749 tempest-FlavorsExtraSpecsTestJSON-226002749-project] 10.222.0.25 "GET /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024157 Aug 30 18:10:40.632771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 164/384] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:10:40 2022] GET /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:40.637653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.638831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] [instance: 2afb60d7-9359-4d84-a9a4-b2411844a185] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:40.652303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.653224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.654022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.655679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.657126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.657825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.684292 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] HTTP exception thrown: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Request method failure captured: Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 HTTP/1.1 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJHCK5KKBc3mLmXrgt_IgLUOXwPGK5C71xi_zwKVUrLPYsprTvSzfEitMVuzVDJnl88Syt7QhtY9_pa6yS9RP3uQc6Uw81VjX33leNhSNRPtu1MRjMWRn9cFp4HpyWfEwLOxyytkDMBj0YWTOSiCT2JWezbJ68PMAZQBu-SuaMeGGo Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:40.686014 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/93894963a8184b2e9299def30242caa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/93894963a8184b2e9299def30242caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_93894963a8184b2e9299def30242caa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 93894963a8184b2e9299def30242caa9 Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-306024761 Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 24f233fe35c249f0965c48297369f4ab Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersAdminTestJSON-306024761-project Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.687479 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2afb60d7-9359-4d84-a9a4-b2411844a185'} Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:40.688433 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. Aug 30 18:10:40.689818 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:40.691433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] Returning 404 to user: Instance 2afb60d7-9359-4d84-a9a4-b2411844a185 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:40.692501 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1c8f9d1-61a3-400f-a66f-e92e131604bf tempest-DeleteServersAdminTestJSON-306024761 tempest-DeleteServersAdminTestJSON-306024761-project] 10.222.0.25 "GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185" status: 404 len: 111 microversion: 2.1 time: 0.059255 Aug 30 18:10:40.693485 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 165/385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:40 2022] GET /compute/v2.1/servers/2afb60d7-9359-4d84-a9a4-b2411844a185 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:40.703591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:40.704461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:40.711596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.712262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.712809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.713676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:40.714443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:40.715094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:40.836849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:40.925311 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95393b39-4b9b-40c9-ad6b-29667ce891e6 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1937 microversion: 2.75 time: 0.474741 Aug 30 18:10:40.926162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 221/386] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:40 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1937 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:40.968839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c6b8eb6-a769-4b38-9c83-a4c23d702635 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:40.996152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:41.087222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c6b8eb6-a769-4b38-9c83-a4c23d702635 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.136722 Aug 30 18:10:41.091712 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 222/387] 10.222.0.25 () {60 vars in 1224 bytes} [Tue Aug 30 18:10:40 2022] POST /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:41.101235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f0599a7-fe7f-4e60-9567-631af197f179 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.128203 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f0599a7-fe7f-4e60-9567-631af197f179 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030976 Aug 30 18:10:41.144827 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 223/388] 10.222.0.25 () {58 vars in 1203 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:10:41.157396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0108a1a8-be10-4d2f-b332-274fcc3aa971 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:41.264325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0108a1a8-be10-4d2f-b332-274fcc3aa971 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.112644 Aug 30 18:10:41.277607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 224/389] 10.222.0.25 () {60 vars in 1265 bytes} [Tue Aug 30 18:10:41 2022] PUT /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:41.300766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f7b6f10-9111-4f77-951d-ee6e40a7ce59 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.392065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f7b6f10-9111-4f77-951d-ee6e40a7ce59 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.112452 Aug 30 18:10:41.393091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 225/390] 10.222.0.25 () {58 vars in 1203 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/flavors/1604047186/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:41.403155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ccbb166-454f-49d2-82e4-aef550851cde tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.509760 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ccbb166-454f-49d2-82e4-aef550851cde tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.110938 Aug 30 18:10:41.514948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 226/391] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:10:41 2022] DELETE /compute/v2.1/flavors/1604047186/os-extra_specs/hw:numa_nodes => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 18:10:41.533173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66afef0a-e21b-4b99-8194-9531f5a17955 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.588534 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66afef0a-e21b-4b99-8194-9531f5a17955 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1604047186/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.072378 Aug 30 18:10:41.594259 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 227/392] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:10:41 2022] DELETE /compute/v2.1/flavors/1604047186/os-extra_specs/hw:cpu_policy => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:10:41.607415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3bca012-8c83-42ad-9a34-ad6f37da38ef tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.630147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3bca012-8c83-42ad-9a34-ad6f37da38ef tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1604047186/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034492 Aug 30 18:10:41.636335 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 228/393] 10.222.0.25 () {58 vars in 1203 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/flavors/1604047186/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:10:41.641835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edc99918-852c-478a-9c12-f9e7866cd416 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.691036 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edc99918-852c-478a-9c12-f9e7866cd416 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1604047186" status: 202 len: 0 microversion: 2.1 time: 0.053074 Aug 30 18:10:41.692122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 229/394] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:10:41 2022] DELETE /compute/v2.1/flavors/1604047186 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:10:41.714760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bc54148-a282-49c8-9e14-4c36094ff903 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.807878 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1bc54148-a282-49c8-9e14-4c36094ff903 tempest-FlavorsExtraSpecsTestJSON-71179953 tempest-FlavorsExtraSpecsTestJSON-71179953-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.111063 Aug 30 18:10:41.815948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 230/395] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:41.886676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:41.889363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:41.905232 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a59634e4-301c-4465-8ed0-92cdd1e6a5d8 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1468 microversion: 2.1 time: 1.210337 Aug 30 18:10:41.905911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 166/396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:40 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1468 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:41.961686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:41.962967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:41.985345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:41.990165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:41.991554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:41.993111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:41.993940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:41.994715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:42.187423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:42.228470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ae65911-e0f1-4a05-a2e8-1041ee3a9c05 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1937 microversion: 2.75 time: 0.273187 Aug 30 18:10:42.233059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 231/397] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:41 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1937 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:42.673865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1295585771", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:43.002013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:10:43.268183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:43.270460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:43.288132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.289456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.291975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.293676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.296929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.298901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.461349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] Lazy-loading 'services' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:43.504587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-792d68a4-83f8-477c-b968-055c3aaf4569 tempest-ServersAdmin275Test-1991194081 tempest-ServersAdmin275Test-1991194081-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1922 microversion: 2.75 time: 0.248052 Aug 30 18:10:43.521775 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 232/398] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:43 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1922 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:10:43.558191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:43.560802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:43.589469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.595607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.601012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.603145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:43.609026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:43.614700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:43.698809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:10:43.974017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-85f2a571-fa1b-43ec-aef2-af21f84b0838 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "DELETE /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 204 len: 0 microversion: 2.75 time: 0.431957 Aug 30 18:10:43.975019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 233/399] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:10:43 2022] DELETE /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:10:44.009503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:44.011491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:44.045685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.047311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.051507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.057677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.058897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.061622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.391278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:44.420092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:44.427246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:44.471408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80f75f00-0362-4889-a39a-a0e6b8dfe4bc tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1444 microversion: 2.75 time: 0.478262 Aug 30 18:10:44.472873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 234/400] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:43 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1444 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:44.826394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:10:44.827279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:10:44.827726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:10:44.828284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:10:44.829210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:10:44.895498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.900951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.910407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:44.917110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:44.921279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:44.937404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.032731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Getting quotas for project c9c0d6bfbe664dab9895c9f526a0cf73. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:10:45.054602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Getting quotas for user 05d787b142d543d8b9b09d99084d3823 and project c9c0d6bfbe664dab9895c9f526a0cf73. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:10:45.100566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:10:45.108526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:10:45.341423 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68c62f2d-d7ac-42ed-8124-4d5e55059ea1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670651 Aug 30 18:10:45.358581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 167/401] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:10:45.367993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a087c49e-2584-4f0a-a8c3-ea716e4b167d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:45.368989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a087c49e-2584-4f0a-a8c3-ea716e4b167d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:45.525374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:45.530623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:45.553068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.554570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.555326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.563443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:45.564265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:45.564891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:45.700527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a087c49e-2584-4f0a-a8c3-ea716e4b167d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:45.754139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a087c49e-2584-4f0a-a8c3-ea716e4b167d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1219 microversion: 2.1 time: 0.391445 Aug 30 18:10:45.755210 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 235/402] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:45 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1219 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:46.240697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:46.260906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:46.265672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:46.284786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9738d691-49dd-460f-91ff-32b82881f32f tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1444 microversion: 2.75 time: 0.761833 Aug 30 18:10:46.304017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 168/403] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:45 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1444 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:46.789835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:46.807623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:46.829028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.830679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.831332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:46.833066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:46.833844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:46.834492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:47.108732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:47.137808 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b034d467-4981-46e8-864f-4609f706147f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1223 microversion: 2.1 time: 0.355234 Aug 30 18:10:47.140675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 236/404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:46 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1223 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:47.322054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:47.324487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:47.334849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:47.343973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:47.347040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:47.352875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:47.354046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:47.357238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:47.919836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:47.967799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:47.971382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:47.990837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6fc510f0-8de0-4a6e-a600-282743fe7579 tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1444 microversion: 2.75 time: 0.673166 Aug 30 18:10:47.992685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 169/405] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:47 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1444 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:10:48.199969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:48.206695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:48.261472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.267002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.267823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.273675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:48.274576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:48.275335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:48.554467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:48.598140 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-71189a37-7cd3-47cb-9ab1-b23865c8fced tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1271 microversion: 2.1 time: 0.400603 Aug 30 18:10:48.604839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 237/406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:48 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1271 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:49.046396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.056415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:49.089728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.097276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.102579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.103921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.104734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.116140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.301846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.303862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.304957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.306219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lazy-loading 'fault' on Instance uuid 809c6553-e891-4a87-8c69-f61ad118def0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:10:49.570979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.593711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.599672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bbd17002db46c1bd704c5006886d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb149780c5049f8a3b7aefe224cca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.613246 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed2e8a62-1dfb-4c62-b110-7b7dc3e76eae tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 200 len: 1449 microversion: 2.75 time: 0.577148 Aug 30 18:10:49.614803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 170/407] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 1449 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:49.638684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.641658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:49.666295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.670577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.673618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.674620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:49.677990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:49.679892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:49.850574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a27cfaf2-2428-4179-9e07-7186d7856270 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Calling method '.version_select at 0x7f4e57731310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.852978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a27cfaf2-2428-4179-9e07-7186d7856270 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e82b9fb12b884f838686b6f5883e71b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafb3fe421c340b2ad4bb652a821eb90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a27cfaf2-2428-4179-9e07-7186d7856270 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Request method failure captured: Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKk3n3a3mV08PnuLtbaio1PHIf0q-TRa07ly1COV977BGuGRIQ3RzP7gxd5wWCOuYreVQtjqbiBQFAKPuc3Py37gqYCgtzOVc8KdZjPxwuxzMtkZ7OIc6RhFFS___kpCSOtdEjXGL1hxAqsb5J9Qd1eUPRug7F4B82c5Rvpf3oXMfY Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:49.856086 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e82b9fb12b884f838686b6f5883e71b4 Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:10:49.857794 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:49.858803 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 18:10:49.860947 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.862971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a27cfaf2-2428-4179-9e07-7186d7856270 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:49.862971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a27cfaf2-2428-4179-9e07-7186d7856270 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.614058 Aug 30 18:10:49.863766 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 238/408] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 621 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:10:49.875443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2e478ce-35ac-46de-8e3e-4545beac4fa0 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Calling method '.version_select at 0x7f4e576a6820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.881113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2e478ce-35ac-46de-8e3e-4545beac4fa0 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e82b9fb12b884f838686b6f5883e71b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafb3fe421c340b2ad4bb652a821eb90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2e478ce-35ac-46de-8e3e-4545beac4fa0 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Request method failure captured: Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKk3n3a3mV08PnuLtbaio1PHIf0q-TRa07ly1COV977BGuGRIQ3RzP7gxd5wWCOuYreVQtjqbiBQFAKPuc3Py37gqYCgtzOVc8KdZjPxwuxzMtkZ7OIc6RhFFS___kpCSOtdEjXGL1hxAqsb5J9Qd1eUPRug7F4B82c5Rvpf3oXMfY Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:49.888289 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e82b9fb12b884f838686b6f5883e71b4 Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:10:49.889707 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:49.890762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 18:10:49.892102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.893247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2e478ce-35ac-46de-8e3e-4545beac4fa0 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:49.893247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2e478ce-35ac-46de-8e3e-4545beac4fa0 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.020612 Aug 30 18:10:49.893485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 239/409] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:49.905919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b547c2f9-d09f-4063-84a9-87f89a1d0044 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Calling method '.version_select at 0x7f4e5751d310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:49.907936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b547c2f9-d09f-4063-84a9-87f89a1d0044 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e82b9fb12b884f838686b6f5883e71b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafb3fe421c340b2ad4bb652a821eb90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b547c2f9-d09f-4063-84a9-87f89a1d0044 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Request method failure captured: Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKk3n3a3mV08PnuLtbaio1PHIf0q-TRa07ly1COV977BGuGRIQ3RzP7gxd5wWCOuYreVQtjqbiBQFAKPuc3Py37gqYCgtzOVc8KdZjPxwuxzMtkZ7OIc6RhFFS___kpCSOtdEjXGL1hxAqsb5J9Qd1eUPRug7F4B82c5Rvpf3oXMfY Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:49.917661 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e82b9fb12b884f838686b6f5883e71b4 Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:10:49.919311 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:49.920015 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 18:10:49.921065 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:49.923095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b547c2f9-d09f-4063-84a9-87f89a1d0044 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:49.923095 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b547c2f9-d09f-4063-84a9-87f89a1d0044 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022871 Aug 30 18:10:49.923095 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 240/410] 10.222.0.25 () {58 vars in 1179 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:50.065767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:50.084314 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-115f0690-fc75-486e-8091-c0658b49e5e2 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1277 microversion: 2.1 time: 0.462700 Aug 30 18:10:50.085587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 171/411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1277 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:50.478234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Calling method '.version_select at 0x7f4e57550790>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.482507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.487107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.492082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.566559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.571173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.576189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.617512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.618850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.620628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.641682 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d95bebd-d80e-46b4-bfdb-ee0267d7b9eb tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.714932 Aug 30 18:10:50.653468 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 241/412] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:10:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:50.660032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.661086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] [instance: 809c6553-e891-4a87-8c69-f61ad118def0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:50.667426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a5b7717-a44d-4a53-921e-e805be8bd45e tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Calling method '.version_select at 0x7f4e57564160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.669567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.671104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a5b7717-a44d-4a53-921e-e805be8bd45e tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e82b9fb12b884f838686b6f5883e71b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafb3fe421c340b2ad4bb652a821eb90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:50.671639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.673430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a5b7717-a44d-4a53-921e-e805be8bd45e tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Request method failure captured: Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKk3n3a3mV08PnuLtbaio1PHIf0q-TRa07ly1COV977BGuGRIQ3RzP7gxd5wWCOuYreVQtjqbiBQFAKPuc3Py37gqYCgtzOVc8KdZjPxwuxzMtkZ7OIc6RhFFS___kpCSOtdEjXGL1hxAqsb5J9Qd1eUPRug7F4B82c5Rvpf3oXMfY Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:50.674040 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e82b9fb12b884f838686b6f5883e71b4 Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1'} Aug 30 18:10:50.675228 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:50.675967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 18:10:50.676989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.677892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a5b7717-a44d-4a53-921e-e805be8bd45e tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:50.677892 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a5b7717-a44d-4a53-921e-e805be8bd45e tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017477 Aug 30 18:10:50.678289 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 242/413] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:50.680071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.680793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.681335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.691372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cf89009-0ec7-4086-b82d-67150526c4af tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Calling method '.version_select at 0x7f4e5751d550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.696172 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6cf89009-0ec7-4086-b82d-67150526c4af tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] HTTP exception thrown: Hypervisor with ID 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' could not be found. Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cf89009-0ec7-4086-b82d-67150526c4af tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Request method failure captured: Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/c294d39e-81d5-4a05-87b6-d7a5f98d28d9/uptime HTTP/1.1 Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKohYZjycOUatwJxQJV_az_NoRput076IhzyQmjmOt5q0FXMby-VGCnJAa0zllYNChEMErRyTVxgyhBLo-QNOhL6ACpA8IbVIWILQ2N_Q-BmK1FdKmX_Q_RSDiUufbBptDuREebv6skpijANekarrM4LSi0t1233Tf8G3E2KaKhNWw Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b004c9cc18504d4b878ccc70c9bebc9f Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:10:50.708201 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b004c9cc18504d4b878ccc70c9bebc9f Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 03334e1a0564496fb6da7f691e41a828 Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: exception: Hypervisor with ID 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' could not be found. Aug 30 18:10:50.709583 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9'} Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 18:10:50.710313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' could not be found. Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.711744 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' could not be found. Aug 30 18:10:50.715336 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] HTTP exception thrown: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Request method failure captured: Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 HTTP/1.1 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJg9ZiCgCov1towGhxwe-Y7UR93GfTciyiJh-ZG1y1m4uCzvsNKbfw8Dcsb1V-WVm_TdvPctKcO2-Q6igBUbM50o1xxKJSw7kgB8q_y3aY8Ddu_Juy78knr-X0-SQuWAwzUpm-dfDGroHi7TDrKz9jLV0Prxc8Edh9sAasjxrVWNOc Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.75 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: beb149780c5049f8a3b7aefe224cca76 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdmin275Test-1377696245 Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:10:50.716983 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/beb149780c5049f8a3b7aefe224cca76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/beb149780c5049f8a3b7aefe224cca76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/beb149780c5049f8a3b7aefe224cca76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_beb149780c5049f8a3b7aefe224cca76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdmin275Test-1377696245 Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: beb149780c5049f8a3b7aefe224cca76 Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdmin275Test-1377696245 Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdmin275Test-1377696245-project Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4bbd17002db46c1bd704c5006886d1c Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdmin275Test-1377696245-project Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. Aug 30 18:10:50.720010 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '809c6553-e891-4a87-8c69-f61ad118def0'} Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:50.721074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. Aug 30 18:10:50.723547 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.726328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] Returning 404 to user: Instance 809c6553-e891-4a87-8c69-f61ad118def0 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:50.726328 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58d6f2f5-559a-469a-a6f1-8d656fb58aca tempest-ServersAdmin275Test-1377696245 tempest-ServersAdmin275Test-1377696245-project] 10.222.0.25 "GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0" status: 404 len: 111 microversion: 2.75 time: 0.057488 Aug 30 18:10:50.726328 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 172/414] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/servers/809c6553-e891-4a87-8c69-f61ad118def0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:10:50.727822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cf89009-0ec7-4086-b82d-67150526c4af tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Returning 404 to user: Hypervisor with ID 'c294d39e-81d5-4a05-87b6-d7a5f98d28d9' could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:50.729231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6cf89009-0ec7-4086-b82d-67150526c4af tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c294d39e-81d5-4a05-87b6-d7a5f98d28d9/uptime" status: 404 len: 123 microversion: 2.1 time: 0.042864 Aug 30 18:10:50.730420 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 243/415] 10.222.0.25 () {58 vars in 1278 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/os-hypervisors/c294d39e-81d5-4a05-87b6-d7a5f98d28d9/uptime => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:50.744290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Calling method '.version_select at 0x7f4e5718a790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.754402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.755926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.757452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.800927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.804063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.805425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.842208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:50.844212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:50.847465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:50.870037 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2709fe44-2680-4362-a1b8-2e8325044f76 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.132370 Aug 30 18:10:50.872858 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 173/416] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:50.892553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af99da49-9c53-4338-9824-2b95919e88f4 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Calling method '.version_select at 0x7f4e576a2f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.895723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-af99da49-9c53-4338-9824-2b95919e88f4 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e82b9fb12b884f838686b6f5883e71b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafb3fe421c340b2ad4bb652a821eb90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af99da49-9c53-4338-9824-2b95919e88f4 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Request method failure captured: Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKk3n3a3mV08PnuLtbaio1PHIf0q-TRa07ly1COV977BGuGRIQ3RzP7gxd5wWCOuYreVQtjqbiBQFAKPuc3Py37gqYCgtzOVc8KdZjPxwuxzMtkZ7OIc6RhFFS___kpCSOtdEjXGL1hxAqsb5J9Qd1eUPRug7F4B82c5Rvpf3oXMfY Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:10:50.899172 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cafb3fe421c340b2ad4bb652a821eb90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: cafb3fe421c340b2ad4bb652a821eb90 Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876 Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e82b9fb12b884f838686b6f5883e71b4 Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1353474876-project Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1'} Aug 30 18:10:50.900675 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:10:50.901447 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 18:10:50.902676 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.903896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af99da49-9c53-4338-9824-2b95919e88f4 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:50.903896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af99da49-9c53-4338-9824-2b95919e88f4 tempest-HypervisorAdminNegativeTestJSON-1353474876 tempest-HypervisorAdminNegativeTestJSON-1353474876-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016906 Aug 30 18:10:50.903896 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 244/417] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:50.914415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e46aa171-33c5-4ad7-86fd-c185c7278de7 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Calling method '.version_select at 0x7f4e5718a4c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:50.916516 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e46aa171-33c5-4ad7-86fd-c185c7278de7 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] HTTP exception thrown: Hypervisor with ID 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' could not be found. Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e46aa171-33c5-4ad7-86fd-c185c7278de7 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Request method failure captured: Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-hypervisors/dfff5a1b-b257-44f3-8163-49f89ab72bf4 HTTP/1.1 Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlKohYZjycOUatwJxQJV_az_NoRput076IhzyQmjmOt5q0FXMby-VGCnJAa0zllYNChEMErRyTVxgyhBLo-QNOhL6ACpA8IbVIWILQ2N_Q-BmK1FdKmX_Q_RSDiUufbBptDuREebv6skpijANekarrM4LSi0t1233Tf8G3E2KaKhNWw Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b004c9cc18504d4b878ccc70c9bebc9f Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:10:50.919274 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b004c9cc18504d4b878ccc70c9bebc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b004c9cc18504d4b878ccc70c9bebc9f Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-173148604 Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 03334e1a0564496fb6da7f691e41a828 Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: exception: Hypervisor with ID 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' could not be found. Aug 30 18:10:50.920606 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'dfff5a1b-b257-44f3-8163-49f89ab72bf4'} Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 18:10:50.921830 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:10:50.923502 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' could not be found. Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' could not be found. Aug 30 18:10:50.924740 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:10:50.927896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e46aa171-33c5-4ad7-86fd-c185c7278de7 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] Returning 404 to user: Hypervisor with ID 'dfff5a1b-b257-44f3-8163-49f89ab72bf4' could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:10:50.930842 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e46aa171-33c5-4ad7-86fd-c185c7278de7 tempest-HypervisorAdminNegativeTestJSON-173148604 tempest-HypervisorAdminNegativeTestJSON-173148604-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/dfff5a1b-b257-44f3-8163-49f89ab72bf4" status: 404 len: 123 microversion: 2.1 time: 0.019377 Aug 30 18:10:50.933529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 174/418] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:10:50 2022] GET /compute/v2.1/os-hypervisors/dfff5a1b-b257-44f3-8163-49f89ab72bf4 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:10:51.121657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:51.126524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:51.146813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:51.155213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:51.160311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:51.162916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:51.166915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:51.168339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:51.990645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:52.004886 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2d5cf93-3d06-4561-94cf-106929635ffe tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 0.899328 Aug 30 18:10:52.010277 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 245/419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:51 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:53.048240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:53.049538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:53.064468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.069742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.073815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:53.075214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:53.078320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:53.084656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:54.546013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:54.565736 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7e0a9bb-a573-4f38-ad02-11c2b4a2f2d3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 1.515944 Aug 30 18:10:54.568038 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 175/420] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:53 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:55.270261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82", "tag": "1eaf64d3-e53c-478b-bd21-808a45ada76e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:55.310770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:55.311601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:55.316487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:10:55.328521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:55.330037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:55.334850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:55.391100 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] Creating event network-changed:1eaf64d3-e53c-478b-bd21-808a45ada76e for instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 on n-h1-854119-10 Aug 30 18:10:55.412605 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2e475923-e05c-40a7-b17f-b87103b9d6eb req-b1dfaa9e-27c4-4beb-bb38-ff51a79841e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145723 Aug 30 18:10:55.414894 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 176/421] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:55.606236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:55.607228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:55.624898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b57e61f1-1dc9-4b41-aca3-66986043654c tempest-InstanceUsageAuditLogTestJSON-82306339 tempest-InstanceUsageAuditLogTestJSON-82306339-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:55.641680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:55.642207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:55.642688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:55.661860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:55.662439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:55.672717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:55.751843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b57e61f1-1dc9-4b41-aca3-66986043654c tempest-InstanceUsageAuditLogTestJSON-82306339 tempest-InstanceUsageAuditLogTestJSON-82306339-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 18:10:54" status: 200 len: 318 microversion: 2.1 time: 0.817482 Aug 30 18:10:55.762638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 246/422] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:10:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2018%3A10%3A54 => generated 318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:55.769195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-577b1ae5-b912-4f80-b028-b6ef985eab4f tempest-InstanceUsageAuditLogTestJSON-82306339 tempest-InstanceUsageAuditLogTestJSON-82306339-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:55.797081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-577b1ae5-b912-4f80-b028-b6ef985eab4f tempest-InstanceUsageAuditLogTestJSON-82306339 tempest-InstanceUsageAuditLogTestJSON-82306339-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.032411 Aug 30 18:10:55.807586 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 247/423] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:10:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:10:57.315493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:57.340414 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb9b30a4-3dc7-4011-a482-e4befe412ac3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 1.727869 Aug 30 18:10:57.342657 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 177/424] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:55 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:10:57.986716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c7ccf40-f5df-494d-9ade-937984634235 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1272321320", "id": 1576247868, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:58.021372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c7ccf40-f5df-494d-9ade-937984634235 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.722939 Aug 30 18:10:58.035853 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 248/425] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:10:57 2022] POST /compute/v2.1/flavors => generated 449 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:58.375992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18d4a248-5876-4afc-8e40-c8283e4a5266 tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.381730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.383194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:10:58.400661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18d4a248-5876-4afc-8e40-c8283e4a5266 tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] 10.222.0.25 "GET /compute/v2.1/flavors/1576247868" status: 200 len: 449 microversion: 2.55 time: 0.361558 Aug 30 18:10:58.412064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:58.412867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:58.413460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:58.423008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:10:58.423581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 178/426] 10.222.0.25 () {60 vars in 1199 bytes} [Tue Aug 30 18:10:58 2022] GET /compute/v2.1/flavors/1576247868 => generated 449 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:58.429097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f56a9fec-f847-4b7d-acf1-0ae17841f167 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:10:58.429959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:10:58.430570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:10:58.540033 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f56a9fec-f847-4b7d-acf1-0ae17841f167 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1576247868" status: 200 len: 450 microversion: 2.55 time: 0.115119 Aug 30 18:10:58.549295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 179/427] 10.222.0.25 () {62 vars in 1219 bytes} [Tue Aug 30 18:10:58 2022] PUT /compute/v2.1/flavors/1576247868 => generated 450 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:10:58.555107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe1e0cf5-7906-48e0-a50e-121ef48c8a3e tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.605451 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe1e0cf5-7906-48e0-a50e-121ef48c8a3e tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.054166 Aug 30 18:10:58.634758 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 180/428] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:10:58 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:58.658183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1a2ac71-66fc-4a94-9bbd-1ade3fb06c5b tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.707360 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1a2ac71-66fc-4a94-9bbd-1ade3fb06c5b tempest-FlavorsV255TestJSON-1069844862 tempest-FlavorsV255TestJSON-1069844862-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.056023 Aug 30 18:10:58.732634 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 181/429] 10.222.0.25 () {60 vars in 1166 bytes} [Tue Aug 30 18:10:58 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:10:58.744201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3556c7e5-d3d9-4fe9-b8e1-2b11cef4d5f3 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.888536 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3556c7e5-d3d9-4fe9-b8e1-2b11cef4d5f3 tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1576247868" status: 202 len: 0 microversion: 2.55 time: 0.153542 Aug 30 18:10:58.896253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 182/430] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Aug 30 18:10:58 2022] DELETE /compute/v2.1/flavors/1576247868 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:10:58.915309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-006d5df6-989b-4a63-8255-a0110c38d51c tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:10:58.942259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:10:59.000496 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-baff4c3a-46b7-4da8-b85a-594357baaa3c tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 0.621448 Aug 30 18:10:59.003999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 249/431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:10:58 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:10:59.058729 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-006d5df6-989b-4a63-8255-a0110c38d51c tempest-FlavorsV255TestJSON-1712506442 tempest-FlavorsV255TestJSON-1712506442-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.154285 Aug 30 18:10:59.074687 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 183/432] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:10:58 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:11:00.031102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:00.038335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:00.093094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:00.112745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:00.114595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:00.116151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:00.123350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:00.125209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:01.246607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:01.296778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:01.322953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0ca5b5d-bdf7-476b-8880-72d08ce0b21e tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 1.300927 Aug 30 18:11:01.328395 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 250/433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:00 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:02.397407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:02.406154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:02.441402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.442144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.442942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:02.444443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:02.447228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:02.452976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:04.743581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:04.767766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e21e388e-4691-4bf7-b29d-cf26432c2809 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 2.390789 Aug 30 18:11:04.771233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 184/434] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:02 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:05.107559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b631196-3911-4594-b498-1ba141701f35 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:05.159893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b631196-3911-4594-b498-1ba141701f35 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.469971 Aug 30 18:11:05.160763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 251/435] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:11:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:05.793081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:05.793690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:05.797076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:05.846038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:05.846755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:05.848539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:05.849574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:05.855120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:05.859324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:06.031978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e00f27b-eb62-4aa5-ae9c-19f3b0bd9ee8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:06.051978 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e00f27b-eb62-4aa5-ae9c-19f3b0bd9ee8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.277737 Aug 30 18:11:06.052820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 185/436] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:11:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:06.377304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:06.421702 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9b248ea-0009-4684-9e93-d40c53d9db1f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 0.632323 Aug 30 18:11:06.426011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 252/437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:05 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:07.250473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2270fa1-42a4-4c8e-bbbe-b7e0f97ac02b tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1775342602", "id": 840514432, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:07.321062 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2270fa1-42a4-4c8e-bbbe-b7e0f97ac02b tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.258845 Aug 30 18:11:07.329386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 186/438] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:06 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:07.347680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58eb4cc3-74ad-4590-9963-758b3200cc64 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:07.381973 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58eb4cc3-74ad-4590-9963-758b3200cc64 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030527 Aug 30 18:11:07.385491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 253/439] 10.222.0.25 () {58 vars in 1182 bytes} [Tue Aug 30 18:11:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:11:07.404765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08da6246-a56b-48ab-8627-b42038c7944e tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-880620738", "id": 1368620075, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:07.453048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:07.456334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:07.462900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:07.474327 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08da6246-a56b-48ab-8627-b42038c7944e tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.080587 Aug 30 18:11:07.489697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 187/440] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:07 2022] POST /compute/v2.1/flavors => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:07.502956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb8262f6-9439-4aab-a18e-ca106f7d14c0 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:07.536226 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb8262f6-9439-4aab-a18e-ca106f7d14c0 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040302 Aug 30 18:11:07.542444 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 188/441] 10.222.0.25 () {58 vars in 1182 bytes} [Tue Aug 30 18:11:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:11:07.557317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:07.563674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:07.567280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:07.576119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:07.579322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-accf1f49-cc12-44ca-bfbc-b4a9e9757d3c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Action: 'create', calling method: .version_select at 0x7f4e5718a820>, body: {"keypair": {"name": "tempest-keypair-1483351753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuwjHrRJA7ohcN7n7YfuR5UUPO8612oxtNX1a2YTd+p9thDR/JctDtlb1qQQV1BoQnGyy1mkrWX7uk27I0KS1q14K91opsH315QcZzwA3TDx0d4A3da94fQ4Nr2+4lk+g=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:07.580924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:07.583673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:07.643286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-accf1f49-cc12-44ca-bfbc-b4a9e9757d3c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:07.654530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-accf1f49-cc12-44ca-bfbc-b4a9e9757d3c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for user bb87eded75e64169b15feb9cab2eec4b and project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:07.720395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-accf1f49-cc12-44ca-bfbc-b4a9e9757d3c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162305 Aug 30 18:11:07.721528 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 189/442] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:11:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:08.174488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82", "name": "network-vif-plugged", "status": "completed", "tag": "1eaf64d3-e53c-478b-bd21-808a45ada76e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:08.232024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:08.243936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:08.244817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:08.328254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] Creating event network-vif-plugged:1eaf64d3-e53c-478b-bd21-808a45ada76e for instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 on n-h1-854119-10 Aug 30 18:11:08.355663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-17e89791-b0a3-4958-bf2b-0e6962475dee req-a9b158cf-f7d7-4e15-8c81-55cd1cc07d25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191042 Aug 30 18:11:08.373248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 190/443] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:09.040642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:09.060154 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24697000-d403-4818-b356-5f9240007ce7 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 1.609948 Aug 30 18:11:09.062042 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 254/444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:07 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:09.504781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-447140698", "imageRef": "69f0b672-15c7-4bef-86db-4962658a27f6", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:09.632612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:10.126753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] Request method failure captured: Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 142 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlK3B_ix7lYkmCc1xUTL781ptdajuKSwzlt89VSIeDShYooCSw_p68hExnglBuDDl8cJrugYv5Vqhn3qJPtjOy_apEdeL-FDy97PLvhAHJtY9u9m4oLEknd5PJYeYb067QtN7D-lPPzH9aENPT9Uz_MeE3wFll0YppJvmMQlQ7rRjRw Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 09fbbae7d1d14001a5cc5787a96915a7 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsV2NegativeTest-2036891767 Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:11:10.128707 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09fbbae7d1d14001a5cc5787a96915a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09fbbae7d1d14001a5cc5787a96915a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09fbbae7d1d14001a5cc5787a96915a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09fbbae7d1d14001a5cc5787a96915a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsV2NegativeTest-2036891767 Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 09fbbae7d1d14001a5cc5787a96915a7 Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2036891767 Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsV2NegativeTest-2036891767-project Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 216c246df932468091ebace65d1eaa16 Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsV2NegativeTest-2036891767-project Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-447140698", "imageRef": "69f0b672-15c7-4bef-86db-4962658a27f6", "flavorRef": "452"}} Aug 30 18:11:10.130042 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor's memory is too small for requested image. Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-447140698', 'imageRef': '69f0b672-15c7-4bef-86db-4962658a27f6', 'flavorRef': '452'}}} Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:10.130825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:10.131902 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 30 18:11:10.133014 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:10.134958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:10.137410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-360683fa-9bb0-4039-be5b-57e74d41f5a5 tempest-FlavorsV2NegativeTest-2036891767 tempest-FlavorsV2NegativeTest-2036891767-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.637081 Aug 30 18:11:10.138829 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 255/445] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 639 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:11:10.154330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:10.156482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:10.159604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-90f55cd8-0ff6-4cad-9a7f-3701b1ca9968 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] Calling method '.version_select at 0x7f4e571d59d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:10.170096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:10.171218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:10.172124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:10.173582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:10.174330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:10.175056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:10.685361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:10.711459 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95bed87e-9cb6-4275-9ca3-1621d70caed9 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1319 microversion: 2.1 time: 0.566808 Aug 30 18:11:10.714572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 256/446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:10 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:10.725219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-90f55cd8-0ff6-4cad-9a7f-3701b1ca9968 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 5389 microversion: 2.1 time: 1.470221 Aug 30 18:11:10.726619 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 191/447] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:11:09 2022] GET /compute/v2.1/os-networks => generated 5389 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:10.750658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24d6e057-201b-4079-8140-f2b06f807273 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] Calling method '.version_select at 0x7f4e57550430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:11.381736 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24d6e057-201b-4079-8140-f2b06f807273 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/9585baba-2122-4932-98c4-6da5756fbca9" status: 200 len: 652 microversion: 2.1 time: 0.648204 Aug 30 18:11:11.388547 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 257/448] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:11:10 2022] GET /compute/v2.1/os-networks/9585baba-2122-4932-98c4-6da5756fbca9 => generated 652 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:11.467730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-329002bf-798a-427d-9094-925ec33ac399 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] Calling method '.version_select at 0x7f4e5718ac10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:11.765847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:11.769103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:11.798790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.800128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.802856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:11.804916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:11.809706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:11.811552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:12.006591 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-329002bf-798a-427d-9094-925ec33ac399 tempest-NetworksTest-1793350074 tempest-NetworksTest-1793350074-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 5389 microversion: 2.1 time: 0.545622 Aug 30 18:11:12.012163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 192/449] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:11:11 2022] GET /compute/v2.1/os-networks => generated 5389 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:12.956287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:12.974563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0472dce9-779d-47f4-962a-268aaeb2f134 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1469 microversion: 2.1 time: 1.218006 Aug 30 18:11:12.975749 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 258/450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:11 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1469 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:13.006082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:13.009532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:13.027350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.052293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.053871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.055043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.056283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.058145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.144992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=60 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:13.149942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lazy-loading 'flavor' on Instance uuid ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:11:13.444973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0501713-8f4d-4a04-b74d-489ac9bf0be7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82/action" status: 202 len: 0 microversion: 2.1 time: 0.452238 Aug 30 18:11:13.452379 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 193/451] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:11:12 2022] POST /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:11:13.471234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:13.475327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:13.486554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.495181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.495916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:13.496905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:13.497571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:13.503243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:14.647758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be9d531d-307f-4ae2-948b-c081a6312394 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Action: 'create', calling method: .version_select at 0x7f4e571d5310>, body: {"keypair": {"name": "tempest-keypair-7390554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJChtH0vE/ex1Re/8TC7NBria6hz+U8iP7QQ5s3rH5tkXtxVQmjmnO2i/9mSOQDervCG1IQ7f1XaIcMPg8PSokhOgPHb2GL8Bz6Tri9XX+5v79W1x8lZvHCfAxvkD8xh4A=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:14.711735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-be9d531d-307f-4ae2-948b-c081a6312394 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Getting quotas for project 97a09f1cb6404d30b4871a5165ab7f58. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:14.738521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-be9d531d-307f-4ae2-948b-c081a6312394 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Getting quotas for user 46366931fc5b4f07870c34a86c97b518 and project 97a09f1cb6404d30b4871a5165ab7f58. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:14.817198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be9d531d-307f-4ae2-948b-c081a6312394 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.693130 Aug 30 18:11:14.818238 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 194/452] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:11:14 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:11:15.315549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d502c84e-c64d-4664-89b6-495246ca6fa5 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Action: 'create', calling method: .version_select at 0x7f4e571a5160>, body: {"keypair": {"name": "tempest-keypair-995699048", "type": "ssh", "user_id": "662318585cdc43bcb00f541339c6842d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyivV1d+ZhP8NiSw5WlOIgfIpEArze9BmYy3+OfUd2PzSYm3WFHRu70D2j+AReSW5xjRPwYzfxRILAyyGAe/VTSXX3pwNQ3x81ZwcK3dt0/IetV4wibG0yjHGJgpyDY2g=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:15.353384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d502c84e-c64d-4664-89b6-495246ca6fa5 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:15.365551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d502c84e-c64d-4664-89b6-495246ca6fa5 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for user 36df0d3c578f4effa16bbb15a6fd0da4 and project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:15.420997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:15.437160 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64ffb0ba-2036-451a-b6e9-98e3cda092db tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1477 microversion: 2.1 time: 1.979948 Aug 30 18:11:15.456048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 259/453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:13 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1477 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:15.470401 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d502c84e-c64d-4664-89b6-495246ca6fa5 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.650416 Aug 30 18:11:15.471524 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 195/454] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:11:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 652 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:11:15.488838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a78fc8d6-60ac-49c2-bdff-4dd566ecc373 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Action: 'create', calling method: .version_select at 0x7f4e576a65e0>, body: {"keypair": {"name": "tempest-keypair-2132995217", "type": "ssh", "user_id": "662318585cdc43bcb00f541339c6842d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGS8nM0m6HlarmnpzhQGSKaQ30Dvce76P7qE1N3LifkbL1rE4NHgSenul/9laW1u5FV7+Z+UKojUIJ2kbiW7N+DSBZ+Pt7XpdBfrpjKuEpYKLRFVVBW1ZpNWSCFasfG+6g=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:15.540921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a78fc8d6-60ac-49c2-bdff-4dd566ecc373 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:15.550474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a78fc8d6-60ac-49c2-bdff-4dd566ecc373 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for user 36df0d3c578f4effa16bbb15a6fd0da4 and project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:15.616743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a78fc8d6-60ac-49c2-bdff-4dd566ecc373 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.131469 Aug 30 18:11:15.637038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 260/455] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:11:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 18:11:15.641910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5191d5e-d23f-4430-b8b3-f87c198aeb06 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Calling method '.version_select at 0x7f4e571a5790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.664644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5191d5e-d23f-4430-b8b3-f87c198aeb06 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-995699048?user_id=662318585cdc43bcb00f541339c6842d" status: 200 len: 511 microversion: 2.10 time: 0.026718 Aug 30 18:11:15.666775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 196/456] 10.222.0.25 () {60 vars in 1337 bytes} [Tue Aug 30 18:11:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-995699048?user_id=662318585cdc43bcb00f541339c6842d => generated 511 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:11:15.698703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78049079-672d-4e0c-b2cb-db1c6fcdb292 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Action: 'create', calling method: .version_select at 0x7f4e575738b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1889134076", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXPH9cwKRcSAo9qTLuxqJ6czrLQURDsg+2T6cdYZf3OlH8142dgGH+4iY28Trh3dVw68fXBp1yQlpvuK7m8qaDI50G+F6+tQi4J89d0P9H62BoFI4Ib6Pc+YKlcP3IeMQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:15.738281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78049079-672d-4e0c-b2cb-db1c6fcdb292 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:15.754611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78049079-672d-4e0c-b2cb-db1c6fcdb292 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Getting quotas for user 36df0d3c578f4effa16bbb15a6fd0da4 and project 33eb22651ee247e8b299f933b53c248f. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:15.883067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78049079-672d-4e0c-b2cb-db1c6fcdb292 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.193402 Aug 30 18:11:15.886428 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 261/457] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:11:15 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:11:15.901205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-df585714-94ff-41b6-a099-7bfe674a25ad tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Calling method '.version_select at 0x7f4e571a5f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.905440 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-df585714-94ff-41b6-a099-7bfe674a25ad tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:11:15.930581 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-df585714-94ff-41b6-a099-7bfe674a25ad tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=662318585cdc43bcb00f541339c6842d" status: 200 len: 725 microversion: 2.10 time: 0.031926 Aug 30 18:11:15.945364 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 197/458] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Aug 30 18:11:15 2022] GET /compute/v2.1/os-keypairs?user_id=662318585cdc43bcb00f541339c6842d => generated 725 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:11:15.953190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96fa4897-4311-4424-a8dc-f8097e8b80e8 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Calling method '.version_select at 0x7f4e577d1ee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:15.991857 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96fa4897-4311-4424-a8dc-f8097e8b80e8 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1889134076" status: 204 len: 0 microversion: 2.10 time: 0.045425 Aug 30 18:11:15.992995 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 262/459] 10.222.0.25 () {60 vars in 1325 bytes} [Tue Aug 30 18:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1889134076 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 18:11:16.008872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7885b5b2-e4b7-44be-859d-06216ee13829 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Calling method '.version_select at 0x7f4e571f55e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:16.125441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7885b5b2-e4b7-44be-859d-06216ee13829 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132995217?user_id=662318585cdc43bcb00f541339c6842d" status: 204 len: 0 microversion: 2.10 time: 0.102311 Aug 30 18:11:16.129178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 198/460] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132995217?user_id=662318585cdc43bcb00f541339c6842d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:11:16.141434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23826fa4-a585-4586-9147-43afbe427f00 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] Calling method '.version_select at 0x7f4e57486f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:16.189811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23826fa4-a585-4586-9147-43afbe427f00 tempest-KeyPairsV210TestJSON-1421145572 tempest-KeyPairsV210TestJSON-1421145572-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995699048?user_id=662318585cdc43bcb00f541339c6842d" status: 204 len: 0 microversion: 2.10 time: 0.053295 Aug 30 18:11:16.191719 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 263/461] 10.222.0.25 () {60 vars in 1340 bytes} [Tue Aug 30 18:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995699048?user_id=662318585cdc43bcb00f541339c6842d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:11:16.475232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:16.477257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:16.495849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:16.499515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:16.500899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:16.503020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:16.506109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:16.507198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:17.120067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:17.136920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f45525d-ae11-4d93-8ffb-3458dd051ab1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1460 microversion: 2.1 time: 0.667120 Aug 30 18:11:17.155565 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 199/462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:16 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1460 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:17.161365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:17.162960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:17.176916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:17.177865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:17.178862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:17.180968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:17.182064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:17.183787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:18.220805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1484404130", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:18.395720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:18.497766 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-777cc6f6-d61d-4ed4-bac3-d4c81a9b300e tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1613 microversion: 2.1 time: 1.340974 Aug 30 18:11:18.502021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 264/463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:17 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1613 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:18.535118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-987618588", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "1368620075", "adminPass": "***", "networks": [{"uuid": "69cb7ba0-dd7c-453c-91e6-5d1017a55f5e"}], "security_groups": [{"name": "tempest-securitygroup--1560496100"}], "key_name": "tempest-keypair-1483351753", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:18.814288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] validate_networks() for [('69cb7ba0-dd7c-453c-91e6-5d1017a55f5e', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:19.583687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:19.585196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:19.586251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:19.587211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:19.589302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:19.625102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.627321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.634570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.639185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.642934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.646956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:19.750742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Getting quotas for project ddd4e7f9205f42588c1b5a90e92dd0c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:19.757590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Getting quotas for user 9c47e78df83f41e99ec8b6d0ca9c7a55 and project ddd4e7f9205f42588c1b5a90e92dd0c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:19.773271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:19.780410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:19.784664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:19.951018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ab97c56-b855-4761-8f05-34fb3b422d27 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549710 Aug 30 18:11:19.970981 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 200/464] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:19.985606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:19.995956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:19.997082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:19.998104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.002047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:20.003249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:20.005519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.086082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-22e842f5-e53c-4bc6-a30f-7d060d7d9ceb tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.110136 Aug 30 18:11:20.087647 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 201/465] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:11:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:20.577456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Calling method '.version_select at 0x7f4e571a5790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:20.669660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:11:20.672148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Neutron security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:11:20.673371 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] HTTP exception thrown: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.673371 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Request method failure captured: Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/2769d13e-bbf8-47b0-bbde-b56ba9f50670 HTTP/1.1 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLH8t6XDxJ-QnhK3vqJ8WJJYVPbQmzAjbl7oh7r9WAapDSjW711NvIFno75j41g-vC5eT21bvB9rPY6U0q0ojvgNPhgT8AEoh-AbBhvIZ8p1gZaAv-QKsya0eyhifuKu93fHQKYW4p8ws4ae_4TPjr-lZPuPVZu1D7cYW52l6SYG9E Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:11:20.677843 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3244191c315c4107b80ab5d53c9ac72e Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.680740 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2769d13e-bbf8-47b0-bbde-b56ba9f50670'} Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:20.682221 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:11:20.684567 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.688915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Returning 404 to user: Security group 2769d13e-bbf8-47b0-bbde-b56ba9f50670 does not exist Aug 30 18:11:20.695413 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c9658471-d9d3-4485-a6b9-23202f83de21'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:20.702262 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f06e0e0-3929-4a57-bf67-99e7a2fd817d tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2769d13e-bbf8-47b0-bbde-b56ba9f50670" status: 404 len: 194 microversion: 2.1 time: 0.612797 Aug 30 18:11:20.714657 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 202/466] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:11:20 2022] DELETE /compute/v2.1/os-security-groups/2769d13e-bbf8-47b0-bbde-b56ba9f50670 => generated 194 bytes in 626 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:20.769831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a541b8f-1f5e-4b1c-bfbb-e6ceebb439bc tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:20.770673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a541b8f-1f5e-4b1c-bfbb-e6ceebb439bc tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:20.786198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:20.787616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:20.787817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:20.788737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:20.789949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:20.827813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:20.828334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:20.832233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.833108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:20.833606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:20.834172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:20.886491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:20.901090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for user bb87eded75e64169b15feb9cab2eec4b and project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:20.937134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:20.941772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:21.044431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a541b8f-1f5e-4b1c-bfbb-e6ceebb439bc tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:21.060329 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a541b8f-1f5e-4b1c-bfbb-e6ceebb439bc tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1223 microversion: 2.1 time: 0.339979 Aug 30 18:11:21.060921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 203/467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:20 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1223 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:21.072655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-10", "block_migration": true, "disk_over_commit": false}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:21.077321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:21.089920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.090943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.091559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.092500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.093539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.094200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.103577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9aa1c34e-c82e-46d2-9af3-caac3a7e8ba2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.580623 Aug 30 18:11:21.104412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 265/468] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:21.134260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-211405969", "imageRef": "a3ea0ad8-9788-4bbb-a147-3f7926b41f38", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dd5f503f-d2b1-417e-b10d-8c666320f68d"}], "security_groups": [{"name": "tempest-securitygroup--1784341731"}], "key_name": "tempest-keypair-7390554", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:21.160692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Lazy-loading 'flavor' on Instance uuid ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:11:21.180178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 while it is in vm_state suspended Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Request method failure captured: Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82/action HTTP/1.1 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 98 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJ_LIyiS2d56cYIvEIddJb4CqnSlDB3pXjioUeAdCAhdrtmWsZBPAa36ZF4gdYDPXQmAJoEGl2LnpiDKYdYvOWg_6vb8ubjL3698ncHRiC5AAYcablkD749SNQHCjTbE-K2QVH-6-ieSn3cv7s_JGyn8ADUXV2EEeYqQc7bBygZCFQ Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f35191b9c30e4cc28c4ddc7654017717 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:11:21.182330 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f35191b9c30e4cc28c4ddc7654017717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f35191b9c30e4cc28c4ddc7654017717 Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1991184011 Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationNegativeTest-1991184011-project-admin Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 0eb266a7d9cf4d678453e200b46b13fc Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationNegativeTest-1991184011-project-admin Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: {"os-migrateLive": {"host": "n-h2-854119-10", "block_migration": true, "disk_over_commit": false}} Aug 30 18:11:21.185231 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'os-migrateLive' instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 while it is in vm_state suspended Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82', 'body': {'os-migrateLive': {'host': 'n-h2-854119-10', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 18:11:21.186918 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:21.189142 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 while it is in vm_state suspended Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 while it is in vm_state suspended Aug 30 18:11:21.193334 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:21.196027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 while it is in vm_state suspended {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:21.196027 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5274de63-b6d8-44d1-89a8-47e3af321cc7 tempest-LiveMigrationNegativeTest-1991184011 tempest-LiveMigrationNegativeTest-1991184011-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82/action" status: 409 len: 155 microversion: 2.1 time: 0.123929 Aug 30 18:11:21.196027 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 204/469] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:11:21 2022] POST /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82/action => generated 155 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:11:21.202144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65770e1a-d57d-4ab6-b5e0-02c097c8e523 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013330 Aug 30 18:11:21.203241 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 205/470] 10.222.0.25 () {58 vars in 1164 bytes} [Tue Aug 30 18:11:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 18:11:21.229273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4db3d845-def2-483b-99fe-2772c80c638b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:21.237458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4db3d845-def2-483b-99fe-2772c80c638b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:21.420323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] validate_networks() for [('dd5f503f-d2b1-417e-b10d-8c666320f68d', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:21.511126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4db3d845-def2-483b-99fe-2772c80c638b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:21.543613 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4db3d845-def2-483b-99fe-2772c80c638b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1264 microversion: 2.1 time: 0.333999 Aug 30 18:11:21.545553 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 206/471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:21 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1264 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:21.580910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:21.582972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:21.632591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.633466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.634568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.635836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:21.636633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:21.637388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:21.763351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:11:22.231661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65e4910c-64b2-4ba0-b0bf-d23d8e504161 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 204 len: 0 microversion: 2.1 time: 0.682682 Aug 30 18:11:22.247538 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 207/472] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:11:21 2022] DELETE /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:11:22.275072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0cf1230-a6b0-427c-b959-2b75abb26b71 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Calling method '.version_select at 0x7f4e5718a040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:23.441929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0cf1230-a6b0-427c-b959-2b75abb26b71 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.188330 Aug 30 18:11:23.443510 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 208/473] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:11:22 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:23.457427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:23.458764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:23.507060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.509204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.510695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.512444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.515511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.516631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.675960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:23.676573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:23.676852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:23.677253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:23.677848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:23.705869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.706422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.706824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.707570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:23.708027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:23.708451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:23.775906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Getting quotas for project 97a09f1cb6404d30b4871a5165ab7f58. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:23.784121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Getting quotas for user 46366931fc5b4f07870c34a86c97b518 and project 97a09f1cb6404d30b4871a5165ab7f58. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:23.820798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:23.827664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3ea0ad8-9788-4bbb-a147-3f7926b41f38',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:23.890503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:23.905020 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3aa99ea4-be55-4257-b6a5-8540989f0a97 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1281 microversion: 2.1 time: 0.459789 Aug 30 18:11:23.906832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 209/474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:23 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1281 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:23.972197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:23.977157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:23.990889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3650c61-c6de-41d0-84cd-78b88c52d20f tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.871882 Aug 30 18:11:23.992199 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 266/475] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:24.005990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.007156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.007822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:24.008930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.011047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.015836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:24.028227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:24.029123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:24.048084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.048599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.049047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:24.058156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:24.059097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:24.061356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:24.362504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:24.398007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3edaf74b-eef2-4145-bf56-b841f07901f8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1322 microversion: 2.1 time: 0.401478 Aug 30 18:11:24.400556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 267/476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:23 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:24.421349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Calling method '.version_select at 0x7f4e574b8550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:24.794540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:11:24.796375 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 30 18:11:24.796375 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Request method failure captured: Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-security-groups/4efc7150-c5f8-40c4-8792-25b129af520e HTTP/1.1 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLH8t6XDxJ-QnhK3vqJ8WJJYVPbQmzAjbl7oh7r9WAapDSjW711NvIFno75j41g-vC5eT21bvB9rPY6U0q0ojvgNPhgT8AEoh-AbBhvIZ8p1gZaAv-QKsya0eyhifuKu93fHQKYW4p8ws4ae_4TPjr-lZPuPVZu1D7cYW52l6SYG9E Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:11:24.806264 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3244191c315c4107b80ab5d53c9ac72e Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: exception: Insufficient rights for removing default security group. Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.807666 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4efc7150-c5f8-40c4-8792-25b129af520e'} Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:24.808439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 30 18:11:24.809843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:24.810935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] Aug 30 18:11:24.812680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:24.815285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 30 18:11:24.815285 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-c7fdc6c7-9e0d-4315-90a8-1acb36f6139c'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:24.816329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2ac75bb-59a5-4d2e-9591-0582edd36342 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4efc7150-c5f8-40c4-8792-25b129af520e" status: 400 len: 182 microversion: 2.1 time: 0.411435 Aug 30 18:11:24.818873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 268/477] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:11:24 2022] DELETE /compute/v2.1/os-security-groups/4efc7150-c5f8-40c4-8792-25b129af520e => generated 182 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:11:25.409236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8b64d6d-8b0f-42ed-87a2-2d3b163a58f0 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e57400ca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:25.556832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:25.580378 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-768792ce-0930-40e1-8962-844f9b8e35f1 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1466 microversion: 2.1 time: 1.671651 Aug 30 18:11:25.581865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 210/478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:23 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1466 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:25.592271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:25.593863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:25.611753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:25.613251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:25.614270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:25.618098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:25.622503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:25.623652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.302232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8b64d6d-8b0f-42ed-87a2-2d3b163a58f0 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea" status: 200 len: 371 microversion: 2.1 time: 1.481961 Aug 30 18:11:26.303872 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 269/479] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:11:24 2022] GET /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea => generated 371 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:26.321275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Calling method '.version_select at 0x7f4e57486ee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:26.326845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:26.338573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b18ece66-bf6e-470d-878b-5780ad66c7ca tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1246 microversion: 2.1 time: 0.754484 Aug 30 18:11:26.340125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 211/480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:25 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1246 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:26.360059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:26.370040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:26.406226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.412715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.420967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.422942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.424134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.425156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.618477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:11:26.619107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Neutron security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:11:26.619653 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] HTTP exception thrown: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.619653 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Request method failure captured: Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-security-groups/7fd1fdc7-00c8-47c6-a3c3-258346fb32cb HTTP/1.1 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLH8t6XDxJ-QnhK3vqJ8WJJYVPbQmzAjbl7oh7r9WAapDSjW711NvIFno75j41g-vC5eT21bvB9rPY6U0q0ojvgNPhgT8AEoh-AbBhvIZ8p1gZaAv-QKsya0eyhifuKu93fHQKYW4p8ws4ae_4TPjr-lZPuPVZu1D7cYW52l6SYG9E Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:11:26.621561 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3244191c315c4107b80ab5d53c9ac72e Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.624496 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7fd1fdc7-00c8-47c6-a3c3-258346fb32cb'} Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:26.626111 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:11:26.628587 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.630874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Returning 404 to user: Security group 7fd1fdc7-00c8-47c6-a3c3-258346fb32cb does not exist Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-ea3c62ed-6bff-4045-986d-08989f606687'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca015a18-9150-48af-b063-513f47c7e300 tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/7fd1fdc7-00c8-47c6-a3c3-258346fb32cb" status: 404 len: 194 microversion: 2.1 time: 0.307207 Aug 30 18:11:26.633510 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 270/481] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:11:26 2022] GET /compute/v2.1/os-security-groups/7fd1fdc7-00c8-47c6-a3c3-258346fb32cb => generated 194 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:26.639543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:26.639543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:26.668648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.669155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.669601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:26.672097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:26.672636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:26.673241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.069652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:27.088502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3906c066-6da0-4f59-a9cb-d2a39ea91a62 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1281 microversion: 2.1 time: 0.747145 Aug 30 18:11:27.091616 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 212/482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:26 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1281 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:27.104709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Action: 'update', calling method: .version_select at 0x7f4e571d5ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:27.499996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.500495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.500935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.502225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.503413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.504541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.583317 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78ef1c69-0a9b-47ac-8b18-f8458e0a917d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea" status: 200 len: 328 microversion: 2.1 time: 0.490155 Aug 30 18:11:27.592499 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 213/483] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:11:27 2022] PUT /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea => generated 328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:27.598483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.599643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.616460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.617291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.618029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.619076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.619721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.620332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.682541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:27.697780 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d527e5e7-c925-4668-ba88-9172b33cb421 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 1.068716 Aug 30 18:11:27.698786 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 271/484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:26 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:27.713397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Action: 'update', calling method: .version_select at 0x7f4e5744b0d0>, body: {"security_group": {"name": "tempest-sg-1950234851", "description": "tempest-description-1815965786"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:27.876312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:11:27.877365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Neutron security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:11:27.878221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] HTTP exception thrown: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.878221 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Request method failure captured: Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-security-groups/a66fbd0d-cb4c-4ca9-9317-2460833990f9 HTTP/1.1 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 102 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLH8t6XDxJ-QnhK3vqJ8WJJYVPbQmzAjbl7oh7r9WAapDSjW711NvIFno75j41g-vC5eT21bvB9rPY6U0q0ojvgNPhgT8AEoh-AbBhvIZ8p1gZaAv-QKsya0eyhifuKu93fHQKYW4p8ws4ae_4TPjr-lZPuPVZu1D7cYW52l6SYG9E Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:11:27.880759 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f77f763a6d54b86abf9dc6a66db3294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1f77f763a6d54b86abf9dc6a66db3294 Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983 Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3244191c315c4107b80ab5d53c9ac72e Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1180633983-project Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: {"security_group": {"name": "tempest-sg-1950234851", "description": "tempest-description-1815965786"}} Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:11:27.882085 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a66fbd0d-cb4c-4ca9-9317-2460833990f9', 'body': {'security_group': {'name': 'tempest-sg-1950234851', 'description': 'tempest-description-1815965786'}}} Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:11:27.882985 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:11:27.884049 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.885185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] Aug 30 18:11:27.886261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:11:27.891584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] Returning 404 to user: Security group a66fbd0d-cb4c-4ca9-9317-2460833990f9 does not exist Aug 30 18:11:27.891584 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-42fb20eb-6349-49ea-b5d4-51c2787280a5'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:27.893557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2750ee87-0392-422e-ae3b-43be399aa73e tempest-SecurityGroupsNegativeTestJSON-1180633983 tempest-SecurityGroupsNegativeTestJSON-1180633983-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/a66fbd0d-cb4c-4ca9-9317-2460833990f9" status: 404 len: 194 microversion: 2.1 time: 0.193131 Aug 30 18:11:27.894143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 272/485] 10.222.0.25 () {60 vars in 1290 bytes} [Tue Aug 30 18:11:27 2022] PUT /compute/v2.1/os-security-groups/a66fbd0d-cb4c-4ca9-9317-2460833990f9 => generated 194 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:27.917051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:27.918921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:27.941451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.942219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.942888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:27.945234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:27.947352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:27.948315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.087534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:28.103603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c8d15af-8aae-4c09-b592-e031102c88fd tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1300 microversion: 2.1 time: 0.207953 Aug 30 18:11:28.104627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 273/486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:27 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1300 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:28.122600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31e7815d-12c1-4ba7-b002-240ad1a993eb tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:28.156333 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31e7815d-12c1-4ba7-b002-240ad1a993eb tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea" status: 202 len: 0 microversion: 2.1 time: 0.050105 Aug 30 18:11:28.157314 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 274/487] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:11:28 2022] DELETE /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:11:28.185444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:28.186502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:28.208122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.208942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.209680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.210999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.211811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.223598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.622914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:28.653823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e958099c-a795-474a-9afe-d87c3f58fd37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1281 microversion: 2.1 time: 0.494338 Aug 30 18:11:28.660299 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 275/488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:28 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1281 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:28.678731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a13fc999-bf23-4a03-87ec-2262b2153b51 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e574b8670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:28.822770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:28.837928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a3750e2-8036-47e6-96e8-f05165a7b0d4 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1466 microversion: 2.1 time: 1.243605 Aug 30 18:11:28.852595 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 214/489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:27 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1466 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:28.893093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:28.898252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:28.914274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a13fc999-bf23-4a03-87ec-2262b2153b51 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea" status: 200 len: 371 microversion: 2.1 time: 0.252291 Aug 30 18:11:28.921218 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 276/490] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:11:28 2022] GET /compute/v2.1/os-quota-sets/5a2c6b0a08ed436c931eac3bed60ffea => generated 371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:28.923398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.927963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.928963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:28.946159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:28.949460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:28.950625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:29.146783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:29.153404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:29.185208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:29.193545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:29.194336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:29.196258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:29.197247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:29.200362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:29.201112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.002105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:30.043114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7527f237-9f01-43de-9d49-1c8665f29b72 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1300 microversion: 2.1 time: 0.907360 Aug 30 18:11:30.047459 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 277/491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:29 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1300 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:30.067855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82", "name": "network-vif-unplugged", "status": "completed", "tag": "1eaf64d3-e53c-478b-bd21-808a45ada76e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:30.111752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:30.117196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:30.123105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.155251 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] Creating event network-vif-unplugged:1eaf64d3-e53c-478b-bd21-808a45ada76e for instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 on n-h1-854119-10 Aug 30 18:11:30.169120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e4d81592-3dde-4b36-bdbf-2dc04347f731 req-50a43383-61ec-4408-bfe0-8b281a252c85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119567 Aug 30 18:11:30.172814 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 278/492] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:30.189940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40471d7f-a8f4-45ea-96a4-b5c9eb71744d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e57400c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:30.777419 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40471d7f-a8f4-45ea-96a4-b5c9eb71744d tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.602957 Aug 30 18:11:30.778030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 279/493] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:11:30 2022] GET /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5/defaults => generated 371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:30.786590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:30.787620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:30.804302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:30.804811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:30.805296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:30.806046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:30.806548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:30.806975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.622235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:31.628045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:31.637984 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f77cb37e-3b21-4226-ae93-ed0b4f048c72 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1281 microversion: 2.1 time: 0.858819 Aug 30 18:11:31.638898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 280/494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:30 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1281 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:31.644263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:31.645142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:31.652207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.653138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.653737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.654785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.655483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.656301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.703100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.703903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.704521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.705142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lazy-loading 'fault' on Instance uuid ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:11:31.717506 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9d57d4b-3f49-48f6-b01e-95bbe1f5305a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 2.858388 Aug 30 18:11:31.719362 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 215/495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:28 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 2865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:31.731630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82", "name": "network-vif-deleted", "tag": "1eaf64d3-e53c-478b-bd21-808a45ada76e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:31.758514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.759388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.760071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.775779 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] Creating event network-vif-deleted:1eaf64d3-e53c-478b-bd21-808a45ada76e for instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 on n-h1-854119-10 Aug 30 18:11:31.782402 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-28e4f9c8-150c-4d31-9457-0e41bc63fa92 req-85414f5b-2be9-451f-926c-db810ce48317 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061197 Aug 30 18:11:31.783866 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 216/496] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:31.791222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:31.792201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:31.799530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.800393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.801003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:31.801921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:31.802584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:31.803597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.068402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:32.083613 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e3c1412-babb-48c2-828f-39437b72f3a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1300 microversion: 2.1 time: 0.297877 Aug 30 18:11:32.084905 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 217/497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:31 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:32.100143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:32.146709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b9ec0df-d49d-4fe6-9897-fe9986be80f3 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 200 len: 1309 microversion: 2.1 time: 0.504891 Aug 30 18:11:32.172711 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 281/498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:31 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 1309 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:32.214028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Action: 'update', calling method: .version_select at 0x7f4e577d3940>, body: {"quota_set": {"ram": "5120"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:32.530957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0645fd-c385-4382-8b86-09b48861cccc", "tag": "a0271b93-c722-408b-a646-e45cd99449cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:32.572258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.573538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.574169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.617402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.626926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.627638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.629008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.630136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.630598 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] Creating event network-changed:a0271b93-c722-408b-a646-e45cd99449cb for instance df0645fd-c385-4382-8b86-09b48861cccc on n-h2-854119-10 Aug 30 18:11:32.631532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.643603 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-44e446f9-d4cd-4a09-b0a0-260930b52fa4 req-a27bd964-f1c3-4c38-852d-d69be74e784b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556999 Aug 30 18:11:32.649002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 218/499] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:32.678156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:32.680556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:32.707327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.716547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.719011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.720128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.728095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.728879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.852800 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c08c0fd-cbe9-46b1-9ee0-9a7683f57a26 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f" status: 200 len: 328 microversion: 2.1 time: 0.677314 Aug 30 18:11:32.855952 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 282/500] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:11:32 2022] PUT /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f => generated 328 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:32.864343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:32.871555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:32.903938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.904770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.905574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:32.906795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:32.907556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:32.923482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.563049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:33.588519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e77020e-3383-4600-8219-df8a51a37a98 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 0.730332 Aug 30 18:11:33.598547 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 283/501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:32 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:33.617927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e57486700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:33.792820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.798073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.803907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.805785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.807048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.809524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.854505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:33.910272 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2222b679-1f48-4a84-b6fa-6914090311da tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f/detail" status: 200 len: 916 microversion: 2.1 time: 0.309426 Aug 30 18:11:33.912305 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 284/502] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:11:33 2022] GET /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f/detail => generated 916 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:33.928539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:33.929648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:33.958724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.959584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.960419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:33.961760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:33.962632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:33.963443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.081989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:34.087571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:34.147987 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a69e375d-99e5-4ddd-b858-322b34134109 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1281 microversion: 2.1 time: 1.469008 Aug 30 18:11:34.199017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 219/503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:32 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1281 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:34.213757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:34.224118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:34.253309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.254674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.255990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.258264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.262237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.263303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.314709 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] HTTP exception thrown: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Request method failure captured: Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 HTTP/1.1 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJ9-6ig_B676LgJEO2C6dxqYISndpJCZ_n9uQ_7MZgc4b_7Fb7x46FbJN9pTKXMte07KAo8ImKHJZlz4nXt13nmvF5KNsiABD-vjmXSQXroegWiCgXf1Xmc0UDLS8Q0uI1PMrjWOqFWQk7E_xWEREzDEki-9uSnL8n45SAaQMNObX0 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: c9c0d6bfbe664dab9895c9f526a0cf73 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:11:34.317976 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: c9c0d6bfbe664dab9895c9f526a0cf73 Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationNegativeTest-128803135-project Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 05d787b142d543d8b9b09d99084d3823 Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationNegativeTest-128803135-project Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. Aug 30 18:11:34.320853 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82'} Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:34.322497 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. Aug 30 18:11:34.325186 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:34.327576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Returning 404 to user: Instance ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:34.327576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86602d59-59ec-4a7c-bf3c-0c5574cb4886 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82" status: 404 len: 111 microversion: 2.1 time: 0.119280 Aug 30 18:11:34.337086 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 220/504] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:34 2022] GET /compute/v2.1/servers/ff5e9dde-d762-4bdd-91ca-11fc9ddf4d82 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:34.359485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:34.360307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:34.422657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.424023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.424801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.426095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.426959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.431337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.521708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:11:34.682422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:34.709967 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2509a4eb-f86b-40a8-919e-e0c9086c7711 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 0.795508 Aug 30 18:11:34.723747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 285/505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:33 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:34.743687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Action: 'update', calling method: .version_select at 0x7f4e57400b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:34.825442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5241ba12-8a27-4dfc-88a9-f6387faf5b70 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 204 len: 0 microversion: 2.1 time: 0.486115 Aug 30 18:11:34.826326 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 221/506] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:11:34 2022] DELETE /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:11:34.838234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:34.838998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:34.878924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.879422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.890820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.893248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.893248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.895681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:34.987982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:34.990724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:34.992922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.011867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.018509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.022255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.115775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.116590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.117195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.118209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.118869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.119455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.316869 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6eb5e2e8-223b-46d7-aa48-80e5acae113e tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f?user_id=dc7277b6d50c414caef0f4d75e2b4e81" status: 200 len: 328 microversion: 2.1 time: 0.590900 Aug 30 18:11:35.335058 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 286/507] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:11:34 2022] PUT /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f?user_id=dc7277b6d50c414caef0f4d75e2b4e81 => generated 328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:35.353971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:35.356615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:35.371882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.373088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.373981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.376669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.378027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.379141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.491633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:35.510770 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f48ab986-5f4e-49a2-985b-2816d01cc230 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 0.676193 Aug 30 18:11:35.526125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 222/508] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:34 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:35.526125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:35.527570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:35.542134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.552531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.554518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:35.555523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:35.555802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:35.556485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.451095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:36.466478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96cbfa4e-f51a-4c26-a6d4-4d6b931e271b tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1474 microversion: 2.1 time: 1.120379 Aug 30 18:11:36.480962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 287/509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:35 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1474 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:36.496658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1bc5efc-e696-4d62-9821-9d65e595c430 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e574a2040>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:36.575465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:36.589262 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fef9b0f9-2b7f-4af4-90bf-8c8e99fd12c9 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 1.073939 Aug 30 18:11:36.604469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 223/510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:35 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:36.626258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:36.627905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:36.642153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.644801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.646184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.652293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.653159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.653769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.748017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=47 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:36.792367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1bc5efc-e696-4d62-9821-9d65e595c430 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f?user_id=dc7277b6d50c414caef0f4d75e2b4e81" status: 200 len: 370 microversion: 2.1 time: 0.306600 Aug 30 18:11:36.801190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 288/511] 10.222.0.25 () {58 vars in 1323 bytes} [Tue Aug 30 18:11:36 2022] GET /compute/v2.1/os-quota-sets/509b6e80418d4bf68354fb478ba8aa4f?user_id=dc7277b6d50c414caef0f4d75e2b4e81 => generated 370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:36.815374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:36.816352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:36.833761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.834591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.835280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:36.836252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:36.836948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:36.837970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:37.518487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:37.576037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=30 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:37.878418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:37.895069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff19a25a-ab47-4210-adfc-d3d919e91923 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 1.092080 Aug 30 18:11:37.897932 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 289/512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:36 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:37.915148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:37.921059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:37.947139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:37.948236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:37.950986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:37.956059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:37.956934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:37.970323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:38.112074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:38.194928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e82afd7-10e3-4b6b-8ec7-0b447a2bdf56 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 1.586715 Aug 30 18:11:38.206160 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 224/513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:36 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:38.274953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:38.283878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:38.321734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:38.322236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:38.322693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:38.331868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:38.338197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:38.367153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:39.839591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:39.855930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f70c7588-f6a4-4eb6-b3d5-82123bcfb624 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 1.612680 Aug 30 18:11:39.874433 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 225/514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:38 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:39.879860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e9266d80-0a9b-4b60-9c0e-812caae14fba tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Calling method '.version_select at 0x7f4e5718a1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:40.230032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:40.239785 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-063f61be-bde2-43e2-8f68-b24dcb304415 tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1474 microversion: 2.1 time: 2.340370 Aug 30 18:11:40.250957 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 290/515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:37 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1474 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:40.260292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:40.277479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:40.309185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.312329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.318241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:40.319599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.320372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.321092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:40.321384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e9266d80-0a9b-4b60-9c0e-812caae14fba tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.445246 Aug 30 18:11:40.322170 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 226/516] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:11:39 2022] GET /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5/defaults => generated 371 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:40.343020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:40.350772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:40.359488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.363292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.374170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:40.375382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:40.376028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:40.376633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:41.206623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:41.248376 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6474b7d5-30b0-4bb3-8da2-1d942b1f8673 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 0.988550 Aug 30 18:11:41.278121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 291/517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:40 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:41.344140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Action: 'update', calling method: .version_select at 0x7f4e57400ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:41.721074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.722000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.725016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:41.731224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:41.732210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:41.734207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:42.494800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:42.778269 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-97ef9fc7-4e7c-4834-b069-504c9b27d963 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5" status: 200 len: 329 microversion: 2.1 time: 1.480483 Aug 30 18:11:42.784553 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 292/518] 10.222.0.25 () {60 vars in 1263 bytes} [Tue Aug 30 18:11:41 2022] PUT /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5 => generated 329 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:42.809096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:42.810295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:42.847276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:42.853039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:42.855951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:42.861122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:42.863544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:42.866592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.321737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:43.336572 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0994865f-558a-4c10-bd7d-0f63dfebc102 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 0.550283 Aug 30 18:11:43.355163 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 293/519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:42 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:43.363780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7cd088-bcc4-4361-9fac-789b2e57089f", "tag": "908865a9-5c0c-46de-a306-43ae8729d41a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:43.387703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.391489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.392387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.425680 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] Creating event network-changed:908865a9-5c0c-46de-a306-43ae8729d41a for instance cf7cd088-bcc4-4361-9fac-789b2e57089f on n-h2-854119-10 Aug 30 18:11:43.439986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2bf00992-925c-4e6b-a0f8-8bfedf76fedd req-afcf2520-f087-4632-8525-76ac8a2d70af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083025 Aug 30 18:11:43.443271 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 294/520] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:43.457565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:43.459602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:43.474263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.486988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.488195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:43.489790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:43.495312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:43.497350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.059334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:44.104608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c7330a3-d3df-4500-a32c-2038c2ebf55d tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1474 microversion: 2.1 time: 0.659440 Aug 30 18:11:44.116332 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 295/521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:43 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1474 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:44.147386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:44.151144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:44.196714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.213161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.216574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.220119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.221157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.222807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.365752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:44.383830 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d18363a-e82d-4cb5-9593-6b8e5df72300 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 4.049431 Aug 30 18:11:44.391999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 227/522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:40 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 4058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:44.411209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Action: 'update', calling method: .version_select at 0x7f4e571a5310>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:44.585712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.587013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.588157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.590024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:44.591128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:44.592137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:44.793063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:45.355444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:45.388545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-166fcef2-7c77-4d17-a4f8-bf2c11a9781c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 1.269367 Aug 30 18:11:45.412013 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 296/523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:44 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:45.433881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0645fd-c385-4382-8b86-09b48861cccc", "name": "network-vif-plugged", "status": "completed", "tag": "a0271b93-c722-408b-a646-e45cd99449cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:45.473185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93f341d8-df64-448c-ac2d-ea2cb7e9dd87 tempest-QuotasAdminTestJSON-1209758153 tempest-QuotasAdminTestJSON-1209758153-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5" status: 200 len: 329 microversion: 2.1 time: 1.074689 Aug 30 18:11:45.491569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.494119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.498575 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 228/524] 10.222.0.25 () {60 vars in 1263 bytes} [Tue Aug 30 18:11:44 2022] PUT /compute/v2.1/os-quota-sets/243c1775f2d548bcaddcf685906992e5 => generated 329 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:45.499211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.519864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:45.520570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:45.547608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.548075 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] Creating event network-vif-plugged:a0271b93-c722-408b-a646-e45cd99449cb for instance df0645fd-c385-4382-8b86-09b48861cccc on n-h2-854119-10 Aug 30 18:11:45.548269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.548532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.549281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.549746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.571353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.571744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d71667ef-8a61-447a-8e76-2634f5b4dd8c req-fd0698aa-3fea-470f-96ab-3259d0641015 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155778 Aug 30 18:11:45.574603 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 297/525] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:45.600803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:45.603338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:45.628847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.637919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.639843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.641939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:45.643145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:45.648478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:45.950791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d787b142d543d8b9b09d99084d3823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c0d6bfbe664dab9895c9f526a0cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:46.004285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-69c6242d-51a5-455a-b280-621ab4cf150f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 200 len: 1303 microversion: 2.1 time: 0.425917 Aug 30 18:11:46.005485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 298/526] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:45 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 1303 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:46.011963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:46.012817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:46.041742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.044209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.045733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.058408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.060694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.064760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.660282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:46.674704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab3a7395-4905-4f97-92e9-b96bcfe4735a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 0.663527 Aug 30 18:11:46.675962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 299/527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:46 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:46.684921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdff2654-b3dc-423e-ad30-e87fed671aed", "name": "network-vif-deleted", "tag": "db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:46.713686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.714643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.715491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.780741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] Creating event network-vif-deleted:db25f51d-e8f3-4a41-a4e9-3ff8e97cdbf0 for instance fdff2654-b3dc-423e-ad30-e87fed671aed on n-h1-854119-10 Aug 30 18:11:46.807587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0d670290-2c1c-4fea-91df-6262f80b1d68 req-32dd3038-33f2-45b0-ac16-43332162f163 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129185 Aug 30 18:11:46.812631 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 300/528] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:46.826561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:46.827739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:46.836879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.837485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.838135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:46.839686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:46.840684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:46.841292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.526532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:47.551045 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ee6ab90-dee1-4991-8640-0bbffff2ab37 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 2.048925 Aug 30 18:11:47.559917 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 229/529] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:45 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:47.569833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:47.583276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] [instance: fdff2654-b3dc-423e-ad30-e87fed671aed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:47.597625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.598489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.599265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.600519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.601331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.602020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.643573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] HTTP exception thrown: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Request method failure captured: Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed HTTP/1.1 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJ9-6ig_B676LgJEO2C6dxqYISndpJCZ_n9uQ_7MZgc4b_7Fb7x46FbJN9pTKXMte07KAo8ImKHJZlz4nXt13nmvF5KNsiABD-vjmXSQXroegWiCgXf1Xmc0UDLS8Q0uI1PMrjWOqFWQk7E_xWEREzDEki-9uSnL8n45SAaQMNObX0 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: c9c0d6bfbe664dab9895c9f526a0cf73 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:11:47.646442 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c0d6bfbe664dab9895c9f526a0cf73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: c9c0d6bfbe664dab9895c9f526a0cf73 Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-128803135 Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationNegativeTest-128803135-project Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 05d787b142d543d8b9b09d99084d3823 Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationNegativeTest-128803135-project Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. Aug 30 18:11:47.648036 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fdff2654-b3dc-423e-ad30-e87fed671aed'} Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:47.648915 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. Aug 30 18:11:47.650905 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:47.652453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] Returning 404 to user: Instance fdff2654-b3dc-423e-ad30-e87fed671aed could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:47.668015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-111128ff-9cbd-4a30-bc02-aa90bef9180f tempest-LiveMigrationNegativeTest-128803135 tempest-LiveMigrationNegativeTest-128803135-project] 10.222.0.25 "GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed" status: 404 len: 111 microversion: 2.1 time: 0.104807 Aug 30 18:11:47.676859 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 230/530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:47 2022] GET /compute/v2.1/servers/fdff2654-b3dc-423e-ad30-e87fed671aed => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:47.685598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:47.704672 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38ec19ad-b1c4-4002-b937-e40468aff347 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1390 microversion: 2.1 time: 0.886736 Aug 30 18:11:47.716011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:47.717936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:47.721387 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 301/531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:46 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1390 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:47.731465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.734599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.735652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:47.736953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:47.741542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:47.742473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:48.577542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:48.581339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:48.619823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:48.622650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:48.626927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:48.631712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:48.632896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:48.635532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.437922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:49.449163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f3612bf-cffa-46d2-8e61-527e3bd63fb5 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 0.879598 Aug 30 18:11:49.456403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 302/532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:48 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:49.462081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:49.463158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:49.473368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:49.474286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:49.475058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.476074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:49.476773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:49.477456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.636341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:49.658484 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7afa8693-5390-48b7-b00b-0aa03bab3b1e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 1.947685 Aug 30 18:11:49.676578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 231/533] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:47 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:49.699238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c745e1-8abe-4a92-b2ab-0c93734e7503", "tag": "0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:49.717676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:49.719437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:49.721014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:49.749390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] Creating event network-changed:0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8 for instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 on n-h1-854119-10 Aug 30 18:11:49.761812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cde3c75a-9970-43e7-9d42-cb9c9e5af854 req-9bd50a78-1a49-45ea-a1d0-89282b3f7b61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081876 Aug 30 18:11:49.764052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 232/534] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:50.026005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:50.038950 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b733c193-365d-402a-8356-a321744c7ad6 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1589 microversion: 2.1 time: 0.580799 Aug 30 18:11:50.040696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 303/535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:49 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1589 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:50.080760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:50.081402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:50.093598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.094877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.096143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.097583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.097583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.098040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.480292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:50.481028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:50.509093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.510792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.512469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.514001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.517091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.520493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.899250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ae318ee-f204-45bd-bc0a-4b91e4e834e5 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.823540 Aug 30 18:11:50.900250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 233/536] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:11:50 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc/os-interface => generated 284 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:50.918468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:50.919681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:50.952431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.953134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.953675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:50.958970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:50.959364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:50.959799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:51.687484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:51.699733 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c84d4668-1b44-4baf-aeda-9631ad523c1d tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 1.224505 Aug 30 18:11:51.719630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 304/537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:50 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:52.194495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:52.206325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-529ec39a-9f96-4199-8747-5232466726fa tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 1.303283 Aug 30 18:11:52.207209 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 234/538] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:50 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:52.567834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7cd088-bcc4-4361-9fac-789b2e57089f", "name": "network-vif-plugged", "status": "completed", "tag": "908865a9-5c0c-46de-a306-43ae8729d41a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:52.585516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=15 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:52.603562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:52.603562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:52.603562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:52.651832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:52.666388 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] Creating event network-vif-plugged:908865a9-5c0c-46de-a306-43ae8729d41a for instance cf7cd088-bcc4-4361-9fac-789b2e57089f on n-h2-854119-10 Aug 30 18:11:52.677275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bbd35e3c-012f-4165-a569-53d3397ab044 req-bbb49991-484f-40a5-9fec-5e4f0e747227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120657 Aug 30 18:11:52.689258 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 305/539] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:52.738001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:52.744103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:52.789121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:52.794464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:52.796113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:52.805607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:52.808229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:52.814200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:53.243088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:53.243357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:53.245421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=37 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:53.263092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:53.263992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:53.264654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:53.265615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:53.270553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:53.271624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:53.878104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:53.891136 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4323f01a-c4c7-40ad-adcc-e0640d254a79 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 0.654689 Aug 30 18:11:53.893734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 306/540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:53 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:54.615936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:55.187219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:55.191735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-165516421", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "c509431d-333d-4d7e-98ce-55b83064afaa"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:55.198287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e282861c-aeab-4dc8-9cef-761f96f8e1a6 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1323 microversion: 2.1 time: 2.469857 Aug 30 18:11:55.217677 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 235/541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:52 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1323 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:55.228805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:55.229422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:55.245979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:55.246922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:55.247952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:55.249249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:55.250058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:55.251237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:55.448568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=34 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:55.473893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] validate_networks() for [('c509431d-333d-4d7e-98ce-55b83064afaa', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:11:55.744027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:55.753393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12ff290f-c8f6-423e-92a8-ccc864a0ede5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 0.534589 Aug 30 18:11:55.758437 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 236/542] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:55 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:56.227422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:56.228102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:56.238064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.238594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.239294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:56.240230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.241580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.242253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:56.850675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:56.889261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1de46106-c89b-498e-8300-d3daaf9b000b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1473 microversion: 2.1 time: 0.669151 Aug 30 18:11:56.890293 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 237/543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:56 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1473 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:11:56.910555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:56.922550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:56.961626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.964984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.966938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:56.974562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:56.988710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:56.995749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:57.376489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:11:57.378734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:11:57.379809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:11:57.380763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:11:57.390401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:11:57.489296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:57.489296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:57.489296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:57.500603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:57.501618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:57.507346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:57.643191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:11:57.664948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for user 8526d208810247feaf96b54f55452d07 and project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:11:57.763176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:11:57.771921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:11:57.897074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:57.902304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:11:57.935874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1104d0a7-87ab-48f3-92dd-57b64f675705 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 1.036270 Aug 30 18:11:57.937346 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 238/544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:56 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:57.962298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:57.980897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:58.003679 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4f45646-e693-4806-bf26-f76270bf436e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.613425 Aug 30 18:11:58.031373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 307/545] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:11:58.042106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.043422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.045541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:58.049398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:58.049677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.050845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.051351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.051798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.072542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.073827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.075226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.096051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.096603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.111104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.157837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Request method failure captured: Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f/diagnostics HTTP/1.1 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLCLUoJ1yfbAy03oY4Ds50Jgv-HO5XEZJ7iFaPlM5RENI1btESWxzKwuwcHEDcEf6URsc3n6iX-K-LwajXx7EwRgIRG1nslyFLzby_hxVe30UB0iU2YsfjgdCD9EtewfiKqeqRjKU_abH_QpNphAMtd3MxywVExv9yzCvZcPK3OMWI Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ddd4e7f9205f42588c1b5a90e92dd0c8 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:11:58.165696 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ddd4e7f9205f42588c1b5a90e92dd0c8 Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiagnosticsNegativeTest-12176295-project Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c47e78df83f41e99ec8b6d0ca9c7a55 Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-12176295-project Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:11:58.168426 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': 'cf7cd088-bcc4-4361-9fac-789b2e57089f'} Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:11:58.169725 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:11:58.173210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:11:58.175571 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3435ff39-af9f-4091-91fc-a99a4a73198b tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.223690 Aug 30 18:11:58.177138 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 239/546] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:11:57 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f/diagnostics => generated 117 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:11:58.189840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0645fd-c385-4382-8b86-09b48861cccc", "tag": "a0271b93-c722-408b-a646-e45cd99449cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:11:58.224045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.224534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.224968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.276905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] Creating event network-changed:a0271b93-c722-408b-a646-e45cd99449cb for instance df0645fd-c385-4382-8b86-09b48861cccc on n-h2-854119-10 Aug 30 18:11:58.301934 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a2cec862-149f-4c7a-91b5-a9d5efb8587d req-30afa627-9c90-488b-a667-96678d6d36f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123323 Aug 30 18:11:58.312806 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 240/547] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:11:58.319228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71503ba6-dacc-484e-b739-b49a566351ce tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:58.319928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71503ba6-dacc-484e-b739-b49a566351ce tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:58.676240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71503ba6-dacc-484e-b739-b49a566351ce tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:58.689726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71503ba6-dacc-484e-b739-b49a566351ce tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1224 microversion: 2.1 time: 0.373261 Aug 30 18:11:58.691883 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 241/548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:58 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1224 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:58.699582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:58.700499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:58.708834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.709710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.710560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.720366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:58.721057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:58.722011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:58.773703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:11:59.028806 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-785d7aff-f55b-412d-8753-5eb026fa5406 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 204 len: 0 microversion: 2.1 time: 0.334099 Aug 30 18:11:59.035404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 242/549] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:11:58 2022] DELETE /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:11:59.056644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:59.057499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:59.084059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.086466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.087171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.088055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.092943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.097020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:11:59.105087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.117935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b023ca82-17d5-4017-b1e4-5c82d000a7d8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 200 len: 1707 microversion: 2.1 time: 1.084453 Aug 30 18:11:59.155761 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 308/550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:58 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 1707 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:11:59.180426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:11:59.187125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:11:59.215638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.219782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.220520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:11:59.222287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:11:59.223571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:11:59.227064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:00.038179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:00.051539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:00.067574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bac49770-b271-41a5-9eaa-b45a4fb41cf2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 1.029833 Aug 30 18:12:00.079066 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 243/551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:59 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:00.115141 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d608abe-e808-4bb2-9c02-15000f7a2628 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1479 microversion: 2.1 time: 0.955204 Aug 30 18:12:00.115952 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 309/552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:11:59 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1479 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:00.494603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-836a810b-ec61-45fd-9677-e56afead8c64 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] Calling method '.version_select at 0x7f4e571a5af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:00.555885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-836a810b-ec61-45fd-9677-e56afead8c64 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.435748 Aug 30 18:12:00.563492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 244/553] 10.222.0.25 () {60 vars in 1226 bytes} [Tue Aug 30 18:12:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:12:00.577056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1a0b53b-bc11-4d37-962f-00d9c8adb398 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] Action: 'create', calling method: .version_select at 0x7f4e5744b430>, body: {"security_group": {"name": "tempest-securitygroup-880133185", "description": "tempest-description-2143810430"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:00.585733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:00.586881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:00.626025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.627066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.627828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:00.633975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:00.638173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:00.640222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.257543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:01.275411 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c3fa30b-d8ba-4371-9709-0d739c96dd0d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1276 microversion: 2.1 time: 0.707629 Aug 30 18:12:01.276041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 245/554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:00 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1276 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:01.283533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c745e1-8abe-4a92-b2ab-0c93734e7503", "name": "network-vif-plugged", "status": "completed", "tag": "0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:01.305023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.308855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.309488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.341203 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] Creating event network-vif-plugged:0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8 for instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 on n-h1-854119-10 Aug 30 18:12:01.354487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-aea6521e-d3b1-4754-a49c-969bac963df8 req-82aa2981-3806-4b68-946a-e950086ce37a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075759 Aug 30 18:12:01.355733 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 246/555] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:01.362068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68750176-e998-457b-8b99-d2a8b0ee9f50 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] Action: 'update', calling method: .version_select at 0x7f4e571a5f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:01.460155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=73,nova_api:UPDATE=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:01.890887 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68750176-e998-457b-8b99-d2a8b0ee9f50 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.533612 Aug 30 18:12:01.892346 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 247/556] 10.222.0.25 () {62 vars in 1247 bytes} [Tue Aug 30 18:12:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:12:01.897544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:01.898785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:01.912246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.912897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.924837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:01.926328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:01.927098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:01.927795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.420801 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1a0b53b-bc11-4d37-962f-00d9c8adb398 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.293458 Aug 30 18:12:02.422509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 310/557] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:12:00 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:02.438196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:02.439413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:02.457949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.458872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.459668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.461002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.461870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.476754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.747338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:02.764706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6036a5d9-7d2f-410f-91d0-8a596262828a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1368 microversion: 2.1 time: 0.870770 Aug 30 18:12:02.765720 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 248/558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:01 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1368 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:02.788853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7125e1b-98f5-41de-946a-98c1fb6ef800 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] Calling method '.version_select at 0x7f4e572f98b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:02.812407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7125e1b-98f5-41de-946a-98c1fb6ef800 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027660 Aug 30 18:12:02.823551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 249/559] 10.222.0.25 () {60 vars in 1226 bytes} [Tue Aug 30 18:12:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:12:02.844600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:02.846073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:02.861483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.865755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.867311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:02.868924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:02.870325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:02.871367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:03.284870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:03.293103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecc8e901-f850-428f-a1d8-230245c5a31b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1282 microversion: 2.1 time: 0.457181 Aug 30 18:12:03.328404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 250/560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:02 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1282 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:03.338311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-972490f7-dc82-4db5-a8a3-a805ee9aaf75 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] Action: 'create', calling method: .version_select at 0x7f4e570a4d30>, body: {"security_group": {"name": "tempest-securitygroup-1908968599", "description": "tempest-description-313402256"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:03.663168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:03.687460 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8340a578-84fa-4b3e-9175-0e3e994dd6a1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1479 microversion: 2.1 time: 1.263395 Aug 30 18:12:03.703725 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 311/561] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:02 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1479 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:03.703725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f842a08e-b1d5-4531-81f2-b3212f0492f7 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] Action: 'update', calling method: .version_select at 0x7f4e57400940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:03.958106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f842a08e-b1d5-4531-81f2-b3212f0492f7 tempest-QuotaClassesAdmin257Test-1536005734 tempest-QuotaClassesAdmin257Test-1536005734-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.263143 Aug 30 18:12:03.960502 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 312/562] 10.222.0.25 () {62 vars in 1247 bytes} [Tue Aug 30 18:12:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:12:03.975161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:03.975547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:03.985556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:03.987819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:03.989461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:03.993021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:03.996055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:03.998286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:04.849324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:04.862297 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bc5071a-b4fe-4ff8-8aeb-9365063f45e2 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1554 microversion: 2.1 time: 0.896514 Aug 30 18:12:04.863341 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 313/563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:03 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1554 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:04.872091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7cd088-bcc4-4361-9fac-789b2e57089f", "name": "network-vif-deleted", "tag": "908865a9-5c0c-46de-a306-43ae8729d41a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:04.900431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:04.901622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:04.902332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:04.918368 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] Creating event network-vif-deleted:908865a9-5c0c-46de-a306-43ae8729d41a for instance cf7cd088-bcc4-4361-9fac-789b2e57089f on n-h2-854119-10 Aug 30 18:12:04.928619 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-eac38738-37a2-453c-ac44-a3756e96c2dd req-dc566617-b67c-4c12-9f47-b902804d7884 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063017 Aug 30 18:12:04.929930 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 314/564] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:04.942400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:04.943518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:04.953087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:04.954313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:04.955185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:04.956274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:04.957415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:04.964646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.059280 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-972490f7-dc82-4db5-a8a3-a805ee9aaf75 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.728498 Aug 30 18:12:05.062463 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 251/565] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:12:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:05.080578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:05.082787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:05.101832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.103212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.105763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.107066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.113794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.114694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.191138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:05.210434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.215090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.216403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.218910 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd41a2a3-deb4-4800-b24b-2610c7920594 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1282 microversion: 2.1 time: 0.282346 Aug 30 18:12:05.219334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lazy-loading 'fault' on Instance uuid cf7cd088-bcc4-4361-9fac-789b2e57089f {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:12:05.220301 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 315/566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:04 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:05.229237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:05.230076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:05.264198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.265142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.278684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.280360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:05.281234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:05.282020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:05.534289 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d0a2f31-8d32-451d-9ad5-6d0f49130e6e tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312094 Aug 30 18:12:05.543271 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 316/567] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:12:05 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:05.549686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c47e78df83f41e99ec8b6d0ca9c7a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd4e7f9205f42588c1b5a90e92dd0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:05.563451 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d46e7c15-3209-43c6-aa65-af4ab78fbe0e tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 200 len: 1313 microversion: 2.1 time: 0.498464 Aug 30 18:12:05.564223 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 252/568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:05 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:06.263573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:06.268233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:06.270853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb52ed7d-2cf8-443e-b2d3-56f60862bb61 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Action: 'create', calling method: .version_select at 0x7f4e5734bdc0>, body: {"security_group": {"name": "tempest-securitygroup-277225543", "description": "tempest-description-1941530276"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:06.286258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:06.287380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:06.288170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:06.289624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:06.290498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:06.291557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:07.077867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:07.091948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-22370e68-c861-4dc6-b5b7-f04808c5364c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.835097 Aug 30 18:12:07.102894 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 253/569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:06 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:07.120578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:07.121285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] [instance: cf7cd088-bcc4-4361-9fac-789b2e57089f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:07.129915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:07.130460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:07.130931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:07.131896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:07.132119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:07.143231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:07.170525 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] HTTP exception thrown: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Request method failure captured: Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f HTTP/1.1 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLCLUoJ1yfbAy03oY4Ds50Jgv-HO5XEZJ7iFaPlM5RENI1btESWxzKwuwcHEDcEf6URsc3n6iX-K-LwajXx7EwRgIRG1nslyFLzby_hxVe30UB0iU2YsfjgdCD9EtewfiKqeqRjKU_abH_QpNphAMtd3MxywVExv9yzCvZcPK3OMWI Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ddd4e7f9205f42588c1b5a90e92dd0c8 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:07.172690 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddd4e7f9205f42588c1b5a90e92dd0c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ddd4e7f9205f42588c1b5a90e92dd0c8 Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-12176295 Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiagnosticsNegativeTest-12176295-project Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c47e78df83f41e99ec8b6d0ca9c7a55 Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-12176295-project Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. Aug 30 18:12:07.174079 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'cf7cd088-bcc4-4361-9fac-789b2e57089f'} Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:07.174985 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. Aug 30 18:12:07.176101 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:07.179350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] Returning 404 to user: Instance cf7cd088-bcc4-4361-9fac-789b2e57089f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:07.180227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41c51442-9ad9-46b3-aaef-c1b1a8fe7fc1 tempest-ServerDiagnosticsNegativeTest-12176295 tempest-ServerDiagnosticsNegativeTest-12176295-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f" status: 404 len: 111 microversion: 2.1 time: 0.076188 Aug 30 18:12:07.180801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 254/570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:07 2022] GET /compute/v2.1/servers/cf7cd088-bcc4-4361-9fac-789b2e57089f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:12:07.570775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:07.892635 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb52ed7d-2cf8-443e-b2d3-56f60862bb61 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.354807 Aug 30 18:12:07.894028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 317/571] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:12:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:07.919606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7aaff571-9003-4eed-9567-644b9c587413 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Action: 'create', calling method: .version_select at 0x7f4e57089b80>, body: {"security_group": {"name": "tempest-securitygroup-772075526", "description": "tempest-description-1259899979"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:08.142120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:08.152618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:08.176662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.177169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.182454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.183367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:08.183854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:08.184293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:08.788930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:08.809438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95fa7441-5077-4c72-87a0-2061a2668858 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.694853 Aug 30 18:12:08.810830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 318/572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:08 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:09.641457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c745e1-8abe-4a92-b2ab-0c93734e7503", "tag": "0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:09.668010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:09.668505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:09.668943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:09.715820 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] Creating event network-changed:0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8 for instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 on n-h1-854119-10 Aug 30 18:12:09.739021 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0e79b848-8b0d-46b5-85c4-9792e8415221 req-62b1ea93-8572-40f0-b200-9b3dc6e884fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102140 Aug 30 18:12:09.740076 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 319/573] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:09.834203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:09.835815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:09.843912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:09.844726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:09.845397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:09.846315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:09.846970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:09.847602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:10.373810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:10.399281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ebca76d-6ff4-48ac-9c38-fd7695bfa5f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.570096 Aug 30 18:12:10.401160 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 320/574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:09 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:10.567704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7aaff571-9003-4eed-9567-644b9c587413 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.652973 Aug 30 18:12:10.575940 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 255/575] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:12:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:10.600354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Calling method '.version_select at 0x7f4e574a9670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:11.438427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:11.439495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:11.464546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:11.472459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:11.472723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:11.473501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:11.480135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:11.484684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:12.809793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:12.947342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:12.972659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9ae4ab7-f2ba-4294-ab84-8dbee501a42c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 1.541261 Aug 30 18:12:12.973580 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 256/576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:11 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:12.985312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee35143-2128-4f32-9513-d0a3dee51d87", "tag": "6a74a133-75bb-4419-a823-0b625f7746df"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:13.027159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:13.028020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:13.030451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:13.054469 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] Creating event network-changed:6a74a133-75bb-4419-a823-0b625f7746df for instance 2ee35143-2128-4f32-9513-d0a3dee51d87 on n-h1-854119-10 Aug 30 18:12:13.068455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-deab6860-c17b-4c5a-8693-4a7a23f8bc4e req-bc14ccb9-f436-49fc-ad98-dac742bb19a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090007 Aug 30 18:12:13.070270 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 257/577] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:13.941188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:14.005104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:14.006392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:14.045803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:14.053735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:14.063681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:14.068794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:14.071903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:14.073230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:14.303230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c13a7c18-b412-4296-b4d0-fdd4e155cad3 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:12:14.304821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Neutron security group c13a7c18-b412-4296-b4d0-fdd4e155cad3 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:12:14.305972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.security_groups [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Security Group ID c13a7c18-b412-4296-b4d0-fdd4e155cad3 does not exist {{(pid=122589) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 30 18:12:14.379493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c13a7c18-b412-4296-b4d0-fdd4e155cad3 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:12:14.380615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Neutron security group c13a7c18-b412-4296-b4d0-fdd4e155cad3 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:12:14.381394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.security_groups [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Security Group ID c13a7c18-b412-4296-b4d0-fdd4e155cad3 does not exist {{(pid=122589) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 30 18:12:14.720552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:14.750425 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76804a28-2ad0-4f75-bc35-6a682de0ff4e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.753086 Aug 30 18:12:14.753931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 258/578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:13 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:15.957919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:15.965964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:15.977944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:15.981292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:15.984478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:15.987073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:15.992241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.109299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d34e97f6-4d53-43ea-815d-bf1c9794f7cb tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.670102 Aug 30 18:12:16.112211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 259/579] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:12:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:16.140345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:16.142092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:16.163495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.163996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.164439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.165157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.165621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.166032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.331699 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1bbec5c9-4074-4c9d-817b-afad92b6b323 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11160 microversion: 2.1 time: 5.738029 Aug 30 18:12:16.333230 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 321/580] 10.222.0.25 () {58 vars in 1191 bytes} [Tue Aug 30 18:12:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11160 bytes in 5742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:12:16.354005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:16.371946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.374270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.375650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.377343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.378754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.379727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.414710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=78,nova_api:UPDATE=7 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:16.447008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff4b7742-403c-43b5-b05e-2a074599af90 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.111387 Aug 30 18:12:16.455914 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 322/581] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:12:16 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:16.518285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d9a0c66-6556-4748-9ea4-4277e3c1aca0 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] Calling method '.version_select at 0x7f4e574fc9d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:16.773946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:16.801847 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cf238c9e-628d-453b-8f24-06faaa71754b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.675967 Aug 30 18:12:16.826623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 260/582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:16 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:16.862801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:16.872177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.883592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.884795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:16.887857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:16.890235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:16.895472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:17.004920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-179ad45b-5b85-4c26-a254-bcb4ff358849 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.176171 Aug 30 18:12:17.016150 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 261/583] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:12:16 2022] GET /compute/v2.1/os-services => generated 949 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:17.305757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1344663248", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "743afca4-b9ea-4dd3-9212-5be5116e6bbf"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:17.415556 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d9a0c66-6556-4748-9ea4-4277e3c1aca0 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.954698 Aug 30 18:12:17.416356 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 323/584] 10.222.0.25 () {58 vars in 1191 bytes} [Tue Aug 30 18:12:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:17.433944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:17.442830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:17.454434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:17.455087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:17.455946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:17.459269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:17.459872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:17.481974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] validate_networks() for [('743afca4-b9ea-4dd3-9212-5be5116e6bbf', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:17.517970 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fdaddc0e-3ced-476e-abbc-964822aa8b17 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-854119-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.098462 Aug 30 18:12:17.529615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 324/585] 10.222.0.25 () {58 vars in 1196 bytes} [Tue Aug 30 18:12:17 2022] GET /compute/v2.1/os-services?host=n-d-854119-10&binary=xxx => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:12:17.537855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fecf7aab-260c-4079-b2fc-de843c053bd5 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Calling method '.version_select at 0x7f4e57819160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:18.373917 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fecf7aab-260c-4079-b2fc-de843c053bd5 tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5a8c2bf9-7b4b-4b32-9ed7-16176e9cd87c" status: 202 len: 0 microversion: 2.1 time: 0.842819 Aug 30 18:12:18.378122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 325/586] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:12:17 2022] DELETE /compute/v2.1/os-security-groups/5a8c2bf9-7b4b-4b32-9ed7-16176e9cd87c => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:12:18.386482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:18.390992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.403234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.404489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.405636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.406120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.406591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.429984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:18.430589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:18.430900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:18.431307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:18.431727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:18.454281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.455122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.455770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.457061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.457742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.458394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.477463 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f57559e-5ca1-4fc6-a521-0f5376246ba0 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.101393 Aug 30 18:12:18.489757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 326/587] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:12:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:18.494855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:18.495478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:18.512357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.526003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Getting quotas for project 954ea457e2944682bb2c5cd324dbbaf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:18.526826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.527629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.528819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.529678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.531179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:18.541112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Getting quotas for user d36bacd1987c4cfe960a8bb71e4931f6 and project 954ea457e2944682bb2c5cd324dbbaf6. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:18.574322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Going to run 3 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:18.577167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:18.651929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=147f0d87-0e99-4ff4-b460-91a1ec4884b5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:18.735571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=4f55551b-c118-4844-b868-95b16d9b1918,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:18.884629 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abfb520c-dfdb-4d21-83b3-c1e1ac120847 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.865117 Aug 30 18:12:18.886091 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 262/588] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:18.894512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea2418f8-1983-4edc-9b05-6ed945a42c7a tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] Calling method '.version_select at 0x7f4e570cc550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:18.958950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:18.971861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65075056-43c2-4978-9d63-8c41ac43c91f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.480783 Aug 30 18:12:18.972879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 327/589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:18 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:18.978460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:18.989479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:18.994094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:18.994991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.010747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.011414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.011862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.103383 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84625d56-2c3e-49ab-b34d-9fa0668d54f6 tempest-ServicesAdminNegativeTestJSON-607158469 tempest-ServicesAdminNegativeTestJSON-607158469-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.129071 Aug 30 18:12:19.129129 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 328/590] 10.222.0.25 () {58 vars in 1198 bytes} [Tue Aug 30 18:12:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:12:19.140959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:19.152685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:19.154935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:12:19.194779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.195756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.196378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.197333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:19.197960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:19.198587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:19.413474 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea2418f8-1983-4edc-9b05-6ed945a42c7a tempest-SecurityGroupsTestAdminJSON-741087966 tempest-SecurityGroupsTestAdminJSON-741087966-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1aef0448-05cc-44cb-a399-8dcb5bad0943" status: 202 len: 0 microversion: 2.1 time: 0.525340 Aug 30 18:12:19.414854 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 263/591] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:12:18 2022] DELETE /compute/v2.1/os-security-groups/1aef0448-05cc-44cb-a399-8dcb5bad0943 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:12:19.420488 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0743f45-e95d-499b-b197-bc18efb60cd3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.289449 Aug 30 18:12:19.428700 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 329/592] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:12:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:19.433824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee205c15-d163-44a7-bdf8-9a2c45f78c50 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] Calling method '.version_select at 0x7f4e5737f310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:20.083371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77ad61ee-bde8-40c6-8fc1-1e1337c3fa80 tempest-ServicesAdminNegativeTestJSON-737728522 tempest-ServicesAdminNegativeTestJSON-737728522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:20.097955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77ad61ee-bde8-40c6-8fc1-1e1337c3fa80 tempest-ServicesAdminNegativeTestJSON-737728522 tempest-ServicesAdminNegativeTestJSON-737728522-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e0b2fa47f5c94eb3b80cd74d22e78f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba49bc531a064b9faeb336d5ff6741b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77ad61ee-bde8-40c6-8fc1-1e1337c3fa80 tempest-ServicesAdminNegativeTestJSON-737728522 tempest-ServicesAdminNegativeTestJSON-737728522-project] Request method failure captured: Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlL9sVYRytC3m1LnFT13fIoQ6boU0IfrrH34rxtXywBKzlMhMI3PtHI_aU1HvJqLbJ2mTlLD2910mjIRaYIRsD7lXCaDnuCnDncqDQ4tlx5fWXAuWbSupl0VKxvZsIeHeLt9_sF1psBmr3DqeuE1h3x7dHPchVYkCz-3ObEt0Y3pYis Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba49bc531a064b9faeb336d5ff6741b5 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-737728522 Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:20.144021 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba49bc531a064b9faeb336d5ff6741b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba49bc531a064b9faeb336d5ff6741b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba49bc531a064b9faeb336d5ff6741b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba49bc531a064b9faeb336d5ff6741b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-737728522 Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba49bc531a064b9faeb336d5ff6741b5 Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-737728522 Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServicesAdminNegativeTestJSON-737728522-project Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e0b2fa47f5c94eb3b80cd74d22e78f10 Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-737728522-project Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:12:20.147134 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:12:20.148804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:12:20.157524 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:20.163909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77ad61ee-bde8-40c6-8fc1-1e1337c3fa80 tempest-ServicesAdminNegativeTestJSON-737728522 tempest-ServicesAdminNegativeTestJSON-737728522-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:20.163909 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77ad61ee-bde8-40c6-8fc1-1e1337c3fa80 tempest-ServicesAdminNegativeTestJSON-737728522 tempest-ServicesAdminNegativeTestJSON-737728522-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.731693 Aug 30 18:12:20.163909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 264/593] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:12:19 2022] GET /compute/v2.1/os-services => generated 112 bytes in 734 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:12:20.163909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-879b2710-ddec-4e6e-a969-6af889f6a189 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:20.174496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-879b2710-ddec-4e6e-a969-6af889f6a189 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:20.398167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-879b2710-ddec-4e6e-a969-6af889f6a189 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:20.409707 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-879b2710-ddec-4e6e-a969-6af889f6a189 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1223 microversion: 2.1 time: 0.259418 Aug 30 18:12:20.420712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 265/594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:20 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1223 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:20.431777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:20.433469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:20.464654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:20.472841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:20.474643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:20.476473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:20.478564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:20.483582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:21.000768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:21.020233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3fe5449-7d86-4685-8a7f-01a6d984fb82 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.605404 Aug 30 18:12:21.023642 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 266/595] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:20 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:21.150819 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee205c15-d163-44a7-bdf8-9a2c45f78c50 tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/88e801a6-8abf-4b3c-b27f-bedef7d87ee1" status: 202 len: 0 microversion: 2.1 time: 1.720646 Aug 30 18:12:21.156633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 330/596] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:12:19 2022] DELETE /compute/v2.1/os-security-groups/88e801a6-8abf-4b3c-b27f-bedef7d87ee1 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:12:21.161268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f5a43d7-e5c9-410d-8e6e-c6cadaae6d1a tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] Calling method '.version_select at 0x7f4e570ccf70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:21.441505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8399a2d9-3af7-4b5e-acc0-6709c9ef7bdc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:21.446851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8399a2d9-3af7-4b5e-acc0-6709c9ef7bdc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:21.750419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8399a2d9-3af7-4b5e-acc0-6709c9ef7bdc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:21.776125 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8399a2d9-3af7-4b5e-acc0-6709c9ef7bdc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1223 microversion: 2.1 time: 0.344441 Aug 30 18:12:21.780604 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 331/597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:21 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1223 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:22.044669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:22.045298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:22.071364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.078917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.085163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:22.086655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.087514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.088283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:22.239794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f5a43d7-e5c9-410d-8e6e-c6cadaae6d1a tempest-SecurityGroupsTestAdminJSON-1250961972 tempest-SecurityGroupsTestAdminJSON-1250961972-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/3f5bf054-9479-4be5-b512-f0a72cd4ca52" status: 202 len: 0 microversion: 2.1 time: 1.082378 Aug 30 18:12:22.241653 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 267/598] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:12:21 2022] DELETE /compute/v2.1/os-security-groups/3f5bf054-9479-4be5-b512-f0a72cd4ca52 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:12:22.904629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:22.930252 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38061df1-e57f-4f17-ab56-e008d991bdd8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.889222 Aug 30 18:12:22.935184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 332/599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:22 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:22.955647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:22.956877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:22.988440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.989623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.990400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:22.992429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:22.993493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:22.994232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:23.309351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-962479084", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "2a276390-21e3-480e-8639-5bd55ca03773"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:23.325743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:23.332508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=85 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:23.356125 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e0e2f9d-670f-4834-bf08-05ad4a6df56a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1275 microversion: 2.1 time: 0.418888 Aug 30 18:12:23.359689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 333/600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:22 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:23.518810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] validate_networks() for [('2a276390-21e3-480e-8639-5bd55ca03773', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:23.983144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:23.986780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:24.011593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.017813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.019198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:24.020844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.023770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.026898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:24.593064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:24.628468 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe95ddc4-5239-46ba-961a-7ca1a0d8892d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.651024 Aug 30 18:12:24.635926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 334/601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:23 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:12:24.648671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:24.659660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:24.684011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.690304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.692091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:24.693800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:24.695031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:24.698758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.209856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:25.272933 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-52030921-9001-4082-8870-aaa0dcf1f358 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1281 microversion: 2.1 time: 0.634454 Aug 30 18:12:25.292035 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 335/602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:24 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1281 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:25.327043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:25.330963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:25.359819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.363321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.365549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.369572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.373916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.375296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.466875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:12:25.724844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4188115c-1b6e-4c44-8801-bcf5a3f1eb46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 204 len: 0 microversion: 2.1 time: 0.416708 Aug 30 18:12:25.731123 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 336/603] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:25 2022] DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:25.763396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee35143-2128-4f32-9513-d0a3dee51d87", "name": "network-vif-plugged", "status": "completed", "tag": "6a74a133-75bb-4419-a823-0b625f7746df"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:25.789148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.789669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.790024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.817352 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] Creating event network-vif-plugged:6a74a133-75bb-4419-a823-0b625f7746df for instance 2ee35143-2128-4f32-9513-d0a3dee51d87 on n-h1-854119-10 Aug 30 18:12:25.826771 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-73ddc004-f33a-461b-b9b7-ecd69b2c1924 req-3d0591f2-4a36-4da6-87dc-77ac2d46813d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089566 Aug 30 18:12:25.827763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 337/604] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:25.849135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:25.849135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:25.879823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.880323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.881235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:25.882188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:25.884914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:25.885593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:26.502054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:26.527673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:26.529309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:26.530528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:26.531478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:26.532391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:26.537713 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57b7822a-8207-42c6-a9e2-092b577e461b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1324 microversion: 2.1 time: 0.708323 Aug 30 18:12:26.544904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 338/605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:25 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:26.565336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:26.570536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1307870217", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "840514432", "adminPass": "***", "networks": [{"uuid": "69cb7ba0-dd7c-453c-91e6-5d1017a55f5e"}], "security_groups": [{"name": "tempest-securitygroup--1560496100"}], "key_name": "tempest-keypair-1483351753", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:26.572423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:26.575926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:26.584217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:26.585709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:26.590470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:26.675677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:26.699975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=6,nova_api:INSERT=15 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:26.705746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for user 6774c9dbc6b44018a09893dabeee643a and project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:26.778980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:26.787379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:26.991362 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a4fe9bf-ac04-405c-8fb8-1ddcad855b31 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.408072 Aug 30 18:12:26.992775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 268/606] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4410 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:12:27.012341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:27.017284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:27.041242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:27.042493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:27.047447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:27.051127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:27.054883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:27.056037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:27.161191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:27.460867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] validate_networks() for [('69cb7ba0-dd7c-453c-91e6-5d1017a55f5e', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:28.292587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:28.310932 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdb30ce7-93c6-4534-bc41-b19bed54383f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1281 microversion: 2.1 time: 1.316080 Aug 30 18:12:28.311462 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 269/607] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:26 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1281 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:28.316506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:28.317114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:28.622039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:28.631008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:28.647535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:28.658697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2033f86-a46d-42e4-8edc-8706bddcf127 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1261 microversion: 2.25 time: 0.344685 Aug 30 18:12:28.691919 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 270/608] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:28 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1261 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:29.270046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:29.772700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1134872339", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:29.941181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:30.581548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:30.583851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:30.585303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:30.586461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:30.587990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:30.627595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.628791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.629830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.633873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.636609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.638088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.707879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:30.719403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Getting quotas for user bb87eded75e64169b15feb9cab2eec4b and project 43d8b8f4da3840bf9e7c463a785bb6a4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:30.770849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:30.773946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:30.859682 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e60a9eb-4b51-4b8b-a1bf-c8ddd0c71ac0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.313180 Aug 30 18:12:30.870482 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 339/609] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 4315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:30.870482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:30.870482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:30.880176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.880593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.881043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:30.887251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:30.887817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:30.888352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.093197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:31.093917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:31.094780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:31.096364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:31.097026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:31.140698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.141671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.146469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.148358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.149453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.152738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.255014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:31.278777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for user 04f1cc0e60b04c5e9f3c3df65999a433 and project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:31.328290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:31.338020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:31.504620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:31.517699 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99f57f96-bd1b-4b5f-9dd0-62094d2477fd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.655825 Aug 30 18:12:31.520057 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 340/610] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:30 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:31.531881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74c7e3ea-4af9-4e56-b75f-c9fdd1216f14 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.831364 Aug 30 18:12:31.532111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:31.532599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 271/611] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:31.533666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:31.545697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.550448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:31.551336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.551923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.552094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:31.553239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.553830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.554826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.577539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.580388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.591446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:31.601247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:31.602085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:31.603710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.085249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.127761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.130959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.143800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f84672f9-75b2-4bec-af48-feec1892b5ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1319 microversion: 2.25 time: 0.597926 Aug 30 18:12:32.144903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 272/612] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:31 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:32.170547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:32.171736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:32.195751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:32.213219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:32.214003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.215365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:32.243452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:32.246406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.694051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.704943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:32.722400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e88966f9-fce5-4fe7-8385-d83ab8bef0a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 1.200542 Aug 30 18:12:32.726715 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 341/613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:31 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:32.736340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:32.742794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:32.767361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:32.768149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:32.768674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.769477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:32.769951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:32.770577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:32.797394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9efe46b-f7fc-4767-950e-1308b21ccddd tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1267 microversion: 2.1 time: 0.641958 Aug 30 18:12:32.804256 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 273/614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:32 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1267 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:33.660634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-475511481", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:33.736917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:33.749529 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-695d817f-ae8a-4a47-8a10-0356e1df4ea8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 1.021611 Aug 30 18:12:33.750564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 342/615] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:32 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:33.759596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1215338583", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:33.781457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:33.952252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:34.711699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:34.713976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:34.715221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:34.721214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:34.722060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:34.759735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.760655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.761404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.762866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:34.763670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:34.764770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:34.805088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:34.819385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for user 04f1cc0e60b04c5e9f3c3df65999a433 and project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:34.861985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:34.865105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:34.985530 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d864a70-8490-4e73-8e08-659211e7fe47 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233628 Aug 30 18:12:34.987005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 343/616] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:34.992591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0645fd-c385-4382-8b86-09b48861cccc", "name": "network-vif-deleted", "tag": "a0271b93-c722-408b-a646-e45cd99449cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:35.006191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.007200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.008148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.034630 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] Creating event network-vif-deleted:a0271b93-c722-408b-a646-e45cd99449cb for instance df0645fd-c385-4382-8b86-09b48861cccc on n-h2-854119-10 Aug 30 18:12:35.044354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-772758fe-668f-4d03-b3f3-42949e426064 req-1c998dd4-9a71-41da-84e6-00586ee7d4c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054412 Aug 30 18:12:35.046101 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 344/617] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:35.054642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:35.055587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:35.065352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.069745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.070551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.071438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.072036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.072865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.592720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:35.622704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:35.632824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:35.634893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9fc6196c-68d6-4f9a-aa42-ec4167dad9fc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.586489 Aug 30 18:12:35.635940 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 345/618] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:35 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:35.673897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:35.676794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:35.705014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.715583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.716404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:35.717771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:35.718634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:35.725368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.255107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:12:36.259364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:12:36.260328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:12:36.261396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:12:36.262040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:12:36.282007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.283178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.284145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.285664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.286683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.287665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.329254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Getting quotas for project ab49ebea7cba46b39ce1d1645e03510d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:36.345473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Getting quotas for user b8a477f203e64612a8c6edd6b84df009 and project ab49ebea7cba46b39ce1d1645e03510d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:36.379972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:12:36.385490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:12:36.500866 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2686fe73-73be-4f6b-8785-c1a24c5751e2 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.691741 Aug 30 18:12:36.504188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 274/619] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:12:36.528501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8eecf9b8-cc87-403a-bb1a-166c3db40214 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1879967699", "metadata": {"": ""}}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8eecf9b8-cc87-403a-bb1a-166c3db40214 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action HTTP/1.1 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 107 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:36.548406 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1879967699", "metadata": {"": ""}}} Aug 30 18:12:36.549754 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1879967699', 'metadata': {'': ''}}}} Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'': ''} Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:36.550529 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.551784 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:36.553317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8eecf9b8-cc87-403a-bb1a-166c3db40214 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:36.553764 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8eecf9b8-cc87-403a-bb1a-166c3db40214 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action" status: 400 len: 170 microversion: 2.1 time: 0.045281 Aug 30 18:12:36.558269 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 275/620] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Aug 30 18:12:36 2022] POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action => generated 170 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:12:36.583071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:36.584346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:36.611031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.612172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.613250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.615113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:36.621944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:36.623884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:36.817125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:36.844748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36947c67-14a4-48d0-bd48-e2ea922d3d1e tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 1.184626 Aug 30 18:12:36.850773 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 346/621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:35 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:37.110882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6de82ccf-f30d-4d33-8fda-4c53bd661c9d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.250105 Aug 30 18:12:37.116152 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 347/622] 10.222.0.25 () {58 vars in 1128 bytes} [Tue Aug 30 18:12:36 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 18:12:37.130130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:37.131937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:37.141184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.141870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.142513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.143926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.144589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.145201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.339639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:37.373232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98f04c4b-d9a4-4b2f-a67f-6077deef5cce tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1266 microversion: 2.1 time: 0.255149 Aug 30 18:12:37.374334 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 348/623] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:37 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:37.386820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-587e805c-fb64-4f96-9830-83b0ffd4d4fa tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:37.388482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-587e805c-fb64-4f96-9830-83b0ffd4d4fa tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:37.426019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:37.461922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1da73294-828f-49d3-b25e-f3b820b1acd1 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1321 microversion: 2.1 time: 0.900018 Aug 30 18:12:37.469194 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 276/624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:36 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1321 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:37.507126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:37.508346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:37.521410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-587e805c-fb64-4f96-9830-83b0ffd4d4fa tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:37.536117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.538699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.539772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.541623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.542154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.547410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.553925 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-587e805c-fb64-4f96-9830-83b0ffd4d4fa tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1213 microversion: 2.1 time: 0.174525 Aug 30 18:12:37.555270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 349/625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:37 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:37.570208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:37.577308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:37.603632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.604937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.605725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:37.607713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:37.608672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:37.609520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.097906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.136299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.140811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.145086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ffb886f9-7157-439c-8a0c-54a9d414ce04 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.586154 Aug 30 18:12:38.148229 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 350/626] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:37 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:38.163571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147f0d87-0e99-4ff4-b460-91a1ec4884b5", "tag": "fa58c4d0-0218-489d-a4c1-443c0e2b760c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:38.186518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.187673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.188447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.227034 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] Creating event network-changed:fa58c4d0-0218-489d-a4c1-443c0e2b760c for instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 on n-h2-854119-10 Aug 30 18:12:38.234504 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b284763f-0415-48c2-bacb-f8089808c171 req-78753d7f-6625-41ce-9e82-0031ec62e320 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082015 Aug 30 18:12:38.236059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 351/627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:38.245676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c23e378-ead0-4338-ba6c-7926f6e2ddfb tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Calling method '.version_select at 0x7f4e57400ca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:38.286147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:38.303874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-518d7a57-3319-4142-a2be-260247e52f52 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.833026 Aug 30 18:12:38.304640 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 277/628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:37 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:38.310407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f55551b-c118-4844-b868-95b16d9b1918", "tag": "c0c0be00-b48f-4bf6-82f4-2dc3d99936bd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:38.339349 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6c23e378-ead0-4338-ba6c-7926f6e2ddfb tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] HTTP exception thrown: Image not found. Aug 30 18:12:38.341974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.342383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.342823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.362408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] Creating event network-changed:c0c0be00-b48f-4bf6-82f4-2dc3d99936bd for instance 4f55551b-c118-4844-b868-95b16d9b1918 on n-h2-854119-10 Aug 30 18:12:38.374499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-54c6c7f4-fb5f-4de4-8013-26287cbbc56b req-a03f4224-1ce6-41fb-b115-9220d138dc10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068081 Aug 30 18:12:38.377125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 278/629] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c23e378-ead0-4338-ba6c-7926f6e2ddfb tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Request method failure captured: Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMS9g1Z_fjOJuVrft7KqYKW2ZeruAhDlcXNoBoRKDJ_5o23rVdMg-ETjH9ltQOYneZvM8NLfAumamz6dBdnqi-jR4H7rS1vbX02cv3k-_UccuskK93gpQ7ZCfgEFu034hUzOE9aNt1eLt4XNdGKlsUYHhGERYl5qBmNtxWF_JRhVeM Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:12:38.383657 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b056be7e1d424ae098b7cca6ef7467a3 Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '-1'} Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:38.385143 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.386150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:38.387843 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c23e378-ead0-4338-ba6c-7926f6e2ddfb tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c23e378-ead0-4338-ba6c-7926f6e2ddfb tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.147048 Aug 30 18:12:38.389707 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 352/630] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 18:12:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:38.402851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:38.404729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:38.420520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.424141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.430758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.433060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.433753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.434464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.435174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:38.438989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:38.454236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:38.488186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.492584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.493953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:38.496425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:38.497638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:38.509821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.172506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.192013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-425ea4c5-16c0-4ed8-a106-9f3a0d5c1283 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.801449 Aug 30 18:12:39.193185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 353/631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:38 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:39.219087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.220209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.232798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.235824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.240160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.241201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.241963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.244339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.273037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.309713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-088a98a5-6694-4234-924b-63aa0abdf130 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 0.930501 Aug 30 18:12:39.314163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 279/632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:38 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:39.327671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-232966c9-430f-417d-bdb0-faa475f420df tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Calling method '.version_select at 0x7f4e571a5820>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.391986 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-232966c9-430f-417d-bdb0-faa475f420df tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] HTTP exception thrown: Image not found. Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-232966c9-430f-417d-bdb0-faa475f420df tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Request method failure captured: Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/70f4c9c7-e454-4fde-b720-55b5caaa97fj HTTP/1.1 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMS9g1Z_fjOJuVrft7KqYKW2ZeruAhDlcXNoBoRKDJ_5o23rVdMg-ETjH9ltQOYneZvM8NLfAumamz6dBdnqi-jR4H7rS1vbX02cv3k-_UccuskK93gpQ7ZCfgEFu034hUzOE9aNt1eLt4XNdGKlsUYHhGERYl5qBmNtxWF_JRhVeM Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:39.401895 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b056be7e1d424ae098b7cca6ef7467a3 Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '70f4c9c7-e454-4fde-b720-55b5caaa97fj'} Aug 30 18:12:39.404986 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70f4c9c7-e454-4fde-b720-55b5caaa97fj to delete Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:39.406735 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70f4c9c7-e454-4fde-b720-55b5caaa97fj could not be found. Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:39.409327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:12:39.417228 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:39.419912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-232966c9-430f-417d-bdb0-faa475f420df tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:39.420873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-232966c9-430f-417d-bdb0-faa475f420df tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/70f4c9c7-e454-4fde-b720-55b5caaa97fj" status: 404 len: 62 microversion: 2.1 time: 0.104930 Aug 30 18:12:39.421474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 280/633] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] DELETE /compute/v2.1/images/70f4c9c7-e454-4fde-b720-55b5caaa97fj => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:39.436981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.439547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.458829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.460363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.462370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.464883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.468217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.469403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.516073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.535569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5f63e3d-7ba3-44fe-b706-25e1e608db44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1272 microversion: 2.1 time: 0.325367 Aug 30 18:12:39.547219 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 354/634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:39.552396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.553347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.571594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.572374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.573038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.573981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.574671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.575562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.581054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:39.766565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:39.808718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e6f5727-9d7d-466b-a479-cf0b6b08ffa5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1271 microversion: 2.1 time: 0.259057 Aug 30 18:12:39.810537 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 355/635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:39.822248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:39.823921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:39.836065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.838418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.839871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:39.842831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:39.844094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:39.845164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.076858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:40.103233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a4af92f-175e-4940-824f-c43c98262356 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1321 microversion: 2.1 time: 0.680392 Aug 30 18:12:40.105109 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 281/636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1321 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:40.125221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3b1788e-4547-4fd7-a188-19167777fc1c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1606367879", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3b1788e-4547-4fd7-a188-19167777fc1c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action HTTP/1.1 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 619 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:40.136097 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:40.139195 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:12:40.140280 n-d-854119-10 devstack@n-api.service[122590]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1606367879", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 30 18:12:40.140280 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:12:40.140280 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1606367879', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 18:12:40.140670 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:40.143687 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.148330 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:12:40.152802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.155322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3b1788e-4547-4fd7-a188-19167777fc1c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:40.156781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3b1788e-4547-4fd7-a188-19167777fc1c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action" status: 400 len: 938 microversion: 2.1 time: 0.048684 Aug 30 18:12:40.158032 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 282/637] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Aug 30 18:12:40 2022] POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action => generated 938 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:12:40.173496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f66d9ccc-5a23-43fc-a9f0-ad1effd5bff6 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Calling method '.version_select at 0x7f4e570c59d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:40.209492 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f66d9ccc-5a23-43fc-a9f0-ad1effd5bff6 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] HTTP exception thrown: Image not found. Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f66d9ccc-5a23-43fc-a9f0-ad1effd5bff6 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Request method failure captured: Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/ef72382d-c70f-44e6-93bf-8ed95424034e1 HTTP/1.1 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMS9g1Z_fjOJuVrft7KqYKW2ZeruAhDlcXNoBoRKDJ_5o23rVdMg-ETjH9ltQOYneZvM8NLfAumamz6dBdnqi-jR4H7rS1vbX02cv3k-_UccuskK93gpQ7ZCfgEFu034hUzOE9aNt1eLt4XNdGKlsUYHhGERYl5qBmNtxWF_JRhVeM Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:40.215297 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b056be7e1d424ae098b7cca6ef7467a3 Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ef72382d-c70f-44e6-93bf-8ed95424034e1'} Aug 30 18:12:40.217493 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef72382d-c70f-44e6-93bf-8ed95424034e1 to delete Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.220222 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef72382d-c70f-44e6-93bf-8ed95424034e1 could not be found. Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:40.222616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f66d9ccc-5a23-43fc-a9f0-ad1effd5bff6 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:40.224940 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f66d9ccc-5a23-43fc-a9f0-ad1effd5bff6 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/ef72382d-c70f-44e6-93bf-8ed95424034e1" status: 404 len: 62 microversion: 2.1 time: 0.060489 Aug 30 18:12:40.233691 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 283/638] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:40 2022] DELETE /compute/v2.1/images/ef72382d-c70f-44e6-93bf-8ed95424034e1 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:40.238425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:40.239381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:40.273690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.274194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.274680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.275431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.275900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.276336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.342880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:40.360963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:40.362746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:40.363991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5bf52bb-d2fe-45b5-b885-258503063213 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.551428 Aug 30 18:12:40.364571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 356/639] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:39 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:40.369883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1199071-2c23-4538-bbee-aacc4166b88d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Calling method '.version_select at 0x7f4e572ffa60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:40.414302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e1199071-2c23-4538-bbee-aacc4166b88d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] HTTP exception thrown: Image not found. Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1199071-2c23-4538-bbee-aacc4166b88d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Request method failure captured: Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/tempest-invalid-1788277755 HTTP/1.1 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMS9g1Z_fjOJuVrft7KqYKW2ZeruAhDlcXNoBoRKDJ_5o23rVdMg-ETjH9ltQOYneZvM8NLfAumamz6dBdnqi-jR4H7rS1vbX02cv3k-_UccuskK93gpQ7ZCfgEFu034hUzOE9aNt1eLt4XNdGKlsUYHhGERYl5qBmNtxWF_JRhVeM Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:12:40.416314 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b056be7e1d424ae098b7cca6ef7467a3 Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'tempest-invalid-1788277755'} Aug 30 18:12:40.417829 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1788277755 to delete Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.418726 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1788277755 could not be found. Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:40.419853 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1199071-2c23-4538-bbee-aacc4166b88d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:40.421100 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1199071-2c23-4538-bbee-aacc4166b88d tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-1788277755" status: 404 len: 62 microversion: 2.1 time: 0.052060 Aug 30 18:12:40.424555 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 357/640] 10.222.0.25 () {58 vars in 1206 bytes} [Tue Aug 30 18:12:40 2022] DELETE /compute/v2.1/images/tempest-invalid-1788277755 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:40.440730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd77523-d660-421c-8e81-c8111d0cf124", "tag": "79b3e363-4327-4433-b3d8-bc0fdaa244c0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:40.474653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.475250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.475903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.498753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] Creating event network-changed:79b3e363-4327-4433-b3d8-bc0fdaa244c0 for instance ffd77523-d660-421c-8e81-c8111d0cf124 on n-h1-854119-10 Aug 30 18:12:40.506980 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-faa88f1f-641f-4eb4-99b9-eea67daaae8b req-e5b48440-fba1-4441-aa7a-7c5facfac4e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086586 Aug 30 18:12:40.507742 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 358/641] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:40.516977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:40.518277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:40.545330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.546589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.547255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:40.553184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:40.554179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:40.554866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.267721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:41.292699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e19c752-e31c-4582-93ab-e1236c643ada tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 1.062756 Aug 30 18:12:41.293644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 284/642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:40 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:41.299981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:41.335712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.337404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.338177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.375881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] Creating event network-changed:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:12:41.396262 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-da7ef4e2-d57f-435c-a5f6-64d3d7ed239a req-fa267007-6d8a-41d6-a52e-f5f17540d997 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099941 Aug 30 18:12:41.399940 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 285/643] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:41.421779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bb446a1-0326-470e-a037-bea764a12172 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Calling method '.version_select at 0x7f4e570d8160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:41.468511 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-6bb446a1-0326-470e-a037-bea764a12172 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] HTTP exception thrown: Image not found. Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bb446a1-0326-470e-a037-bea764a12172 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Request method failure captured: Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/a5c38ea3-e6ca-4c2c-b812-8cb325d8849a HTTP/1.1 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMS9g1Z_fjOJuVrft7KqYKW2ZeruAhDlcXNoBoRKDJ_5o23rVdMg-ETjH9ltQOYneZvM8NLfAumamz6dBdnqi-jR4H7rS1vbX02cv3k-_UccuskK93gpQ7ZCfgEFu034hUzOE9aNt1eLt4XNdGKlsUYHhGERYl5qBmNtxWF_JRhVeM Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:12:41.470726 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eba25bee784c49ab817080cc5e0b0646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eba25bee784c49ab817080cc5e0b0646 Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302 Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b056be7e1d424ae098b7cca6ef7467a3 Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1211355302-project Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'a5c38ea3-e6ca-4c2c-b812-8cb325d8849a'} Aug 30 18:12:41.472260 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a5c38ea3-e6ca-4c2c-b812-8cb325d8849a to delete Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:41.473219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5c38ea3-e6ca-4c2c-b812-8cb325d8849a could not be found. Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:41.475050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:12:41.476366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:12:41.479579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bb446a1-0326-470e-a037-bea764a12172 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:41.480024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6bb446a1-0326-470e-a037-bea764a12172 tempest-ImagesDeleteNegativeTestJSON-1211355302 tempest-ImagesDeleteNegativeTestJSON-1211355302-project] 10.222.0.25 "DELETE /compute/v2.1/images/a5c38ea3-e6ca-4c2c-b812-8cb325d8849a" status: 404 len: 62 microversion: 2.1 time: 0.071860 Aug 30 18:12:41.481143 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 286/644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:41 2022] DELETE /compute/v2.1/images/a5c38ea3-e6ca-4c2c-b812-8cb325d8849a => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:41.496422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:41.498954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:41.547018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.547934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.555599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.560651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.561552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.566722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.582256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:41.603458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72f4eae8-3a65-433f-89f1-d4a0756d843a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 1.089587 Aug 30 18:12:41.607396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 359/645] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:40 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:41.624259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f55551b-c118-4844-b868-95b16d9b1918", "name": "network-vif-plugged", "status": "completed", "tag": "c0c0be00-b48f-4bf6-82f4-2dc3d99936bd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:41.646972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.649350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.650942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.681165 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] Creating event network-vif-plugged:c0c0be00-b48f-4bf6-82f4-2dc3d99936bd for instance 4f55551b-c118-4844-b868-95b16d9b1918 on n-h2-854119-10 Aug 30 18:12:41.692742 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8f97d689-bbc7-479c-93ae-f3614d6706cf req-321253af-f2dd-490c-bfe6-6d7d75f02f82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083649 Aug 30 18:12:41.699607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 360/646] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:41.705357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:41.706061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:41.730202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.730739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.731532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:41.732758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:41.733458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:41.734727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.025002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:42.046634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18868802-48f1-4d5e-9490-af34b4e9494e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1271 microversion: 2.1 time: 0.345321 Aug 30 18:12:42.049142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 361/647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:41 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1271 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:42.061725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:42.066272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:42.078074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.083127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.083873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.086233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.087142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.087742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.358653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:42.370698 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15b64b6c-2233-40e4-80da-e018a6178418 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.885413 Aug 30 18:12:42.371350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 287/648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:41 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:42.379023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:42.397249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:42.405243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.409767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.410215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.411249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.411734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.412168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.511008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:42.527070 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6271d1ac-23a2-4187-8fdb-cc518ec48afe tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.476107 Aug 30 18:12:42.529385 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 362/649] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:42 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:42.536949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:42.538228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:42.548098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.548872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.549926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.554185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:42.555211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:42.556598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:42.980192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.008260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.017496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.021587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53a304b6-9f47-4ea0-8983-1b7be1e5d8d7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.489250 Aug 30 18:12:43.022669 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 363/650] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:42 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:43.053271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:43.056233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:43.070851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.072104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.072884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.074200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.075133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.076044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.342641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.385058 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e2150227-babf-41c6-acd6-c9ecf85ecf48 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 1.009404 Aug 30 18:12:43.401265 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 288/651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:42 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:43.419873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0995faf2-943b-4d05-bd21-5e03bab4e1f2", "tag": "ec4484bb-9771-4814-afda-e3b077dcf3f1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:43.444381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.445212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.445952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.463164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] Creating event network-changed:ec4484bb-9771-4814-afda-e3b077dcf3f1 for instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 on n-h2-854119-10 Aug 30 18:12:43.471496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d7b44b61-9d78-4452-ae17-2b7e1f338e47 req-059d8c2b-4c80-485a-887c-0f9e40a5bc24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068672 Aug 30 18:12:43.473323 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 289/652] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:43.487080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:43.489174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:43.499845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.500769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.501375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.503114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.503968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.504584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.575636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:43.585097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a014c4a8-b3f2-41d1-8333-34e42494175f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 0.544521 Aug 30 18:12:43.599807 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 364/653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:43 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:43.605348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:43.606645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:43.614223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.615243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.615915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.616919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:43.617626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:43.618276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:43.995837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:44.013625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebb937c7-d4cb-45a2-9e75-7dbaac0787c7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.412145 Aug 30 18:12:44.019589 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 365/654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:43 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:44.034706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bc38f52-a86b-4fe2-b2a7-d002cda46df5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bc38f52-a86b-4fe2-b2a7-d002cda46df5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action HTTP/1.1 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 285 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:12:44.048006 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:12:44.050135 n-d-854119-10 devstack@n-api.service[122589]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:12:44.051301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:12:44.052571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:12:44.055245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:12:44.063732 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:12:44.063732 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:44.063732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bc38f52-a86b-4fe2-b2a7-d002cda46df5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:44.063732 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5bc38f52-a86b-4fe2-b2a7-d002cda46df5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action" status: 400 len: 619 microversion: 2.1 time: 0.028601 Aug 30 18:12:44.064530 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 366/655] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Aug 30 18:12:44 2022] POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:12:44.081702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:44.083883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:44.110032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.111842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.113172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.116350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.117612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.118495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.545413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:44.568513 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e249946-1112-413b-8816-b872fcf7bf2a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1271 microversion: 2.1 time: 1.090110 Aug 30 18:12:44.570366 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 290/656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:43 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1271 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:44.577820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:44.579245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:44.588415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.589549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.590679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.592192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.593210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.593889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.603615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:44.621210 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a26d842-2fc9-4ebc-bbee-dd5f8bce900b tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.560719 Aug 30 18:12:44.630882 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 367/657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:44 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:44.631821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:44.632950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:44.653474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.657945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.667259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.669589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:44.671162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:44.672327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:44.788843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:45.182007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:45.203346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:45.212691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:45.216166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db531960-ab3a-43c4-86c8-d962562920cd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.591283 Aug 30 18:12:45.221993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 368/658] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:44 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:45.238614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:45.244559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:45.268376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.268902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.269707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:45.285348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.289658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.295017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:45.362114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:45.398877 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6eefe48-139b-4519-b056-dbca5a1f2bc7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.813882 Aug 30 18:12:45.399940 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 291/659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:44 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:45.406119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "110539b2-6108-4c08-a8cc-a25fe6855637"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:45.409089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:45.421856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.422763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.423437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:45.424403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:45.425070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:45.425688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.074249 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb6c2902-8e3a-4e9c-beae-eb5a972ea074 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "POST /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672120 Aug 30 18:12:46.075563 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 292/660] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:12:45 2022] POST /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:46.118515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:46.124363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:46.179400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.179995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.180432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.183482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.185396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.187902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.278925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:46.291338 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d13d4bbe-2e3d-4821-b594-1f2c846f5a30 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 1.063956 Aug 30 18:12:46.297757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 369/661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:45 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:46.310849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:46.311485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:46.322157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:46.327154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.327670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.328169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.328912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.329469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.329928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.369088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=28 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:46.852639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:46.869848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:46.894850 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f939159-b653-4cdc-b997-1dd828405f12 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.817060 Aug 30 18:12:46.904209 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 293/662] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:46 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:46.933736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:46.936420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:46.955658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.956488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.958645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:46.960847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:46.963231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:46.964580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.100993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:47.126659 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf92f19a-6b7f-4cdc-abb0-e1900e09cbb4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.826832 Aug 30 18:12:47.128574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 370/663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:46 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:47.478638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Calling method '.version_select at 0x7f4e57207b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:47.510267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:47.521600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0cbc66bf-a870-4363-bfd7-a176b86d7786 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.614783 Aug 30 18:12:47.537365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=17 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:47.537586 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 294/664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:46 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:47.543071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:47.544055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:47.554153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.555768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.558472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.558975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.559591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.560326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.561142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.561618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.562055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.562504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.564151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.565277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.627598 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcc81661-4a6c-4dfc-9bbd-86c287a7dcf0 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.495579 Aug 30 18:12:47.640646 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 371/665] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 18:12:47 2022] GET /compute/v2.1/limits => generated 511 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:47.688418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344ab242-92c2-416b-8571-f6190835c516", "tag": "b4803740-78fe-4c7f-80ac-eac09cc341ae"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:47.725611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.731379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.733846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.770065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] Creating event network-changed:b4803740-78fe-4c7f-80ac-eac09cc341ae for instance 344ab242-92c2-416b-8571-f6190835c516 on n-h1-854119-10 Aug 30 18:12:47.778765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3e68e396-6b31-46de-a83c-536685d68593 req-fdff4e65-4f31-47fd-b986-55e54f242cae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123535 Aug 30 18:12:47.785006 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 372/666] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:47.794848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:47.795992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:47.826733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.827575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.829119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:47.830995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:47.834903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:47.836592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.282452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:48.304086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:48.307790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:48.311495 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-10c35e90-82ea-4ec8-bccb-fe8ed64cbb0c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.525082 Aug 30 18:12:48.321598 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 373/667] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:47 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:48.338412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147f0d87-0e99-4ff4-b460-91a1ec4884b5", "name": "network-vif-plugged", "status": "completed", "tag": "fa58c4d0-0218-489d-a4c1-443c0e2b760c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:48.363262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.363866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.364608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.390643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] Creating event network-vif-plugged:fa58c4d0-0218-489d-a4c1-443c0e2b760c for instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 on n-h2-854119-10 Aug 30 18:12:48.402587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a4d7a079-e2a4-4d65-bbed-a3972a741be3 req-68e349ff-4765-418c-9c82-090654d2fc1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078648 Aug 30 18:12:48.420098 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 374/668] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:48.453556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-636634148"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:48.484201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:48.501078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.504859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.507180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.508143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.509446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.519730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.624520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:48.661583 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-574dc9a8-0081-407a-9196-eda70abe3851 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 1.122496 Aug 30 18:12:48.690073 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 295/669] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:47 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:48.696221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf7ec5e-78cd-406b-8bcb-2630a9feda5c", "tag": "1de9f153-f51e-4774-b5b4-0d5a58cde445"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:48.748075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.748564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.749043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.794483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] Creating event network-changed:1de9f153-f51e-4774-b5b4-0d5a58cde445 for instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c on n-h2-854119-10 Aug 30 18:12:48.807133 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c4106f7a-26d6-4df7-ba3e-c280e71743db req-e5bf1f3e-28d3-4922-b697-9130184a5edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113279 Aug 30 18:12:48.809011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 296/670] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:48.821556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:48.824462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:48.839406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.840829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.841880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:48.843525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:48.844697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:48.846882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.033275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:49.063038 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ee002a9-52d9-40c9-ad5b-df81d795b7f5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action" status: 202 len: 0 microversion: 2.1 time: 0.638130 Aug 30 18:12:49.070138 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 375/671] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:12:48 2022] POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:12:49.077098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2043040137", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:49.166997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:12:49.188202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:49.207664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cf75507-22d8-48e4-baaa-99a1a2fc3f0f tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 0.395919 Aug 30 18:12:49.209375 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 297/672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:48 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:49.220243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:49.221742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:49.235819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.236953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.237919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.239574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.240613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.241702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.523771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Getting quotas for project 26f26cae27704b2f9b11a445b9259f40. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:12:49.530466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:49.540624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Getting quotas for user ca1fef4ad34041968d19f53439116c5e and project 26f26cae27704b2f9b11a445b9259f40. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:12:49.555391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c20136d4-d176-479d-af0e-ac8dcd3e2c0a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.343316 Aug 30 18:12:49.570840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 30 18:12:49.576563 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 298/673] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:49 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Request method failure captured: Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 1752 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMdBmky1OJu92htqSjBJVWqczkXHJ_4nrJwj24N_NlmSag3h25lClrSWKgwxPjPCwj0rF1WTn8vzPhc_6MFo6BidtD3SMQIuDT3goQpdQu6rIXs0X2tMooOdN3kF20ZTjaDk4tl_AoyY1aA6eb9f6cSrRwkQLgENnxEGMKxxY_ZGyE Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 26f26cae27704b2f9b11a445b9259f40 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-592977624 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26f26cae27704b2f9b11a445b9259f40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26f26cae27704b2f9b11a445b9259f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26f26cae27704b2f9b11a445b9259f40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26f26cae27704b2f9b11a445b9259f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-592977624 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 26f26cae27704b2f9b11a445b9259f40 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-592977624 Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-592977624-project Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ca1fef4ad34041968d19f53439116c5e Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-592977624-project Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2043040137", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:12:49.587847 n-d-854119-10 devstack@n-api.service[122589]: exception: Maximum number of metadata items exceeds 128 Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2043040137', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:49.593056 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-870edfcb-b374-4497-ad92-6d4b62233c83 tempest-AbsoluteLimitsNegativeTestJSON-592977624 tempest-AbsoluteLimitsNegativeTestJSON-592977624-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.518233 Aug 30 18:12:49.599233 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 376/674] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Aug 30 18:12:49 2022] POST /compute/v2.1/servers => generated 87 bytes in 521 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:49.601928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:49.601928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:49.615747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.617065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.618003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.620710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.622956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.623312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-488921283"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:49.624467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.630129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:49.657878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.658701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.662936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.667301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:49.672388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:49.673655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:49.882461 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Cannot 'createImage' instance 2ee35143-2128-4f32-9513-d0a3dee51d87 while it is in task_state image_snapshot_pending Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action HTTP/1.1 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 84 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-488921283"}} Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'createImage' instance 2ee35143-2128-4f32-9513-d0a3dee51d87 while it is in task_state image_snapshot_pending Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-488921283'}}} Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:12:49.894439 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2ee35143-2128-4f32-9513-d0a3dee51d87 while it is in task_state image_snapshot_pending Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2ee35143-2128-4f32-9513-d0a3dee51d87 while it is in task_state image_snapshot_pending Aug 30 18:12:49.901846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:12:49.904840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 409 to user: Cannot 'createImage' instance 2ee35143-2128-4f32-9513-d0a3dee51d87 while it is in task_state image_snapshot_pending {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:12:49.913965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-199b9b02-4410-4bfe-9e4a-adb7a9837be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action" status: 409 len: 167 microversion: 2.1 time: 0.317686 Aug 30 18:12:49.919188 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 377/675] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:12:49 2022] POST /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87/action => generated 167 bytes in 327 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:12:49.946691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:49.950841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:50.022745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.023650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.024398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.025642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.032902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.033120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.281201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.291648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d818e1cb-0c7d-4445-932a-520769b00b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.712963 Aug 30 18:12:50.297168 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 299/676] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:49 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:50.302505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:50.308629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:50.330058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.330890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.331656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.332689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.333543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.334175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.457841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.477463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.479407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.481406 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-250ddaa1-90b7-4d5e-b1aa-4793369c9e2d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.559200 Aug 30 18:12:50.482406 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 378/677] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:49 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:50.495418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c10ec3d-b549-4702-b3b2-690895e6e0b2", "tag": "709ed21a-277e-4a5a-8e7a-b4458c89eb77"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:50.546100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.547141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.547828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.600701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:50.602777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] Creating event network-changed:709ed21a-277e-4a5a-8e7a-b4458c89eb77 for instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 on n-h2-854119-10 Aug 30 18:12:50.613829 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dcfff882-c546-4ffb-acaf-6044fb74e1e7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.315150 Aug 30 18:12:50.617664 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 300/678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:50 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:50.628759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-27dc58d9-fae5-4ae4-87c8-0a69f7ec2de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e56f8c8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:50.629497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6bba4380-0f2d-45da-816a-8c5f44b2baf5 req-0c03f7a6-22d2-4436-aaf7-1bb24933b49b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137574 Aug 30 18:12:50.630775 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 379/679] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:50.645469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:50.646423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:50.680072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.687946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.688482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.689762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:50.694505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:50.695468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:50.942145 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-27dc58d9-fae5-4ae4-87c8-0a69f7ec2de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/images/68c1bcb2-aca6-4710-bd7b-bfb56aecdf27" status: 204 len: 0 microversion: 2.1 time: 0.322907 Aug 30 18:12:50.943325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 301/680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:50 2022] DELETE /compute/v2.1/images/68c1bcb2-aca6-4710-bd7b-bfb56aecdf27 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:50.950267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd77523-d660-421c-8e81-c8111d0cf124", "name": "network-vif-plugged", "status": "completed", "tag": "79b3e363-4327-4433-b3d8-bc0fdaa244c0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:51.001017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.005120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.006228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.051047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] Creating event network-vif-plugged:79b3e363-4327-4433-b3d8-bc0fdaa244c0 for instance ffd77523-d660-421c-8e81-c8111d0cf124 on n-h1-854119-10 Aug 30 18:12:51.074055 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-de52ae59-da63-4b10-8afd-bb5b1fb684ce req-ddcfdbc4-e412-4b0b-9cf5-724a9be2ee3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122905 Aug 30 18:12:51.076055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 302/681] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:51.101149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:51.109430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:51.135206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.137201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.138030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.141862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.142775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.147379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.251001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:51.265847 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-172ff769-99cd-45dc-be23-e2d6babd2a06 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 0.633676 Aug 30 18:12:51.271428 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 380/682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:50 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:51.278534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:51.281850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:51.297847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.300424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.301438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.303360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.308459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.312663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.479195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:51.492747 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1610717b-742f-49af-b3c9-bfab1ac15dcc tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.414876 Aug 30 18:12:51.493722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 303/683] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:51 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:51.508693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:51.509776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:51.520438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.525658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.526528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.527630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.528305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.537245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.630687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:51.644282 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe4b12a7-2fec-4b04-a806-3177ff72fff2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1534 microversion: 2.1 time: 0.371526 Aug 30 18:12:51.645733 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 381/684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:51 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1534 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:51.652353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:51.665070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:51.688738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.689199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.689700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.695474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:51.695474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:51.695474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:51.991247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.006435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.008452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.010444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0beebe24-01d1-45d9-bcd9-535cc83e611b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.362525 Aug 30 18:12:52.011392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 382/685] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:51 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:52.018055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:52.018728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:52.028630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.031959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.033833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.036773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.037546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.038878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.093658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.126515 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6e12f76-9d87-4ec8-b742-1ca50c56a6f8 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.631052 Aug 30 18:12:52.128879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 304/686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:51 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:52.297585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:52.299810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:52.306570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:52.316865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.318669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.320082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.321919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.340404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.342430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.345298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.376789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d7029f2-3dc8-469c-89cc-2c0efc87b6b7 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.355491 Aug 30 18:12:52.399225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 383/687] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:52 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:52.521708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:52.523343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:52.537802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.541420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.542628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.545533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.547020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.548058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.578383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.593510 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6fac7ea-d466-4a4d-a94c-da0c5a0afb31 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1323 microversion: 2.1 time: 0.305024 Aug 30 18:12:52.595357 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 305/688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:52 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:52.692068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:52.707959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:52.727493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.738922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.740218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.741923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:52.747786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:52.748735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:52.835185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:52.850717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-857fab02-a54a-4c32-8efe-b1573147f377 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.337961 Aug 30 18:12:52.851761 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 384/689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:52 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:53.048386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:53.048834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:53.057062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.057567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.058163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.059201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.060804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.061293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.232343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:53.272141 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-79b2a626-7fef-4090-8b7a-f64fe52ca4de tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1540 microversion: 2.1 time: 0.587702 Aug 30 18:12:53.286524 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 306/690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:52 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1540 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:53.329106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0995faf2-943b-4d05-bd21-5e03bab4e1f2", "name": "network-vif-plugged", "status": "completed", "tag": "ec4484bb-9771-4814-afda-e3b077dcf3f1"}, {"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-plugged", "status": "completed", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:53.373953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.374911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.375610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.438502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Creating event network-vif-plugged:ec4484bb-9771-4814-afda-e3b077dcf3f1 for instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 on n-h2-854119-10 Aug 30 18:12:53.439493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] Creating event network-vif-plugged:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:12:53.484541 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6085804e-2fe1-4e83-8e4d-efb238e0ab6b req-6ada7a1b-c5fd-45c6-a758-e9bca7a5f862 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.190206 Aug 30 18:12:53.486171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 307/691] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:53.498042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:53.499722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:53.514120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.515809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.516823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.518430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.519481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.520482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.537341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:53.560536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:53.562385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:53.563673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ee19431-d724-44e2-bc10-40b440a3b32e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.519618 Aug 30 18:12:53.574697 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 385/692] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:53 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:53.574697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:53.574978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:53.614535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.615030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.615664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.616571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:53.620675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:53.621901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:53.993008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:54.010209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d2c179a-030e-4ad5-a690-b364c68fefd8 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.439782 Aug 30 18:12:54.011565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 386/693] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:53 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:54.016928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:54.019393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:54.036656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.040160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.040954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.041913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.043573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.046102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.371057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:54.380226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddfe1b00-90bb-49cc-9409-17c092e3de17 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1516 microversion: 2.1 time: 0.367188 Aug 30 18:12:54.381263 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 387/694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:54 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1516 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:54.389005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:54.398805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:54.399639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:54.409727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.412032 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3fba6aa5-d175-4ceb-abe1-0ea7e3b06699 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.923416 Aug 30 18:12:54.414578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.415145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.415917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.416382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.417058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.426922 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 308/695] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:53 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:54.454912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:54.456503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:54.468915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.470489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.471761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.473712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.475216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.476421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.716163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:54.740858 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9adf4309-a01b-4910-b832-1d1390dea883 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.356600 Aug 30 18:12:54.742872 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 388/696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:54 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:54.771627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:54.773168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:54.804904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.807335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.808382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:54.812200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:54.813704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:54.815259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.104471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:55.127693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-616778b4-363b-45f1-ad26-aac3c8cf718d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 200 len: 1516 microversion: 2.1 time: 0.381986 Aug 30 18:12:55.129274 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 389/697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:54 2022] GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:55.142643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:55.150135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:55.150135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:55.164635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9ea7d10-32d7-431b-983b-b099b12ebddd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1540 microversion: 2.1 time: 0.735433 Aug 30 18:12:55.165697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 309/698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:54 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1540 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:55.168342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.169298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.170613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.172607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.174239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.175378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.193352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:55.198027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:55.241667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.249322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.251395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.253667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.259334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.260627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.541528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:55.562850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:55.566302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:55.569028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39bcea09-f03f-4056-bf1c-15a57e59bc02 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1361 microversion: 2.25 time: 0.437705 Aug 30 18:12:55.588458 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 390/699] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:55 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:55.613600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:55.616141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:55.629672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.630915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.631932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:55.633854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:55.635175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:55.636719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.034528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:56.061904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4b32af2-03ab-4c0f-858f-41163c4bc2fd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 200 len: 1515 microversion: 2.1 time: 0.470943 Aug 30 18:12:56.063412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 391/700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:55 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:56.097616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:56.101006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:56.123693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.123693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.124895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.125346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.126542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.126744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.166207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:56.190005 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e113da67-920f-4a89-9e5c-908ce26c9273 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 1.012008 Aug 30 18:12:56.207966 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 310/701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:55 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:56.236385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:56.238732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:56.255245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.265372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.271676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.272690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.278409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.279186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.522305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:56.534426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3fe41a8-3760-46e7-a85a-358417b5db5e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.469792 Aug 30 18:12:56.535302 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 392/702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:56 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:56.550741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:56.550741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:56.550741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.550741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.550741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.551743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.552419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.553253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.648447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:12:56.741911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:56.848899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a42652c-957d-41bf-a0c7-a567dc79966c tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "DELETE /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 204 len: 0 microversion: 2.1 time: 0.311402 Aug 30 18:12:56.850489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 393/703] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:56 2022] DELETE /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:56.863351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:56.867346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:56.889349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.890898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.892054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.896647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:56.898299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:56.900515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:56.975361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:56.995082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e2e6ed49-bdb2-442e-bf04-4ff210423167 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 0.785042 Aug 30 18:12:56.996216 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 311/704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:56 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.002613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf7ec5e-78cd-406b-8bcb-2630a9feda5c", "name": "network-vif-plugged", "status": "completed", "tag": "1de9f153-f51e-4774-b5b4-0d5a58cde445"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:12:57.018489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.020577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.020982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.042069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] Creating event network-vif-plugged:1de9f153-f51e-4774-b5b4-0d5a58cde445 for instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c on n-h2-854119-10 Aug 30 18:12:57.049921 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-55e18e20-cb71-4d1d-9ef6-ed4b96ebe02f req-6044a7f5-c9af-4868-a06a-af2fb738b9f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050771 Aug 30 18:12:57.051554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 312/705] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:12:57.059563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.060457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.074976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.075808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.076980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.077780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.078238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.079152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.313415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.324749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.326448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.327666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0980357-76cc-4c08-a0aa-59dfefedc04d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1556 microversion: 2.25 time: 0.274763 Aug 30 18:12:57.336793 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 313/706] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1556 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:57.350616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.352160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.366914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.368301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.369011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.369776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.370242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.370705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.378290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:57.380584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.391209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92330b5b-3c49-4ee7-8809-7eb9fc0eb2a0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1522 microversion: 2.1 time: 0.537829 Aug 30 18:12:57.392318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 394/707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:56 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.399613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.400388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.419864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.420367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.420805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.421531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.421983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.422448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.600202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:57.631115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.648427 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6aefe84-f7c2-4d9e-90f8-df812f3fe0f9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 200 len: 1521 microversion: 2.1 time: 0.308986 Aug 30 18:12:57.651427 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 314/708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.817481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:57.854231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ce77154-38b4-42b2-a456-d829be58ea39 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.458134 Aug 30 18:12:57.858659 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 395/709] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:57.879667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:57.883581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:57.896927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:57.903596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.904131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.904907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.905981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:57.907343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:57.908400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:57.992155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:12:58.036302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:58.037270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:58.044679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.045448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.045886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.046864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.047482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.048236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.258986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e43225a-a5c2-4189-9670-4b60af2596f2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 204 len: 0 microversion: 2.1 time: 0.395379 Aug 30 18:12:58.268345 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 396/710] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:12:57 2022] DELETE /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:12:58.306866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:58.313335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:58.328753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.329640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.338751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.338751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.338751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.338751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.640291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 0995faf2-943b-4d05-bd21-5e03bab4e1f2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:12:58.704094 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67229f39-bb62-496a-8d56-ea27bc23cc53 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 2050 microversion: 2.25 time: 1.050633 Aug 30 18:12:58.705729 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 315/711] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:57 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 2050 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:12:58.728866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:58.738440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:58.777490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.783265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.789483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:58.792172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:58.796546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:58.802422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.073193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:59.099340 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7ee6ff74-0872-4de0-9ef2-d518714e04c5 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.824038 Aug 30 18:12:59.102281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 397/712] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:58 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:59.115610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:59.117966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:59.136318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.137815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.139902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.142200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.143828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.144902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.559493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:12:59.661554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:59.675671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-248a9af5-c3ee-44b9-8859-1a60e2ee3c6d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1528 microversion: 2.1 time: 0.571180 Aug 30 18:12:59.676285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 398/713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:59 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1528 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:59.683803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:59.687169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:59.711328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.712375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.713006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.713915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.718385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.719189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.801603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:12:59.819719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db6e9960-4699-415d-833f-36cf28d2a63e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1314 microversion: 2.1 time: 1.110679 Aug 30 18:12:59.878154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 316/714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:58 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:12:59.901720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:12:59.904248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:12:59.917374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.917887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.918526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:12:59.919924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:12:59.920403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:12:59.920842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.300840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 0995faf2-943b-4d05-bd21-5e03bab4e1f2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:00.301771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:00.323164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e21ed26-a7ab-446d-9d50-6f9f87e0b831 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 200 len: 1521 microversion: 2.1 time: 0.645148 Aug 30 18:13:00.330019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 399/715] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:12:59 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:00.332173 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e90fc7f6-9a6b-443a-85b5-8066f5ad3da5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 2050 microversion: 2.25 time: 0.451859 Aug 30 18:13:00.335154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 317/716] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:12:59 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 2050 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:00.341779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344ab242-92c2-416b-8571-f6190835c516", "name": "network-vif-plugged", "status": "completed", "tag": "b4803740-78fe-4c7f-80ac-eac09cc341ae"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:00.342012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:00.343158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:00.389637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.391019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.392398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.395079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.396563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.397967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.402166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.403500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.413579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.445380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] Creating event network-vif-plugged:b4803740-78fe-4c7f-80ac-eac09cc341ae for instance 344ab242-92c2-416b-8571-f6190835c516 on n-h1-854119-10 Aug 30 18:13:00.472385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-947417fd-fcc5-446b-83c5-6564c12a7e64 req-2f566896-cec4-40b6-ba5f-8aa4aa9732ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137884 Aug 30 18:13:00.478588 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 318/717] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:00.489825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:00.491477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:00.502817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.503740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.504541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.505948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.508025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:00.509039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:00.915734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:00.933373 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-75d39c55-d631-4c59-801d-e5f2acac351c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.601665 Aug 30 18:13:00.937230 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 400/718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:00 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:00.964643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:00.991429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:00.996008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.001829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.003335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.009103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.013065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.066190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f96bee4-a24f-465c-88e6-e4c89c6809ee tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.127247 Aug 30 18:13:01.067644 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 401/719] 10.222.0.25 () {60 vars in 1217 bytes} [Tue Aug 30 18:13:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:13:01.085924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:01.097628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:01.107410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.108651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.110209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.115262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.117013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.118040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.216365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:01.240927 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bbf2b552-ac0a-42f3-91d2-ab54d2b108e7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.759498 Aug 30 18:13:01.242707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 319/720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:00 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:01.251101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:01.252293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:01.264186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.267797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.271524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.273479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.274224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.275081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.565779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:01.606746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7748bdc6-0fab-4dcc-9e95-dc512aed3eef tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1528 microversion: 2.1 time: 0.537196 Aug 30 18:13:01.612875 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 402/721] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:01 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1528 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:01.629431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147f0d87-0e99-4ff4-b460-91a1ec4884b5", "name": "network-vif-deleted", "tag": "fa58c4d0-0218-489d-a4c1-443c0e2b760c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:01.679299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.685418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.686402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.772426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] Creating event network-vif-deleted:fa58c4d0-0218-489d-a4c1-443c0e2b760c for instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 on n-h2-854119-10 Aug 30 18:13:01.812402 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2bc0ba53-7791-4286-8ff4-6251105f2e72 req-b1def0fc-c77f-4d17-acbd-d45f7792bbed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184903 Aug 30 18:13:01.815253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 403/722] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:01.836733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": "auto"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:01.852796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:01.880259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.881197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.881992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:01.887443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:01.888456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:01.891170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.140655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:02.173265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78df8a8e-bba5-4bc9-8832-7b802b5970a1 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1464 microversion: 2.1 time: 0.927603 Aug 30 18:13:02.174752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 320/723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:01 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1464 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:02.201846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:02.203603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:02.225105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'flavor' on Instance uuid 0995faf2-943b-4d05-bd21-5e03bab4e1f2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:02.225372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.226110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.226865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.231061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.238740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.239858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.319966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.321083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.321568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122589) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:13:02.322284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.323521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lazy-loading 'fault' on Instance uuid 147f0d87-0e99-4ff4-b460-91a1ec4884b5 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:02.422665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:02.440608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7742358e-1321-4ffe-99fd-29c076b1ab1b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 200 len: 1313 microversion: 2.1 time: 0.260783 Aug 30 18:13:02.442168 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 321/724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:02 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:02.451445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:02.457895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:02.478551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.479621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.480725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.482180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.483474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.484629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.866128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:02.879335 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a663460d-3a56-46a0-a270-422a7a53be3a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1389 microversion: 2.1 time: 0.435544 Aug 30 18:13:02.891427 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 322/725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:02 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1389 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:02.902170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:02.903104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:02.913181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.914193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.915050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:02.916010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:02.916711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:02.917355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.175553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:03.186190 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc31969c-dfea-4af9-a9e0-d930ecce1bfd tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1464 microversion: 2.1 time: 0.288420 Aug 30 18:13:03.186876 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 323/726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:02 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:03.193659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:03.194627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:03.203909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.204404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.205056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.207250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.207956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.210197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.629812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:03.641884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98304559-92d5-4b0c-bccc-7bcd5e83b9d0 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1313 microversion: 2.1 time: 0.453201 Aug 30 18:13:03.643041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 324/727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:03 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:03.649317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c10ec3d-b549-4702-b3b2-690895e6e0b2", "name": "network-vif-plugged", "status": "completed", "tag": "709ed21a-277e-4a5a-8e7a-b4458c89eb77"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:03.663375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.664164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.665143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.704688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] Creating event network-vif-plugged:709ed21a-277e-4a5a-8e7a-b4458c89eb77 for instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 on n-h2-854119-10 Aug 30 18:13:03.720322 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4e4f6c5d-488b-4226-8842-cafdd5e0fe05 req-92fc906d-3ed6-4934-892b-3004e5a4e492 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074454 Aug 30 18:13:03.720979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 325/728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:03.736802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:03.741090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:03.768102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.773643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.776426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.782048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.785964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.786572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.899796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:03.900732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:03.902231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:03.903140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lazy-loading 'fault' on Instance uuid 2ee35143-2128-4f32-9513-d0a3dee51d87 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:04.053247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:04.069528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-279b4ab5-ef7c-469b-b77c-462ede12bb6f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 200 len: 1314 microversion: 2.1 time: 0.345650 Aug 30 18:13:04.083154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 326/729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:03 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:04.092023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:04.092924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:04.101840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.102694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.103281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.104863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.105791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.106559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.128615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] HTTP exception thrown: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 HTTP/1.1 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '147f0d87-0e99-4ff4-b460-91a1ec4884b5'} Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.132675 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:04.138076 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:04.140518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 404 to user: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:04.146798 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65e03ef2-fec4-4a47-9e8f-7b803a477351 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 404 len: 111 microversion: 2.1 time: 0.062281 Aug 30 18:13:04.151656 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 327/730] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:04 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:04.177038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-984852419", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ff1eddd1-e89f-4938-b544-f76bf03f647b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:04.338073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:04.698301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:04.699047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:04.699395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:04.700067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:04.700582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:04.721879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.723020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.723527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.724342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.725027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.725841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.748361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:04.754640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Getting quotas for user 04f1cc0e60b04c5e9f3c3df65999a433 and project 57839407595a483c9ffcb2d9e405e068. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:04.771099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:04.773697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:04.826968 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95b01407-785c-4dd2-a732-6217f8b8c9b8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672388 Aug 30 18:13:04.827997 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 328/731] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:04.850530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee35143-2128-4f32-9513-d0a3dee51d87", "name": "network-vif-deleted", "tag": "6a74a133-75bb-4419-a823-0b625f7746df"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:04.881756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.882949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.883689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.906384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] Creating event network-vif-deleted:6a74a133-75bb-4419-a823-0b625f7746df for instance 2ee35143-2128-4f32-9513-d0a3dee51d87 on n-h1-854119-10 Aug 30 18:13:04.918326 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e57ad287-2cca-4403-943e-8e0c0efa8074 req-753fa271-34b3-4f9c-bd16-644473c28c8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075734 Aug 30 18:13:04.927315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 329/732] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:04.937800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:04.938620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:04.946320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.946893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.947336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:04.948111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:04.948852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:04.949098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:05.329248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:05.358639 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9eef1778-6f23-4c2b-b393-324de07d7504 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1589 microversion: 2.1 time: 0.428701 Aug 30 18:13:05.372683 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 330/733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:04 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1589 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:05.411650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:05.445368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:05.455381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:05.497339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:05.498480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:05.499196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:05.501103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:05.502484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:05.503525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:05.820811 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa4a70a3-4e9d-4a38-983f-b3362e9ca2a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.440795 Aug 30 18:13:05.823030 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 331/734] 10.222.0.25 () {58 vars in 1230 bytes} [Tue Aug 30 18:13:05 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:05.846636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:05.849770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:05.864571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:05.865808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:05.866667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:05.868051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:05.870732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:05.872471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.367903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:06.399017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-258622d6-e96e-4af6-a46e-a8bc9a18490e tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1463 microversion: 2.1 time: 0.562144 Aug 30 18:13:06.399778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 332/735] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:05 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1463 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:06.406882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.407841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.416062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.416663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.417108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.418226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.419162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.419613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.444947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:06.542458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:06.557698 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd3d635b-b697-4a1b-9e26-024990ff8099 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1265 microversion: 2.1 time: 0.156252 Aug 30 18:13:06.558984 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 333/736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:06.568922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.570539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.582008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.582771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.583466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.584781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.585825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.586898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.626186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 HTTP/1.1 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87'} Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.629933 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:06.634400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-368a9077-4ad6-4e78-8b96-2797696dc338 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 404 len: 111 microversion: 2.1 time: 0.071472 Aug 30 18:13:06.638537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 334/737] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:06.644578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.645788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.653279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.654056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.654530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.656032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.656219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.656665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.741258 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f120c6c8-5c74-4408-86b9-1e6972829904 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2/action" status: 202 len: 0 microversion: 2.25 time: 4.920193 Aug 30 18:13:06.742923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 404/738] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:13:01 2022] POST /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2/action => generated 0 bytes in 4927 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:06.753010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.756926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:06.775053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.776064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.776609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.777531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:06.778113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:06.778972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:06.829903 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1bbedd92-f6e0-4254-8622-008eba05062a tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189622 Aug 30 18:13:06.831007 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 335/739] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:06.846887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c57eb64-43ee-43f4-bcda-f4365e61d5c9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:06.848570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-616d4a30-2f6d-4cc3-bdcc-03ea38bd1b43 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103617 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c57eb64-43ee-43f4-bcda-f4365e61d5c9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 18:13:06.859194 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 18:13:06.864975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:06.866111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 405/740] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:06.869514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c57eb64-43ee-43f4-bcda-f4365e61d5c9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:06.872153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c57eb64-43ee-43f4-bcda-f4365e61d5c9 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.036027 Aug 30 18:13:06.882635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 336/741] 10.222.0.25 () {58 vars in 1182 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:13:07.016750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-729997712", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a4549ce9-8c04-485f-9303-8f662d038aa7"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:07.162912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Calling method '.version_select at 0x7f4e56f800d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:07.179901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] validate_networks() for [('a4549ce9-8c04-485f-9303-8f662d038aa7', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:07.211306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:07.212172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:07.213764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:07.249649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:07.250901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:07.251957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:07.306713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8b46d93e-7049-42e9-9fdb-ef959501257f tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/ab49ebea7cba46b39ce1d1645e03510d?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545" status: 200 len: 694 microversion: 2.1 time: 0.419624 Aug 30 18:13:07.307799 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 337/742] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Aug 30 18:13:06 2022] GET /compute/v2.1/os-simple-tenant-usage/ab49ebea7cba46b39ce1d1645e03510d?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545 => generated 694 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:07.330000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-01c8b3d2-0147-4cf8-8420-2240332c7969 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'create', calling method: .version_select at 0x7f4e56f0ad30>, body: {"keypair": {"name": "tempest-keypair-266258920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkkcCHQ4DKUjX55lBQXVU1QvyDgwyqY/hjXU3ZJnXA9BYXh+qUseozz09d7u3RCwN1fCipAP4mW11pjZZGwMCxDU8/b4Z8dDJyVs2mesvAxb/0lFQg3jCWQBBfy0cXiaQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:07.388585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-01c8b3d2-0147-4cf8-8420-2240332c7969 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for project ba69efb209b4468f8d3d69cf0850c320. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:07.400320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-01c8b3d2-0147-4cf8-8420-2240332c7969 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for user 8526d208810247feaf96b54f55452d07 and project ba69efb209b4468f8d3d69cf0850c320. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:07.455929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-01c8b3d2-0147-4cf8-8420-2240332c7969 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145130 Aug 30 18:13:07.458331 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 338/743] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:13:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:07.470837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:07.471740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:07.501246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:07.502060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:07.502797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:07.503819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:07.512865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:07.515180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:08.078911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:08.104877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:08.108301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:08.110263 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82fd5fc8-b8ae-4a98-8e93-0b47d4dc29ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.649104 Aug 30 18:13:08.120071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 339/744] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:07 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:08.135391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:08.137646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:08.146893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:08.147708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:08.148334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:08.149251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:08.150180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:08.150898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:08.372756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lazy-loading 'services' on Instance uuid f6c745e1-8abe-4a92-b2ab-0c93734e7503 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:08.583842 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6474fc8b-9b52-4f6d-8abe-deefa6dba5ad tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments/110539b2-6108-4c08-a8cc-a25fe6855637" status: 202 len: 0 microversion: 2.1 time: 0.460742 Aug 30 18:13:08.588088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 340/745] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:13:08 2022] DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments/110539b2-6108-4c08-a8cc-a25fe6855637 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:08.610216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:08.617440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:08.619019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:08.653834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:08.658782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:08.658782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:08.658782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:08.659509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:08.660313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.002244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:09.004702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:09.008389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:09.009517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:09.010678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:09.029487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.031481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.032670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.034563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.035863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.038612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.254678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:09.525590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db07232d-32dd-484e-bb93-a5628c6b458b tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.936052 Aug 30 18:13:09.526972 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 341/746] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:13:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:09.533953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '.version_select at 0x7f4e56f4b4c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:09.541881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:09.550422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.551191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.552029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.560463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:09.567055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.567818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.568416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.586208 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-556a4518-0b62-4984-94b5-6d0bae1de6d7 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/ab49ebea7cba46b39ce1d1645e03510d?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545" status: 200 len: 650 microversion: 2.1 time: 0.057113 Aug 30 18:13:09.589701 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 342/747] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Aug 30 18:13:09 2022] GET /compute/v2.1/os-simple-tenant-usage/ab49ebea7cba46b39ce1d1645e03510d?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545 => generated 650 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:09.599432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:09.604304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for user ab2acdcb76554cbf9c45566a19d03f35 and project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:09.616329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:09.641792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.643060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.643891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.652108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.653352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.653844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.663357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:09.686204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:09.885264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab5ae6e6-ab8c-4d18-b34e-58fc28b73f80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.022032 Aug 30 18:13:09.894096 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 406/748] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:09.899915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:09.900988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:09.914457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.915555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.916272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.917549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:09.918381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:09.918969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:09.952504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:10.352835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:10.362218 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60686e94-b102-41d6-bd69-e261f86f5e74 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 0.769622 Aug 30 18:13:10.381636 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 343/749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:09 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:10.390763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:10.391404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:10.411467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:10.412018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:10.412460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:10.415712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:10.416327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:10.416672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:10.881231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:10.898788 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b57b4417-c1bb-4900-a1da-fe9b58da5190 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1589 microversion: 2.1 time: 0.515819 Aug 30 18:13:10.905632 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 344/750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:10 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1589 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:10.944714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344ab242-92c2-416b-8571-f6190835c516", "tag": "b4803740-78fe-4c7f-80ac-eac09cc341ae"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:10.973585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:10.974078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:10.974560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.009446 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] Creating event network-changed:b4803740-78fe-4c7f-80ac-eac09cc341ae for instance 344ab242-92c2-416b-8571-f6190835c516 on n-h1-854119-10 Aug 30 18:13:11.027875 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-67910eb0-01bf-48a6-9262-ee8ed972e8fc req-42442953-ba3a-4d96-8bde-33b363515cea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105606 Aug 30 18:13:11.035547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 345/751] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:11.057925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:11.076936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:11.078716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.servers [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Removing options 'limit' from query {{(pid=122590) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 18:13:11.080891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:11.100503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.102338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.104006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.108793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.110732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.111011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.182882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:11.272741 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c492b44d-6be1-40fc-bf15-477b4708e506 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.233893 Aug 30 18:13:11.275545 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 346/752] 10.222.0.25 () {58 vars in 1144 bytes} [Tue Aug 30 18:13:11 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:11.286207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Calling method '.version_select at 0x7f4e570d84c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:11.297300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.297970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.298610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.343221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.347052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.347708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.505594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a1df096-b3fb-4deb-8df5-6404ded4a08e tempest-TenantUsagesTestJSON-623834296 tempest-TenantUsagesTestJSON-623834296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545&detailed=1" status: 200 len: 10733 microversion: 2.1 time: 0.227962 Aug 30 18:13:11.530524 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 347/753] 10.222.0.25 () {58 vars in 1335 bytes} [Tue Aug 30 18:13:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T18%3A13%3A06.428545&end=2022-08-31T18%3A13%3A06.428545&detailed=1 => generated 10733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:13:11.536154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:11.543775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:11.572918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.576493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.578003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.579828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:11.581589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:11.582698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:11.811093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:11.851781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-943294cd-9f22-4015-9b48-271c348381f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1221 microversion: 2.1 time: 0.329214 Aug 30 18:13:11.867171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 348/754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:11 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:11.891355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddd2048b-c81c-4aa9-b17f-19a8f7586ae7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddd2048b-c81c-4aa9-b17f-19a8f7586ae7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi '-1' Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 18:13:11.905399 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 18:13:11.909704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:11.914868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddd2048b-c81c-4aa9-b17f-19a8f7586ae7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:11.916688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ddd2048b-c81c-4aa9-b17f-19a8f7586ae7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.048785 Aug 30 18:13:11.917774 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 349/755] 10.222.0.25 () {58 vars in 1142 bytes} [Tue Aug 30 18:13:11 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:13:11.990752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:11.992091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:12.005193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:12.006559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:12.007511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:12.014939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:12.016132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:12.017099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:12.488470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:12.506879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:12.508371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:12.516729 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f8c8959-0a68-4d28-a2a9-c71aa96b681e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 2.620138 Aug 30 18:13:12.519089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 407/756] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:09 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:12.543846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:12.545312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:12.573221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:12.582943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:12.586568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:12.590847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:12.592375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:12.593514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:12.656441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:12.972646 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-75084667-b8fd-438d-ac5b-bb7482735c7a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 204 len: 0 microversion: 2.1 time: 0.447558 Aug 30 18:13:12.974025 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 408/757] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:12 2022] DELETE /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:12.989952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c08ba8-870d-489c-b812-59bc0de5fc8a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c08ba8-870d-489c-b812-59bc0de5fc8a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: action_args: {} Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'testing' Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 18:13:12.998789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c08ba8-870d-489c-b812-59bc0de5fc8a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24c08ba8-870d-489c-b812-59bc0de5fc8a tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022472 Aug 30 18:13:13.009344 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 409/758] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:13:12 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:13:13.018169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:13.020453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:13.042568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.043584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.050622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:13.052812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.054156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.054945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:13.278029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:13.333970 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-164bccf6-2808-4dc4-bcea-0705c460174d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 1.394783 Aug 30 18:13:13.337601 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 350/759] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:11 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:13.352047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:13.353754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:13.369329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.371472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.372770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:13.374867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.376352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.378484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:13.428085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:13.442457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d949644-217e-4a47-85c8-d645ae00281c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1269 microversion: 2.1 time: 0.435722 Aug 30 18:13:13.459394 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 410/760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:13 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1269 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:13.500907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eae701c2-ce68-4a9a-8a13-082ab37d3436 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:13.545199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eae701c2-ce68-4a9a-8a13-082ab37d3436 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:13.548252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eae701c2-ce68-4a9a-8a13-082ab37d3436 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:13.578125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.servers [None req-eae701c2-ce68-4a9a-8a13-082ab37d3436 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Flavor 'non_existing_flavor' could not be found {{(pid=122589) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 30 18:13:13.586674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eae701c2-ce68-4a9a-8a13-082ab37d3436 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.123266 Aug 30 18:13:13.601395 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 411/761] 10.222.0.25 () {58 vars in 1178 bytes} [Tue Aug 30 18:13:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:13.632405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:13.638434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:13.680904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.681754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.690849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:13.699305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:13.700412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:13.705828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:14.417620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:14.467064 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-26e787ee-f453-4a24-a9e9-3b9644f91c72 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1469 microversion: 2.1 time: 1.127252 Aug 30 18:13:14.471844 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 351/762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:13 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1469 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:14.479889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:14.493022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:14.506183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:14.522177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:14.522712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:14.523161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:14.523948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:14.524413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:14.524850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:14.669712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00cfcf90-cf35-40c1-aa10-39f352c383a7 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.194608 Aug 30 18:13:14.670754 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 352/763] 10.222.0.25 () {58 vars in 1174 bytes} [Tue Aug 30 18:13:14 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:14.681279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f553a3ea-a776-4f55-8118-46fa32db023f", "tag": "787937b9-94c5-4ff4-818d-fc551cf8251e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:14.697937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:14.698778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:14.699632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:14.730043 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] Creating event network-changed:787937b9-94c5-4ff4-818d-fc551cf8251e for instance f553a3ea-a776-4f55-8118-46fa32db023f on n-h1-854119-10 Aug 30 18:13:14.753835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5cec2b39-2acb-4094-86a1-a67e257c7c4a req-c67e6cc5-1423-4048-bfac-a2fd45369630 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077824 Aug 30 18:13:14.759203 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 353/764] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:14.802214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:14.806975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:14.841959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:14.845129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:14.850305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:14.856404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:14.857538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:14.860485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.045531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.061715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.063529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.066424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-386aaf35-2c41-402a-a9ef-b859edfff7eb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 1.462941 Aug 30 18:13:15.075339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 412/765] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:13 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:15.081007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:15.082058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:15.101091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.102423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.103090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.104329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.105087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.105755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.261880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.271597 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-714bca1a-dc1a-4f16-ad76-cff668346f46 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1275 microversion: 2.1 time: 0.194531 Aug 30 18:13:15.287430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 413/766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:15 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:15.294228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:15.301083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.302284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:15.311984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.312843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.313516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.314561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.315291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.316002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.486767 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd16aff1-8ba9-4df6-a5fb-0784f61a1952 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.197343 Aug 30 18:13:15.490729 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 414/767] 10.222.0.25 () {58 vars in 1184 bytes} [Tue Aug 30 18:13:15 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:15.504366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0995faf2-943b-4d05-bd21-5e03bab4e1f2", "name": "network-vif-unplugged", "status": "completed", "tag": "ec4484bb-9771-4814-afda-e3b077dcf3f1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:15.536547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.539755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.540858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.569738 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] Creating event network-vif-unplugged:ec4484bb-9771-4814-afda-e3b077dcf3f1 for instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 on n-h2-854119-10 Aug 30 18:13:15.576887 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-022d05f5-5dc3-4115-b209-66c4c05bf969 req-999ab8cd-1ff2-4345-9cb8-70f467376a88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081880 Aug 30 18:13:15.578570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 415/768] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:15.585162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:15.586326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:15.596819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.597899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.598616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.599983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.601139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.601878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.768780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.790451 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32f8f8db-ca50-4c00-8842-bece0e3db7e9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 1.023656 Aug 30 18:13:15.792509 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 354/769] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:14 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:15.804461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:15.816702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:15.819053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:15.832871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.834079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.835251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:15.836952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:15.838140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:15.839340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.069791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:16.112866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:16.130412 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63686967-3aea-46e4-8f37-8a9e9a3d2b9a tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1469 microversion: 2.1 time: 0.550104 Aug 30 18:13:16.131672 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 416/770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:15 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:16.137420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-732793081", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:16.231305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] validate_networks() for [('c509431d-333d-4d7e-98ce-55b83064afaa', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:16.275480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:16.307603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.311320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.319777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.754270 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-02a00790-4352-498b-acc0-d7e95a0ad1fc tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.959776 Aug 30 18:13:16.774653 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 355/771] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:13:15 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:16.781234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:16.782257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:16.789662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.790727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.791417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.792429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.793142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.793824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.800251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:16.884592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:16.885395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:16.886374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:16.887519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:16.888350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:16.905093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.905917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.906724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.908033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:16.909209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:16.909991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:16.950648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:16.960509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for user 8526d208810247feaf96b54f55452d07 and project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:16.983400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:16.988988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:17.115026 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c809870-b33b-459a-98c5-ab90e9621be0 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.979519 Aug 30 18:13:17.115649 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 417/772] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:17.130049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.131852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:17.146910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.148032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.148859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.150500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.151608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.153318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.337034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.354721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.356329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.357572 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d95cadff-d9a2-4c99-9ee8-dfe21af8ca05 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.581118 Aug 30 18:13:17.359211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 356/773] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:16 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:17.370198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e814e8eb-66cc-44b3-a477-6448bea9e88d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.380319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e814e8eb-66cc-44b3-a477-6448bea9e88d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.391481 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e814e8eb-66cc-44b3-a477-6448bea9e88d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.026724 Aug 30 18:13:17.403151 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 357/774] 10.222.0.25 () {58 vars in 1178 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:17.415969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.416417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:17.454077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.455882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.457776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.460853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.461871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.463492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.849201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.863630 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc02291a-c8bd-4b67-9e90-fef3a0dddebf tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 0.455937 Aug 30 18:13:17.864665 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 358/775] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:17.884436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9ab3579-b9ff-4404-8826-93f15dc7b948 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.884647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9ab3579-b9ff-4404-8826-93f15dc7b948 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:17.935612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:17.952500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e9a1489-e85b-4342-9b4e-dc09bbeccec2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.832550 Aug 30 18:13:17.954422 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 418/776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:17.965984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:17.971846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:17.989167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.989687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.990137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:17.990917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:17.991377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:17.991812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.027085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9ab3579-b9ff-4404-8826-93f15dc7b948 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:18.038808 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9ab3579-b9ff-4404-8826-93f15dc7b948 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1224 microversion: 2.1 time: 0.170938 Aug 30 18:13:18.039406 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 359/777] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1224 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:18.058613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.077281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:18.078267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Searching by: {'deleted': False, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:18.086940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.088869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.089805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.090774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.091482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.092184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.093334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.094326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lazy-loading 'fault' on Instance uuid 4c10ec3d-b549-4702-b3b2-690895e6e0b2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:18.098442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.099270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.168498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:18.222882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:18.274128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df87289f-31d2-4337-a9de-cf4e8a145929 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1303 microversion: 2.1 time: 0.316468 Aug 30 18:13:18.290109 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 419/778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:17 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1303 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:18.295704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c10ec3d-b549-4702-b3b2-690895e6e0b2", "name": "network-vif-deleted", "tag": "709ed21a-277e-4a5a-8e7a-b4458c89eb77"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:18.318014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a86d7533-6806-48ec-a6bf-57c5ad06e3d8 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.249488 Aug 30 18:13:18.321830 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 360/779] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:13:18 2022] GET /compute/v2.1/servers => generated 683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:18.340878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0995faf2-943b-4d05-bd21-5e03bab4e1f2", "tag": "ec4484bb-9771-4814-afda-e3b077dcf3f1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:18.359392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.360273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.361280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.401217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.402189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.403054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.413333 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] Creating event network-vif-deleted:709ed21a-277e-4a5a-8e7a-b4458c89eb77 for instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 on n-h2-854119-10 Aug 30 18:13:18.435594 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-698f26e2-9f87-4b1a-9c0f-a8c258fafc06 req-492e16c8-541f-453e-80be-1fb3243b4d97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156181 Aug 30 18:13:18.436916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 420/780] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:18.459900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.460858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:18.462703 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] Creating event network-changed:ec4484bb-9771-4814-afda-e3b077dcf3f1 for instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 on n-h2-854119-10 Aug 30 18:13:18.470428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.471232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.471824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.472909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.473529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.474391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.491063 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6c803446-a11f-4ef6-bdf5-71921f486cc9 req-8dd8f876-68c3-4884-adc1-853ac458299e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166570 Aug 30 18:13:18.497189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 361/781] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:18.518008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.522861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] HTTP exception thrown: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:18.529449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 HTTP/1.1 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '147f0d87-0e99-4ff4-b460-91a1ec4884b5'} Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:18.542297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 404 to user: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb4b309d-79d8-4289-9744-755b20962c02 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "DELETE /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 404 len: 111 microversion: 2.1 time: 0.105217 Aug 30 18:13:18.557190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 421/782] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:18 2022] DELETE /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:18.561131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.561131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:18.573807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.585232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.587643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.588536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.589343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.590560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.591240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.592228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.592684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.595234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.596413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.597740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.670861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:18.795140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:18.825382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a15aa5b5-4e21-4eaa-ae6d-aa6ea4d480ce tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 204 len: 0 microversion: 2.1 time: 0.271779 Aug 30 18:13:18.827112 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 422/783] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:18 2022] DELETE /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:18.844040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:18.845774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:18.863334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.865593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.866593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.868002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:18.868935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:18.869739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:18.932328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:19.149759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7945d0a3-e139-4cf4-97e3-2590f6bb1647 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 204 len: 0 microversion: 2.1 time: 0.314877 Aug 30 18:13:19.155047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 423/784] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:18 2022] DELETE /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:13:19.180645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.182591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.193144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.194040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.194950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.196147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.197008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.197785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.203094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:19.204826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:19.247216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:19.253368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:19.258108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47487c53-33b5-466f-a5d1-2e93617fb301 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.757540 Aug 30 18:13:19.262616 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 362/785] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:18 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:19.273433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.276518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.293788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.295866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.297134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.299185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.303265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.304717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.564254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:19.583577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6823c77f-ce77-4e32-aeda-f5ff6b5cf64c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 0.425421 Aug 30 18:13:19.599682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 424/786] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:19.631145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.632202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.654646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.654646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.654646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.654646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.655043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.655631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.781363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:19.800614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a16a875f-a8b0-4a33-9ea4-efcb8d118129 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1276 microversion: 2.1 time: 0.198204 Aug 30 18:13:19.801947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 425/787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:19.812044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.813102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 147f0d87-0e99-4ff4-b460-91a1ec4884b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.822024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.822726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.823269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.824229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.824797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.825332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.842803 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] HTTP exception thrown: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 HTTP/1.1 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '147f0d87-0e99-4ff4-b460-91a1ec4884b5'} Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.845487 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:19.850211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 404 to user: Instance 147f0d87-0e99-4ff4-b460-91a1ec4884b5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:19.851921 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d45ef49-47ee-4d18-a7b2-2cb54b462982 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5" status: 404 len: 111 microversion: 2.1 time: 0.048078 Aug 30 18:13:19.855717 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 426/788] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/147f0d87-0e99-4ff4-b460-91a1ec4884b5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:19.858405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:19.859168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:19.872960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.873642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.874217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.875508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.876119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.876817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.918521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:19.919400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:19.920020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:19.920644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lazy-loading 'fault' on Instance uuid 4c10ec3d-b549-4702-b3b2-690895e6e0b2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:19.999526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a477f203e64612a8c6edd6b84df009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab49ebea7cba46b39ce1d1645e03510d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.008866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a13d6a2d-f9ac-4b49-8d29-0faa1ae9f3f9 tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 200 len: 1303 microversion: 2.1 time: 0.155060 Aug 30 18:13:20.023514 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 427/789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:20.029976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:20.030839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:20.037715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.038615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.039237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.040165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.040807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.041395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.092586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.107309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6554e77-40fa-4ed5-9fa4-da45a3f7e466 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.842183 Aug 30 18:13:20.109902 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 363/790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:19 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:20.289530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.303109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:20.304089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:20.318779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.319426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.319961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.320808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.321352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.321871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.327216 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e975cf14-fcf8-4540-94d9-40932504020d tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 200 len: 1522 microversion: 2.1 time: 0.302050 Aug 30 18:13:20.330207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 428/791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:20 2022] GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:20.525223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.547658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.550828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.563257 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-94fb60e6-8665-4ec1-ab1b-5bc3df1aea6e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.265129 Aug 30 18:13:20.564318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 364/792] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:20 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:13:20.630763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:20.632110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:20.644112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.644973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.645743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.646839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.647356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.648025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.724634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07317ac0-9deb-4c18-820c-6582f4fe9a80", "tag": "ceeb1086-155a-49f1-b606-3b792d472871"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:20.769778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.773293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.775582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.829188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] Creating event network-changed:ceeb1086-155a-49f1-b606-3b792d472871 for instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 on n-h2-854119-10 Aug 30 18:13:20.841041 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9fef07d1-c1e2-4431-b490-8afbdc26b7d6 req-5edf30a4-2ef8-429d-bdbf-4c3800ecd32b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122261 Aug 30 18:13:20.843753 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 365/793] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:20.856145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:20.860889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:20.885781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.888422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.894805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.897408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:20.898603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:20.899686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:20.953001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:20.978306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4977401c-adda-486c-b176-66adfca385e5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131981 Aug 30 18:13:20.989688 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 366/794] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:13:20 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:20.996640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-76e85eb7-3c20-4993-adf9-2b079f993b35 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 0.373916 Aug 30 18:13:21.002656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.003484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.012963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.013463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.013900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.014657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.016487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.016919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.017726 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 429/795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:20 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:21.057535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.063757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] [instance: 4c10ec3d-b549-4702-b3b2-690895e6e0b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.083942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.084796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.085551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.086855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.087674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.088380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.122859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] HTTP exception thrown: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Request method failure captured: Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 HTTP/1.1 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMMFdnajXs95s3eF5wvM6AME7LVs7HO9q16k4t6JA0BeRmfwVttNKV32WzbZnw6HDRqZ9M5Lrti6-nYaxunSQUhawl0mEikeznjNBVHIspBDCJW7p6we4V1C1HQGsLaawek4M-MOaTEsqr-WXp2LetkIk0vaFX2Xpod7Nz09rm0Tu8 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ab49ebea7cba46b39ce1d1645e03510d Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TenantUsagesTestJSON-1496036583 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab49ebea7cba46b39ce1d1645e03510d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ab49ebea7cba46b39ce1d1645e03510d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ab49ebea7cba46b39ce1d1645e03510d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ab49ebea7cba46b39ce1d1645e03510d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TenantUsagesTestJSON-1496036583 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ab49ebea7cba46b39ce1d1645e03510d Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1496036583 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TenantUsagesTestJSON-1496036583-project Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b8a477f203e64612a8c6edd6b84df009 Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TenantUsagesTestJSON-1496036583-project Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4c10ec3d-b549-4702-b3b2-690895e6e0b2'} Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:21.131278 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] Returning 404 to user: Instance 4c10ec3d-b549-4702-b3b2-690895e6e0b2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:21.146792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64ffd200-6642-4c43-a630-eaf4d48ddd2f tempest-TenantUsagesTestJSON-1496036583 tempest-TenantUsagesTestJSON-1496036583-project] 10.222.0.25 "GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2" status: 404 len: 111 microversion: 2.1 time: 0.117855 Aug 30 18:13:21.149931 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 430/796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:21 2022] GET /compute/v2.1/servers/4c10ec3d-b549-4702-b3b2-690895e6e0b2 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:21.161175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.162228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.175857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.176789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.177895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.179818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.180626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.181385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.317892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:21.343676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa39983e-f91b-47a1-aa70-1a70dd6908ee tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1276 microversion: 2.1 time: 0.355290 Aug 30 18:13:21.345841 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 367/797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:20 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:21.364913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.373241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.390473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.391824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.392909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.394330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.395328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.396219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.463603 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97e6a510-b163-4aff-8066-090fd8f0fc07 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114944 Aug 30 18:13:21.474811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 368/798] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:13:21 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:21.484394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.485488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.500997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.502188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.503448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.504841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.505845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.506631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.719246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:21.755486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5dc23d43-5834-47f8-87cc-17119ed242a3 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 200 len: 1522 microversion: 2.1 time: 0.261437 Aug 30 18:13:21.763796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:21.766931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 369/799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:21 2022] GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:21.790817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c381856-0d0c-409e-8f77-016e8686fc02 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.638331 Aug 30 18:13:21.797734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.801435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.814924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.816358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.817384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.819006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.819902 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 431/800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:21 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:21.820320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.821334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.828239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:21.829248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:21.875519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.876229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.877007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.878248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:21.879073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:21.879801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:21.882926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:22.062539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5e3aa0a-f615-4057-a358-42b4447b86a6 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 204 len: 0 microversion: 2.1 time: 0.292968 Aug 30 18:13:22.064684 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 370/801] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:21 2022] DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:22.076666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:22.078528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:22.092488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.093830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.095069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.096662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.097751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.098755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.544763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:22.563320 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f586a460-a5f9-482d-8fe4-2dd13e3cf020 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 0.494379 Aug 30 18:13:22.564999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 371/802] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:22 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:22.574263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:22.575480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:22.587006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.587941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.589741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.589999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.590928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.591778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.855889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:22.864924 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdb518f0-a032-4c64-81f7-78deca6889b1 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1679 microversion: 2.1 time: 0.297658 Aug 30 18:13:22.869720 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 372/803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:22 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1679 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:22.879814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f553a3ea-a776-4f55-8118-46fa32db023f", "name": "network-vif-plugged", "status": "completed", "tag": "787937b9-94c5-4ff4-818d-fc551cf8251e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:22.890815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.891291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.891715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.904603 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] Creating event network-vif-plugged:787937b9-94c5-4ff4-818d-fc551cf8251e for instance f553a3ea-a776-4f55-8118-46fa32db023f on n-h1-854119-10 Aug 30 18:13:22.909841 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2dbcb360-e501-4852-affa-9c5548f399cd req-a8318028-d82d-4ba8-9786-be947fa82ada service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041232 Aug 30 18:13:22.910481 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 373/804] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:22.918284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:22.919317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:22.927939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.928432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.928871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.929600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:22.930058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:22.930516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:22.938474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:22.955829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:22.959181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:22.961316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a3870b82-9f5c-4aea-b618-019ffd9e690d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 1.139672 Aug 30 18:13:22.973899 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 432/805] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:21 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:22.989431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:22.991064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:23.003299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.004202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.004970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.006244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.006748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:23.007089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.007857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.011213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:23.025434 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ed045cb-4591-4215-ac79-b2871f526016 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1282 microversion: 2.1 time: 0.112332 Aug 30 18:13:23.038387 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 374/806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:22 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:23.041121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:23.042389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:23.055463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.056296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.056740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.057483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.058040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.059490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.389952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:23.398716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3025460c-646c-4930-b5d3-d1ff8651fe21 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.362568 Aug 30 18:13:23.399951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 375/807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:23 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:23.466920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd77523-d660-421c-8e81-c8111d0cf124", "name": "network-vif-deleted", "tag": "79b3e363-4327-4433-b3d8-bc0fdaa244c0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:23.504063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.505311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.512266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.555896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:23.570688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] Creating event network-vif-deleted:79b3e363-4327-4433-b3d8-bc0fdaa244c0 for instance ffd77523-d660-421c-8e81-c8111d0cf124 on n-h1-854119-10 Aug 30 18:13:23.582666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4d6f13cc-9bb5-4ed2-97de-06b2d4aa334b req-9bd66ed2-57fc-4797-ad9d-57d46dcfa017 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131135 Aug 30 18:13:23.584666 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 376/808] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:13:23.598240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e47689a-0106-4e27-a9cd-5d65cb67c4dd tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 200 len: 1522 microversion: 2.1 time: 0.621831 Aug 30 18:13:23.625621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:23.627183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:23.635344 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 433/809] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:22 2022] GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:23.673756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.678108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.684834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.690197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.691488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.692577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.894496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:23.895609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:23.920596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.932696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.934494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:23.936107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:23.937195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:23.938283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:24.588988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:24.614184 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cbde89d6-e0fd-42cc-8967-584d62be3ca9 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1679 microversion: 2.1 time: 0.729379 Aug 30 18:13:24.615359 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 434/810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:23 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1679 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:24.634707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:24.635389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:24.642147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:24.642689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:24.643133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:24.643870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:24.644326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:24.644980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:24.751458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:24.766615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4c70727-62db-4d21-bc81-e27e0ab93bc7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1313 microversion: 2.1 time: 1.179736 Aug 30 18:13:24.768373 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 377/811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:23 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:24.780532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:24.782703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:24.797425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:24.798190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:24.799424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:24.800628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:24.801323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:24.801878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.030817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:25.046883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:25.094405 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4aa28b2-27df-44e5-957c-2bd31c7f03df tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1282 microversion: 2.1 time: 0.316348 Aug 30 18:13:25.098064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:25.098778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 378/812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:24 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:25.107554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:25.115418 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7ac14c3-f227-4f9a-9096-38abb4468fe0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.494114 Aug 30 18:13:25.121684 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 435/813] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:24 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:25.130569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:25.137386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:25.158876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:25.161323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: 4f55551b-c118-4844-b868-95b16d9b1918] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:25.172062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.178035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.180597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.183586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.185050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.186699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.187402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.188147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.189162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.191022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.192114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.193109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.229069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] HTTP exception thrown: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 HTTP/1.1 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4f55551b-c118-4844-b868-95b16d9b1918'} Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:25.248984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. Aug 30 18:13:25.257603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:25.263475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 404 to user: Instance 4f55551b-c118-4844-b868-95b16d9b1918 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:25.265648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18c7687c-fd30-493b-9b6c-e32995203548 tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918" status: 404 len: 111 microversion: 2.1 time: 0.138141 Aug 30 18:13:25.266890 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 436/814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:25 2022] GET /compute/v2.1/servers/4f55551b-c118-4844-b868-95b16d9b1918 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:25.282244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:25.284180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:25.294391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.295331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.296057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.297286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.298190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.299019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.380558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.381441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.382209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.383011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lazy-loading 'fault' on Instance uuid ffd77523-d660-421c-8e81-c8111d0cf124 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:25.482385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd36bacd1987c4cfe960a8bb71e4931f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954ea457e2944682bb2c5cd324dbbaf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:25.509855 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb43a294-1683-47ae-9814-449195ecf0fe tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 200 len: 1313 microversion: 2.1 time: 0.236455 Aug 30 18:13:25.524568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 437/815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:25 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:25.642419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:25.643593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:25.701919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.703109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.710703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:25.719043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:25.721858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:25.722705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:26.646185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:26.720227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee575f3c-65e5-413d-b8fc-dc88a6b9fcbd tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 1.618094 Aug 30 18:13:26.722544 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 379/816] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:25 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:26.737875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f55551b-c118-4844-b868-95b16d9b1918", "name": "network-vif-deleted", "tag": "c0c0be00-b48f-4bf6-82f4-2dc3d99936bd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:26.775767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:26.776272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:26.782861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:26.810080 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] Creating event network-vif-deleted:c0c0be00-b48f-4bf6-82f4-2dc3d99936bd for instance 4f55551b-c118-4844-b868-95b16d9b1918 on n-h2-854119-10 Aug 30 18:13:26.817155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:26.825372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ea46ad44-a7d5-4f47-9ce1-be3efd4708e7 req-90c8adee-8465-436c-a327-c711ca2d6616 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096931 Aug 30 18:13:26.830748 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 380/817] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:26.831822 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8471a308-3636-497b-9b13-9a0ecdad4273 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1679 microversion: 2.1 time: 1.197911 Aug 30 18:13:26.843994 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 438/818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:25 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1679 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:26.845678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:26.849941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:26.865208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:26.866249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:26.867596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:26.868476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:26.870630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:26.871772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:26.873589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:26.874581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:26.893472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:26.905066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:26.905766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:26.907452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:26.909212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:26.910830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.028332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:27.029919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:27.353980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:27.367290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a4993c4-7e8a-4352-b9c1-292b586e3319 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.521144 Aug 30 18:13:27.369569 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 439/819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:26 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:27.384593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:27.385357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:27.403387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.405676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.407509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.410376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.412529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.413749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.730535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:27.749337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:27.755005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:27.756879 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f59ed47-46f1-45de-b1f4-154df562ed70 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.384713 Aug 30 18:13:27.758313 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 440/820] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:27 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:27.765498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:27.766931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] [instance: ffd77523-d660-421c-8e81-c8111d0cf124] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:27.780559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.781920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.782884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.783927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.784671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.785350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.806253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] HTTP exception thrown: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Request method failure captured: Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 HTTP/1.1 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMAv67pzw7kd47tTTU82_tczWfz3XzdH-fjC6GWMjSmMYEQXE1IKLYgClAmvQs72qK86JqeNB0znGNA0tYS99yNaZOa80T_3Xjb56buVj8FV9uBykYPLdyJz-KKPLdpeidlg1h5qt4nyV9GYgshNUlZmTVS6RMnXq2RhS4hr5A9VZk Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_954ea457e2944682bb2c5cd324dbbaf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 954ea457e2944682bb2c5cd324dbbaf6 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-473114522 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d36bacd1987c4cfe960a8bb71e4931f6 Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServersNegativeTestJSON-473114522-project Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ffd77523-d660-421c-8e81-c8111d0cf124'} Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:27.808844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. Aug 30 18:13:27.812962 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:27.815728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] Returning 404 to user: Instance ffd77523-d660-421c-8e81-c8111d0cf124 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:27.817069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a17c53e3-2108-4fbc-a8ac-ed3bb3e83efb tempest-ListServersNegativeTestJSON-473114522 tempest-ListServersNegativeTestJSON-473114522-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124" status: 404 len: 111 microversion: 2.1 time: 0.057362 Aug 30 18:13:27.823177 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 441/821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:27 2022] GET /compute/v2.1/servers/ffd77523-d660-421c-8e81-c8111d0cf124 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:27.832780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c745e1-8abe-4a92-b2ab-0c93734e7503", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:27.833640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:27.849167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.850086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.850978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.875509 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] Creating event network-vif-unplugged:0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8 for instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 on n-h1-854119-10 Aug 30 18:13:27.878530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c193a27-b102-4709-b856-fdabee506644 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1462 microversion: 2.1 time: 1.044209 Aug 30 18:13:27.888962 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0ae56a6b-c8d0-4635-840d-7474ff5fa619 req-16c20577-3232-4f0e-8838-1c0608aff97c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061164 Aug 30 18:13:27.890646 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 442/822] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:27.898597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 381/823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:26 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1462 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:27.913602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:27.920149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:27.921714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:27.931754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:27.936887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.939062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.940386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.941901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.942532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.942993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.943145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.943467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.944253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:27.944682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.955391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:27.956029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:27.984892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:28.036519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:28.124369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=20 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:28.470866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:28.493921 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e9dcaa7-0648-4617-96a6-d71624f69e2a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.601053 Aug 30 18:13:28.494808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 443/824] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:27 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:28.614460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:28.644586 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f8dda3a0-1d11-4a4f-aeda-97e957947db0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1679 microversion: 2.1 time: 0.743213 Aug 30 18:13:28.675174 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 382/825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:27 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1679 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:28.695846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:28.696497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:28.703944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.704458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.704905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:28.705680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.706155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.706629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:28.920687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:28.940652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'deleted': False, 'project_id': 'ff745397b0c7427d88ca9d4d076bc35b'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:28.954307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.955795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.956682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:28.958116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:28.959281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:28.960533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.229298 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-16df8e32-3c33-4fae-8147-e9fd32853653 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.732420 Aug 30 18:13:29.231230 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 444/826] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:13:28 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:29.259314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:29.261179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:29.279916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.280935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.282042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.283532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.284694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.285689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.620932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:29.624490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:29.638705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:29.640321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:29.641553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e4d1297-1b48-4fe5-8219-ca7f31f4ad1e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.408933 Aug 30 18:13:29.645898 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-789d89aa-f8a4-43de-89ae-c404439c1e9f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.968962 Aug 30 18:13:29.663199 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 445/827] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:29 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:29.663509 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 383/828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:28 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:29.675136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566744c6-79e2-421c-8020-0d662f154579", "tag": "f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:29.693657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:29.710178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.711053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.714393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'deleted': False} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:29.719472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.733759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.734960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.735891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.737585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.738308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.740473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.757610 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] Creating event network-changed:f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a for instance 566744c6-79e2-421c-8020-0d662f154579 on n-h2-854119-10 Aug 30 18:13:29.784335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-df0fe1c1-6d26-467b-b953-078123bbd408 req-96249514-2ff7-4e39-97c8-bee220937e50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118839 Aug 30 18:13:29.790938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 446/829] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:29.812702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:29.819184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:29.850625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.851214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.851659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.852415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:29.852883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:29.853314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:29.891413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:30.053536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.054860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.055837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.720701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:30.739535 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13ee517a-909f-4e25-8b46-e98b78e7111e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.944732 Aug 30 18:13:30.740491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 447/830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:29 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:30.746054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:30.755337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:30.765609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.766170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.766653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.767438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:30.771202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:30.771930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:30.937689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46366931fc5b4f07870c34a86c97b518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a09f1cb6404d30b4871a5165ab7f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:30.947537 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d86b3721-45b7-453c-86d4-8f0e86aac7a5 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 200 len: 1611 microversion: 2.1 time: 0.205728 Aug 30 18:13:30.966881 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 448/831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:30 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 1611 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:30.982074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317ac0-9deb-4c18-820c-6582f4fe9a80", "name": "network-vif-plugged", "status": "completed", "tag": "ceeb1086-155a-49f1-b606-3b792d472871"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:31.008705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.009530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.010187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.035603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] Creating event network-vif-plugged:ceeb1086-155a-49f1-b606-3b792d472871 for instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 on n-h2-854119-10 Aug 30 18:13:31.053410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c0c6ca6e-7a32-40a8-8893-d51a79e0b42d req-bf4604cb-0248-4c7f-829e-7c4fcea43da2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084935 Aug 30 18:13:31.054785 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 449/832] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:31.064570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:31.068268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:31.086909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.087851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.088808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.090417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.091164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.091974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.717851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:31.736979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:31.741877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:31.747189 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3dca7e2-5d61-4b8b-92b3-4b7d7d1892dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1566 microversion: 2.25 time: 0.690848 Aug 30 18:13:31.752999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 450/833] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:31 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1566 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:31.763557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:31.764766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:31.822377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.830918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.831561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.840580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:31.841411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:31.845049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:31.924556 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eee53512-3b67-4405-9188-f53ba7e158d8 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13034 microversion: 2.1 time: 2.240395 Aug 30 18:13:31.925322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 384/834] 10.222.0.25 () {58 vars in 1171 bytes} [Tue Aug 30 18:13:29 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13034 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:13:31.949560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c745e1-8abe-4a92-b2ab-0c93734e7503", "name": "network-vif-deleted", "tag": "0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:32.023705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.027725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.028423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.066392 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] Creating event network-vif-deleted:0c8fde86-7d65-44f7-9f1a-b26bcdd0bee8 for instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 on n-h1-854119-10 Aug 30 18:13:32.077504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-89c23c6a-feca-47aa-98f6-2567988b61d9 req-3414d2a3-66bf-4fdd-801b-527900381893 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150796 Aug 30 18:13:32.082326 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 385/835] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:32.092658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.098191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:32.113261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.113771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.117651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.120298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.120812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.121263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.419158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:32.436063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3302200d-c097-4bdf-87b7-b39f76424328 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.681006 Aug 30 18:13:32.437052 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 451/836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:31 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:32.447580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.454421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:32.472512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.473672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.474895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.479136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.480196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.481276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.559189 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] HTTP exception thrown: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Request method failure captured: Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 HTTP/1.1 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJ0Wf4JNJNwFCgH2xFcNbPuPDmpE5jx7jgMApsdHGdC00gbxgtTIjGPQKaw7kNVD1gVkqs5vcfFC3ztjY8xlMDTx3NJ8bSVaeHESSglWnT33ucBo1azrrHO8JDHnlaORffcnQWf0ty1btMApHBMNZOaoaKjYEqy3XDzWlt_CwTKaBQ Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 46366931fc5b4f07870c34a86c97b518 Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f6c745e1-8abe-4a92-b2ab-0c93734e7503'} Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:32.564628 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:32.568713 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:32.571225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Returning 404 to user: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:32.573388 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56a7736f-66a9-4111-99fb-a3d9d6d666d0 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 404 len: 111 microversion: 2.1 time: 0.134249 Aug 30 18:13:32.575974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 452/837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:32.591163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.601568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'deleted': False, 'project_id': 'ff745397b0c7427d88ca9d4d076bc35b'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:32.617924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.618651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.619204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.620215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.621019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.621552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.695377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-159d4832-4cab-4f07-a0af-160848c18803 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=57839407595a483c9ffcb2d9e405e068" status: 200 len: 15 microversion: 2.1 time: 0.112774 Aug 30 18:13:32.700046 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 453/838] 10.222.0.25 () {58 vars in 1231 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/detail?tenant_id=57839407595a483c9ffcb2d9e405e068 => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:32.713336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-697183af-2424-4aeb-858b-517ea2ae05f4 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '.version_select at 0x7f4e57573160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.760655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-697183af-2424-4aeb-858b-517ea2ae05f4 tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7390554" status: 202 len: 0 microversion: 2.1 time: 0.058698 Aug 30 18:13:32.765696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 454/839] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Aug 30 18:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7390554 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:32.772242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.805551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'tenant_id': '57839407595a483c9ffcb2d9e405e068', 'deleted': False} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:32.811871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.812430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.812876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.813642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.814651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.815094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.857183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:32.872985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecf9fd83-81a3-4931-9598-645b8aacd9b3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1317 microversion: 2.1 time: 0.787235 Aug 30 18:13:32.874003 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 386/840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:32.885472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:32.889095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:32.903325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:32.904557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.907357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.909619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:32.910907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:32.914281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:32.914992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.157805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.158443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.158900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.533147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:33.558324 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3020d174-d783-44de-8ee9-dfa8470d1f40 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=57839407595a483c9ffcb2d9e405e068" status: 200 len: 4832 microversion: 2.1 time: 0.790513 Aug 30 18:13:33.559796 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 455/841] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=57839407595a483c9ffcb2d9e405e068 => generated 4832 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:33.565795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:33.567650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:33.590435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.592823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.594071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:33.595300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.596887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:33.598430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.598765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb30c02f-5cc5-4f00-a80c-97498958a90f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1556 microversion: 2.25 time: 0.723274 Aug 30 18:13:33.600206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 387/842] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:32 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1556 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:33.601582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.604126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.610637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:33.632900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'tenant_id': 'ff745397b0c7427d88ca9d4d076bc35b', 'deleted': False} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:33.644350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:33.661429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.664272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.666101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.670674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.671415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.672037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.754938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5673349f-57cb-44e2-a9bd-f9635bf521f3 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ff745397b0c7427d88ca9d4d076bc35b" status: 200 len: 15 microversion: 2.1 time: 0.153311 Aug 30 18:13:33.755769 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 388/843] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:13:33 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ff745397b0c7427d88ca9d4d076bc35b => generated 15 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:33.780915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0a554b8-34ae-43fd-9101-3c968d3efee0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '.version_select at 0x7f4e56c053a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:33.784623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a554b8-34ae-43fd-9101-3c968d3efee0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.785119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a554b8-34ae-43fd-9101-3c968d3efee0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.785565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a554b8-34ae-43fd-9101-3c968d3efee0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.851798 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0a554b8-34ae-43fd-9101-3c968d3efee0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.077940 Aug 30 18:13:33.854468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 389/844] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Aug 30 18:13:33 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:13:33.870604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b03b6af4-6c85-4948-ae41-6ea53bd08d12 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:33.897161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b03b6af4-6c85-4948-ae41-6ea53bd08d12 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.039767 Aug 30 18:13:33.900441 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 390/845] 10.222.0.25 () {58 vars in 1189 bytes} [Tue Aug 30 18:13:33 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:13:33.937490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:33.943360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:33.961180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.962892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.964528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:33.967672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:33.972622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:33.975167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.168926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:34.178413 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-570550c1-1c6c-473c-b5b5-4f8ef8edb7fa tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.617039 Aug 30 18:13:34.182238 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 456/846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:33 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:34.193830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:34.196955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:34.211112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.214935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.215736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.216731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.217385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.218011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.585023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 0995faf2-943b-4d05-bd21-5e03bab4e1f2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:34.620345 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-276383a6-05f6-4759-b33a-3a2de93a51ab tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 2050 microversion: 2.25 time: 0.717254 Aug 30 18:13:34.630802 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 391/847] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:33 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 2050 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:34.637363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:34.640454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:34.656833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.657275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.657737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.660632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.664516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.665334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.830446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:34.865700 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ddda403-59f5-43d9-9b87-0e27ce275baf tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1507 microversion: 2.1 time: 0.677232 Aug 30 18:13:34.867464 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 457/848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:34 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1507 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:34.897872 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-486ac99e-dda9-474c-9ebd-dec94384fae7 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 0 microversion: 2.1 time: 0.268134 Aug 30 18:13:34.904740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 392/849] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:34 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:34.913861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:34.917101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:34.919051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:34.937321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:34.938105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '57839407595a483c9ffcb2d9e405e068'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:34.948984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.953357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.955017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.955863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.956674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.956896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.957725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.959095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:34.960240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.966227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:34.966823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:34.967661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:35.135346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:35.182022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:35.286973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-df04cf1e-bc16-4117-9bfa-5be022e71cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.380232 Aug 30 18:13:35.288457 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 393/850] 10.222.0.25 () {58 vars in 1150 bytes} [Tue Aug 30 18:13:34 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:35.300367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-964390268", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "2a276390-21e3-480e-8639-5bd55ca03773"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:35.420393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] validate_networks() for [('2a276390-21e3-480e-8639-5bd55ca03773', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:35.528148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:35.551968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e8e889d-bf94-4556-b51b-6d48b0925926 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1507 microversion: 2.1 time: 0.647971 Aug 30 18:13:35.557734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 458/851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:34 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:35.569066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566744c6-79e2-421c-8020-0d662f154579", "name": "network-vif-plugged", "status": "completed", "tag": "f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:35.610445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:35.617864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:35.620299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:35.667466 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] Creating event network-vif-plugged:f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a for instance 566744c6-79e2-421c-8020-0d662f154579 on n-h2-854119-10 Aug 30 18:13:35.686169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-19d72368-9763-4f6f-aaa4-93a7edbcfd15 req-1492945e-39af-4562-91ae-ab5ef0bce647 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120519 Aug 30 18:13:35.691781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 459/852] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:35.703652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:35.705370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:35.732893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:35.735997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:35.741006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:35.744389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:35.746581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:35.752175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.170495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:36.198926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5360e95a-b1ce-49c3-8aa7-08b4f237eb4b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.497030 Aug 30 18:13:36.201831 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 460/853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:35 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:36.218471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:36.226956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:36.265171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.266063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.266872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.268716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.269568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.270384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.497655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e9e67ba-d7ed-4350-942c-405071bd5760 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 0 microversion: 2.1 time: 0.293624 Aug 30 18:13:36.499059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 461/854] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:36 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:36.508376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:36.522851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:36.525188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:36.542526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.543349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.543598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.544334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.544772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.545184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.699516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:36.708369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:36.708796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:36.709269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:36.709670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:36.710076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:36.860235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:36.884084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.884589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.885042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.885914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.886395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.886845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.928625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-faeb1852-7fd0-491e-bd6c-58786c42e02b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "POST /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80/action" status: 202 len: 1109 microversion: 2.1 time: 0.428132 Aug 30 18:13:36.930036 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 462/855] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:36 2022] POST /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80/action => generated 1109 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 18:13:36.935237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:36.936156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:36.942914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.943706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.944293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:36.945199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:36.945813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:36.946424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.263891 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4cf0bfb-b64f-495e-b49f-50abc5f0d90b tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1617 microversion: 2.1 time: 0.330118 Aug 30 18:13:37.265244 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 463/856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:36 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1617 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:37.285634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:37.294728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:37.314930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.316300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.319713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.321417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.322730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.324331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.725307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:37.726097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:37.727245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:37.728696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:37.729746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:37.766988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.772517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.773970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.775972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.782792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.783941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.824941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:37.831354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for user 6774c9dbc6b44018a09893dabeee643a and project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:37.848530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:37.851389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:37.914753 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7633287a-abaf-4ddb-ba49-be0a45109980 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.624577 Aug 30 18:13:37.916207 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 394/857] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:13:37.926596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:37.928040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:37.936150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.937337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.937971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:37.939086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:37.939737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:37.940351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:38.359267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:38.401450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5accfdbe-7fad-42af-bdb4-1461a951104e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1324 microversion: 2.1 time: 0.475964 Aug 30 18:13:38.420083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 395/858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:37 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:38.455982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:38.457511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:38.482284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:38.485405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:38.487407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:38.490010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:38.494974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:38.496135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:38.755201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:38.779477 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-112c3011-71a9-4028-af37-6f21976119a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 1.508855 Aug 30 18:13:38.782229 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 464/859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:37 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:38.796209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:38.797914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:39.024519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:39.035253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:39.047409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:39.048607 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3187e4fa-3f14-46a6-bcaa-613c5451d61c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1261 microversion: 2.25 time: 0.263517 Aug 30 18:13:39.066781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 465/860] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:38 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1261 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:39.237764 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c306f3e-566a-4e5c-8894-b689e3cc3b2d tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1617 microversion: 2.1 time: 0.803373 Aug 30 18:13:39.250404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 396/861] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:38 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1617 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:39.282029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:39.294495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'host': 'n-h1-854119-10', 'deleted': False} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:39.312395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.319947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.320920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.322483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.323563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.324544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.447433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:39.448382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:39.464413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.468122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.473910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.476046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.491187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.495106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.668099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:13:39.764971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e92bbaa-d939-461a-897f-16c681cf1037 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h1-854119-10&all_tenants=1" status: 200 len: 1338 microversion: 2.1 time: 0.490317 Aug 30 18:13:39.766014 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 466/862] 10.222.0.25 () {58 vars in 1192 bytes} [Tue Aug 30 18:13:39 2022] GET /compute/v2.1/servers?host=n-h1-854119-10&all_tenants=1 => generated 1338 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:39.782060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:39.789961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:13:39.795895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.796548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.797096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.798219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.798847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.799610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.825802 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b04bb94e-a6bb-4315-b4c9-db635d709990 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.047437 Aug 30 18:13:39.826931 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 467/863] 10.222.0.25 () {58 vars in 1196 bytes} [Tue Aug 30 18:13:39 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:13:39.834838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:39.835877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:39.844364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.845252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.846011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:39.847029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:39.847821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:39.848484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.156669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.170221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a18820a1-5776-49a4-b1e5-e2eb935900c4 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1522 microversion: 2.1 time: 0.726341 Aug 30 18:13:40.171197 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 397/864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:39 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1522 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:13:40.213858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:40.216618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:40.229742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.230927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.232252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.233319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.234031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.234798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.431824 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8a7df49c-5228-45c4-b578-ff2da23ec162 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 0 microversion: 2.1 time: 0.230537 Aug 30 18:13:40.437515 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 398/865] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:40 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:13:40.454968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:40.460751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:40.475710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.476212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.476652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.477384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.477836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.478280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.714628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.717156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.728801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.738793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:40.745967 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7f0a18d-704a-4b11-b993-22e28ed07a33 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1321 microversion: 2.25 time: 0.299117 Aug 30 18:13:40.748133 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 399/866] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:40 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:40.748894 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-170bff9f-f177-4004-af83-0415796fe799 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.910741 Aug 30 18:13:40.769369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:40.771339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 468/867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:39 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:40.778918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:40.790144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:40.804799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:40.811912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.813378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.818317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.819133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.828504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.830109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.851324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.852723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.853858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:40.855689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:40.856935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:40.857931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.252909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:41.254253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:41.255717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:41.256686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:41.258500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:41.457533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:41.503610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.504462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.505238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.510280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.511485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.512285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.673784 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a59790b9-bbed-4aa2-932f-ddf207673830 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 1068 microversion: 2.1 time: 0.900284 Aug 30 18:13:41.675348 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 469/868] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:40 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 1068 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 18:13:41.702832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:41.713486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:41.752092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.755015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.756394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:41.763421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:41.765791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:41.786124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.017816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.048265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e333c052-6563-4be7-9e6b-fe453fd90c66 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1522 microversion: 2.1 time: 1.298013 Aug 30 18:13:42.074207 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 400/869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:40 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1522 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:42.104020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:42.111378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:42.142271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.143858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.144955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.148042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.152783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.154805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.580309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.631778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.637223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.639940 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-810e3279-5161-4699-be95-e1d1555c71b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1319 microversion: 2.25 time: 0.561554 Aug 30 18:13:42.647506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 401/870] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:42 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:42.661696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:42.663129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:42.674915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.678250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.678982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.699670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.700401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.700855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.813155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:42.828173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a18f4a9a-43c0-4bd2-aca1-77a333a3ae94 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 1.134267 Aug 30 18:13:42.830701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 470/871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:41 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:42.840867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-35841327"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:42.854362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:42.876916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.877648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.880175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:42.887146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:42.887895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:42.891385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:43.132005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:43.154894 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9df669d3-6407-4688-bebb-f4db52c8130a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.505715 Aug 30 18:13:43.156524 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 402/872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:42 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:43.312449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-391864963", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "f4538093-5c5a-48b8-b165-6029db69e2b1"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:43.454983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] validate_networks() for [('f4538093-5c5a-48b8-b165-6029db69e2b1', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:43.672198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb310502-74fe-4557-948e-e35e76633abf tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579/action" status: 202 len: 0 microversion: 2.1 time: 0.837990 Aug 30 18:13:43.681282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 471/873] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:13:42 2022] POST /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:13:43.714631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:43.729970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:43.763079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:43.763914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:43.764848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:43.766600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:43.767405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:43.768109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.090078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:44.120049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:44.126275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:44.127718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b8833a8-3d77-4d5c-8277-977de56822dd tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 0.441458 Aug 30 18:13:44.128334 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 472/874] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:43 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:44.137548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72b901f7-90ce-4e8f-a43e-8816886d598d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e572ffaf0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:44.295531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:44.296274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:44.296523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:44.297217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:44.297830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:44.327792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.331919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.333297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.335593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.336928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.338678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.377192 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72b901f7-90ce-4e8f-a43e-8816886d598d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306" status: 204 len: 0 microversion: 2.1 time: 0.247666 Aug 30 18:13:44.379038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 473/875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:44 2022] DELETE /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:44.386515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:44.390086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:44.409011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.409517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.409963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.410773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.414209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.414521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Getting quotas for project f87bb886242a4732bf31db42bde24ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:44.414792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.431749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Getting quotas for user a547e08e089e4911a3035ef8416dca57 and project f87bb886242a4732bf31db42bde24ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:44.481992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:44.500187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:44.699572 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4bd09f0-ecd7-4542-9c26-f09dd081f3e2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541326 Aug 30 18:13:44.700648 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 403/876] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:44.749295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:44.756934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:44.763902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:44.814898 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd841d49-6d09-4fcc-b20b-731b9175e3b7 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.417340 Aug 30 18:13:44.815831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.820896 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 474/877] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:44 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:44.821830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.822631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.837113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:44.837970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:44.844752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:44.852614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b7273d9-063f-4058-bb4b-3f9d621b275f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e577d3d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9b7273d9-063f-4058-bb4b-3f9d621b275f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Image not found. Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b7273d9-063f-4058-bb4b-3f9d621b275f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306 HTTP/1.1 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b69dbd59-380d-43e1-a166-a9546b968306'} Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b69dbd59-380d-43e1-a166-a9546b968306 Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:13:44.962027 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b69dbd59-380d-43e1-a166-a9546b968306 could not be found. Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b7273d9-063f-4058-bb4b-3f9d621b275f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:44.971177 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b7273d9-063f-4058-bb4b-3f9d621b275f tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306" status: 404 len: 62 microversion: 2.1 time: 0.138006 Aug 30 18:13:44.978927 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 475/878] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:13:44 2022] GET /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306 => generated 62 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:13:45.007775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.008477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.035553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.037963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.042943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.046295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.047358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.049396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.107380 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] HTTP exception thrown: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Request method failure captured: Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 HTTP/1.1 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlJ0Wf4JNJNwFCgH2xFcNbPuPDmpE5jx7jgMApsdHGdC00gbxgtTIjGPQKaw7kNVD1gVkqs5vcfFC3ztjY8xlMDTx3NJ8bSVaeHESSglWnT33ucBo1azrrHO8JDHnlaORffcnQWf0ty1btMApHBMNZOaoaKjYEqy3XDzWlt_CwTKaBQ Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 46366931fc5b4f07870c34a86c97b518 Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f6c745e1-8abe-4a92-b2ab-0c93734e7503'} Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:45.112883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.117350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.121200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Returning 404 to user: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:45.123493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1335cb8-c7e2-40e4-819c-7d8b328a6f3c tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 404 len: 111 microversion: 2.1 time: 0.145557 Aug 30 18:13:45.127192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 476/879] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:44 2022] DELETE /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:45.139864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3942eba-6e1c-4181-9ce1-9a8b493ded49 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.140483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3942eba-6e1c-4181-9ce1-9a8b493ded49 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.241681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3942eba-6e1c-4181-9ce1-9a8b493ded49 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:45.253226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3942eba-6e1c-4181-9ce1-9a8b493ded49 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1223 microversion: 2.1 time: 0.117909 Aug 30 18:13:45.267811 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 477/880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:45 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:45.275075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.276882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.287091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.289840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.290533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.291640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.293281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.294442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.484726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:45.538533 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46600f3f-108f-4f62-b50a-93d57eec6d48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.825588 Aug 30 18:13:45.546180 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 404/881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:44 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:45.576817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.578266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] [instance: f6c745e1-8abe-4a92-b2ab-0c93734e7503] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.617879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.621104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.621883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.628889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.634192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.635559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.721289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] HTTP exception thrown: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Request method failure captured: Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 HTTP/1.1 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlJ0Wf4JNJNwFCgH2xFcNbPuPDmpE5jx7jgMApsdHGdC00gbxgtTIjGPQKaw7kNVD1gVkqs5vcfFC3ztjY8xlMDTx3NJ8bSVaeHESSglWnT33ucBo1azrrHO8JDHnlaORffcnQWf0ty1btMApHBMNZOaoaKjYEqy3XDzWlt_CwTKaBQ Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_97a09f1cb6404d30b4871a5165ab7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 97a09f1cb6404d30b4871a5165ab7f58 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1983704372 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 46366931fc5b4f07870c34a86c97b518 Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1983704372-project Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f6c745e1-8abe-4a92-b2ab-0c93734e7503'} Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:45.727857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. Aug 30 18:13:45.737589 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:13:45.743013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] Returning 404 to user: Instance f6c745e1-8abe-4a92-b2ab-0c93734e7503 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:45.753426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d256f9a6-2300-4144-86ee-10421a68f40a tempest-AttachSCSIVolumeTestJSON-1983704372 tempest-AttachSCSIVolumeTestJSON-1983704372-project] 10.222.0.25 "GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503" status: 404 len: 111 microversion: 2.1 time: 0.192220 Aug 30 18:13:45.754855 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 405/882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:45 2022] GET /compute/v2.1/servers/f6c745e1-8abe-4a92-b2ab-0c93734e7503 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:45.777298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:45.792470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:45.830896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.831747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.832482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:45.833609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:45.839312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:45.840328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.006988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.044606 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d7af548-ca57-4d73-b0fa-baa19ba33de7 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1540 microversion: 2.1 time: 0.774858 Aug 30 18:13:46.058091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 478/883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:45 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1540 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:46.068898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:46.070423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:46.108386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.110385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.113992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.118192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.122461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.123749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.148085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:46.443235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.471693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.506028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.511633 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f92c85ca-3ab9-45e4-bdfe-218ee50a71f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 0.741947 Aug 30 18:13:46.515278 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 406/884] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:45 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:46.537290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b48c5-5ba4-4ec3-9b6d-43841332c913", "tag": "0eca8698-165b-4ee7-a71e-96c553b7c4fc"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:46.580168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.585408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.586851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.648764 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] Creating event network-changed:0eca8698-165b-4ee7-a71e-96c553b7c4fc for instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 on n-h2-854119-10 Aug 30 18:13:46.661709 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e8862c5b-131e-4c4c-ad39-e3e031de6f4a req-5fe10d4c-dc9c-425b-98a7-d21de7665719 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142490 Aug 30 18:13:46.663452 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 407/885] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:46.703249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:46.704519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:46.739822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.740720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.741530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.751148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:46.752173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:46.752929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:46.949131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:46.966943 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b153755-abd1-499b-92ea-64bd6a8ea648 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.904171 Aug 30 18:13:46.970561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 479/886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:46 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:46.989442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:47.019041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:47.027651 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c8dace1-51e7-4915-b73b-33392485a844 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1275 microversion: 2.1 time: 0.343061 Aug 30 18:13:47.031359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:47.034322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 408/887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:46 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:47.060853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.062228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.065068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.073220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.073887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.074372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.101902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:47.102941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:47.121745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.126635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.127536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.144008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.147766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.151343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.560515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:47.572832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40b1342e-cbc3-41f4-af75-de57a92fe8ef tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.600773 Aug 30 18:13:47.576516 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 480/888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:46 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:47.587399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:47.594750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:47.624928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.630150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.634393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:47.635331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:47.635977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:47.636434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.258319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.277007 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7683295-2b38-4f2a-8682-7e79ad00aca8 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1540 microversion: 2.1 time: 1.180450 Aug 30 18:13:48.295277 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 409/889] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:47 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1540 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:48.301566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:48.307473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.322068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.322605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.323244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.323996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.324458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.324886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.583157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.603035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.610556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.612077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fca233b4-2d35-490a-8736-c7dac3f4ab9d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 1.034075 Aug 30 18:13:48.617424 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 481/890] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:47 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:48.632530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:48.633752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.652591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.655948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.656620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.658063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.660483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.666082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.901579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.921395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:48.924753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:48.936611 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ecad85a-3676-47d0-8c86-2e633fde714d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.638993 Aug 30 18:13:48.937980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 410/891] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:48 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:48.943093 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fec60518-65e9-4ac0-be05-58ef4c1613a1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1281 microversion: 2.1 time: 0.322002 Aug 30 18:13:48.949636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:48.953775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:48.957368 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 482/892] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:48 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:48.972090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566744c6-79e2-421c-8020-0d662f154579", "name": "network-vif-plugged", "status": "completed", "tag": "f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:48.972546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.973453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.974118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.976170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.979765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.980791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:48.996913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:48.997765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:48.998515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:49.037647 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] Creating event network-vif-plugged:f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a for instance 566744c6-79e2-421c-8020-0d662f154579 on n-h2-854119-10 Aug 30 18:13:49.055041 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8655bd61-3f21-4769-9698-4b6209494d97 req-6491175b-9ee6-4e0a-8910-006c40ad9626 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094689 Aug 30 18:13:49.056551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 483/893] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:49.307476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:49.309128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:49.340287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:49.346052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:49.347571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:49.348415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:49.362869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:49.363751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:49.364500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:49.365980 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c316355b-fdb0-4fbe-a77d-2a68cf5d308f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.424722 Aug 30 18:13:49.396769 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 411/894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:48 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:49.657083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:49.657706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:49.671266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:49.671763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:49.672249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:49.672943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:49.673390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:49.674006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:49.807800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:50.260486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:50.276829 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-779bf0f3-dbae-4505-b7f9-8351a2ad2a6a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1522 microversion: 2.1 time: 0.975869 Aug 30 18:13:50.291359 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 484/895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:49 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1522 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:50.317674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:50.319324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:50.331766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:50.333115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:50.334163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:50.335728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:50.336896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:50.337938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:50.890479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:50.972053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:50.995486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a2afbe6-82b0-415c-aa4c-cf5c0e145463 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.698686 Aug 30 18:13:50.996672 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 485/896] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:50 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:51.001179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:51.004749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:51.006317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:51.007673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:51.010165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-469b4347-a862-4d87-9778-06273821b75b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 1.353391 Aug 30 18:13:51.013946 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 412/897] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:49 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:51.035550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:51.046614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:51.054887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.055809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.056492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.057983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.058585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.065969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.067240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.068234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.068965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.070065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.071103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.072023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.145729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:51.315953 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88ac09d2-8ca7-4374-b26d-cdd346636b3b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 204 len: 0 microversion: 2.1 time: 0.299426 Aug 30 18:13:51.316862 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 413/898] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:51 2022] DELETE /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:51.331517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:51.333301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:51.346674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.347541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.348337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.349652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.351200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.352543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.728130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:51.745761 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-59faeefe-463c-465c-bd0c-6715a5b02fb2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.746878 Aug 30 18:13:51.747248 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 486/899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:50 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:51.765050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:51.766143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:51.785178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.787781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.788752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.789773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:51.790733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:51.791303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:51.943286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:51.960325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ac7dd51-cf01-47a8-aa47-85da3a3d1fab tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.641683 Aug 30 18:13:51.960926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 414/900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:51 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:52.034951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.036477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.055989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.056507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.056960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.058048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.061968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.062649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.208424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.223618 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b74ec600-20b0-46eb-9b7b-4c45bd371e12 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1528 microversion: 2.1 time: 0.474962 Aug 30 18:13:52.224693 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 487/901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:51 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1528 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:52.234735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.235561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.252084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.252801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.253441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.254408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.255034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.255624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.546975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.561910 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e872d1a1-9998-4e20-94c2-68c9816a81c4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.530967 Aug 30 18:13:52.562567 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 415/902] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:52 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:52.600442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.602211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.611444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.612607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.613305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.614263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.616043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.616800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.655191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:13:52.701560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.720394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.722158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:52.723792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb59e7c7-c531-4388-9919-a14251f78afe tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 0.497807 Aug 30 18:13:52.724457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 488/903] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:52 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:52.740697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566744c6-79e2-421c-8020-0d662f154579", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:52.762700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.763695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.764427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.786728 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] Creating event network-vif-unplugged:f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a for instance 566744c6-79e2-421c-8020-0d662f154579 on n-h2-854119-10 Aug 30 18:13:52.810818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b89e2372-9f26-43f9-a1af-fdac3a59e16b req-144b75e3-ea3e-4a66-84d0-108ac75aa5b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084719 Aug 30 18:13:52.811660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12351815-f2d5-4cb9-91ec-f91f0e75a9c3 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 204 len: 0 microversion: 2.1 time: 0.226157 Aug 30 18:13:52.812044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 489/904] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:52.812995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 416/905] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:13:52 2022] DELETE /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:13:52.819340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.820709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.826789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:52.828290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:52.834993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.837066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.838064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.838201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.838783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.839833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.840614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.841155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.842417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:52.843673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:52.847402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:52.848298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.235924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:53.246192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8b471c45-64b7-49e2-95ed-f1ffdc913636 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1713 microversion: 2.1 time: 0.427109 Aug 30 18:13:53.251284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 417/906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:52 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1713 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:53.265440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:53.266293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:53.276926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.277695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.278605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.279868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.281107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.282006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.502551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:53.516817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-76106941-2abf-45a6-9e5a-a0c52d50f3fd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.702625 Aug 30 18:13:53.517544 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 490/907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:52 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:53.535363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:53.536707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:53.551188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.555093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.556069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:53.557622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:53.565018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:53.566061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.002750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:54.011695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15b2d17e-a41d-4ae9-b8ce-e8e197ba194c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.759037 Aug 30 18:13:54.025600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 418/908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:53 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:54.025600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:54.025600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:54.025600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:54.026176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.026581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.027207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.028045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.028507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.028940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.369198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:54.396525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:54.447555 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-985a881c-a9e6-408b-b60e-3c590ef9666a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1528 microversion: 2.1 time: 0.927285 Aug 30 18:13:54.452390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 491/909] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:53 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1528 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:54.464649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:54.491067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:54.493410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:54.524976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.531959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.532903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.534137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.535228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.536998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.685180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:54.710554 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd309606-1bcb-4d3e-b82d-532059211e44 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.696447 Aug 30 18:13:54.714496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 419/910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:54 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:54.730919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:54.732143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:54.749202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.754850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.755716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:54.756878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:54.757769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:54.758476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.105242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.115927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.118297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.119687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01ca3a20-d417-4d45-8f49-81399ed63d58 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 0.665352 Aug 30 18:13:55.138191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 492/911] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:54 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:55.145004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:55.146561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:55.155986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:55.156837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:55.157552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.158306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:55.158843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:55.159283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.249812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:55.413754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.448718 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b8870b3-493d-4521-a84d-3b73911595a0 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1713 microversion: 2.1 time: 0.727315 Aug 30 18:13:55.463379 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 420/912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:54 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1713 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:55.477010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:55.499690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:55.501720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:55.502547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.536451 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] Creating event network-changed:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:13:55.559021 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bc187af0-b525-452e-988a-32a9c41fa12d req-684dccfb-a747-42d3-b882-ddb8c1aea3a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090251 Aug 30 18:13:55.562169 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 421/913] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:55.586443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:55.587805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:55.610280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:55.618768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:55.619623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.621046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:55.626286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:55.627211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:55.937351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:55.982689 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be735baf-d426-4ead-8619-21bf5d6c578d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.821392 Aug 30 18:13:55.983439 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 493/914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:55 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:56.034017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:56.054393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:56.066289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.067255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.068586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.069890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.070862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.072436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.203800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.206194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.209813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.210864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lazy-loading 'fault' on Instance uuid 566744c6-79e2-421c-8020-0d662f154579 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:13:56.544799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:56.568571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:56.587389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7235873d-dda1-4e44-a1d9-3663a8e02a51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 1.014331 Aug 30 18:13:56.599041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 422/915] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:55 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:56.606798 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b024b080-f1c6-4b82-a50c-06a2f6dfaac6 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 200 len: 1314 microversion: 2.1 time: 0.621574 Aug 30 18:13:56.607872 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 494/916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:55 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:56.625041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:56.627364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:56.630030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:56.630719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:56.645492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.647073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.648325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.649946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.651220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.652241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.655043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.657244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.665017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:56.667374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:56.672880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:56.679102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.150377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.160123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b903e5a-3aee-46b6-a77b-b3fc51d10380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.553536 Aug 30 18:13:57.170770 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 423/917] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:56 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:57.187422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b48c5-5ba4-4ec3-9b6d-43841332c913", "name": "network-vif-plugged", "status": "completed", "tag": "0eca8698-165b-4ee7-a71e-96c553b7c4fc"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:57.204607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.205476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.206144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.225590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] Creating event network-vif-plugged:0eca8698-165b-4ee7-a71e-96c553b7c4fc for instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 on n-h2-854119-10 Aug 30 18:13:57.232684 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-daca05f9-22c7-4f21-a44a-a54a9d7cc166 req-6aa2a1f8-91aa-4d40-b8fb-17d7e70a5273 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060094 Aug 30 18:13:57.233853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 424/918] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:57.241732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:57.242947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:57.250469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.251286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.251880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.253038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.253719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.254361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.293292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:57.437432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.464165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f185fd16-0cf1-4725-baea-fb75d616a2ce tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1645 microversion: 2.1 time: 0.228689 Aug 30 18:13:57.469153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 425/919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:57 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1645 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:57.485562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:57.488621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:57.501486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.519851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.519851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.524870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.525618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.526533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.728024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.739827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.745110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:57.746363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec0a55d6-31e0-4389-bd0d-667cf7838316 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 1.137116 Aug 30 18:13:57.774430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 495/920] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:56 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:13:57.780460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:57.781400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:57.789824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.790585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.791217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:57.792233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:57.793136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:57.795741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.034401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:58.038197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:58.066975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91dd43a1-87b0-412d-bbd5-ec1dd9fb8086 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.278841 Aug 30 18:13:58.067883 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 496/921] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:57 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:58.078312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:58.079822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:58.093306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.094651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.096964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.098649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.099774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.100855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.130052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 HTTP/1.1 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '566744c6-79e2-421c-8020-0d662f154579'} Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:58.133704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-317107d9-a2e3-4b15-8382-b3e4aec467af tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 404 len: 111 microversion: 2.1 time: 0.067197 Aug 30 18:13:58.146572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 497/922] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:58 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:13:58.155423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566744c6-79e2-421c-8020-0d662f154579", "name": "network-vif-deleted", "tag": "f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:58.166016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.166913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.169082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.230315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] Creating event network-vif-deleted:f2b4ec2f-e45d-4ae2-896e-4d9f713bc88a for instance 566744c6-79e2-421c-8020-0d662f154579 on n-h2-854119-10 Aug 30 18:13:58.243077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1481a3ae-b522-4670-b6e7-da4a6e7eeae4 req-ddab5813-4713-4a45-a57d-232e3a6de473 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099832 Aug 30 18:13:58.248635 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 498/923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:13:58.265468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:58.266307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:58.274683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.275562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.276185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.277555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.278506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.279028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.492316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:58.518090 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdb8eb0a-1df9-429b-ab15-904903712bc9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1472 microversion: 2.1 time: 0.267254 Aug 30 18:13:58.519358 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 499/924] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:58 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:58.531919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-103407934", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:13:58.662133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] validate_networks() for [('c509431d-333d-4d7e-98ce-55b83064afaa', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:13:58.666067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:58.677883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9af898ca-a4ab-43d9-8bc4-d556a56d21c2 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 1.208297 Aug 30 18:13:58.691600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 426/925] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:57 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:58.696802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:58.697851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:58.705538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.706507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.707220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.708231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.708940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.709594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.900018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:13:58.932346 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e92ad6b0-477e-4e2e-9c5a-4dfff4b67b46 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1645 microversion: 2.1 time: 0.239376 Aug 30 18:13:58.933496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 427/926] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:58 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1645 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:13:58.940396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:58.941722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:58.952673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.953505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.954295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:58.974403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:58.975169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:58.975973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.342160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:13:59.343342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:13:59.344053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:13:59.344631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:13:59.345307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:13:59.375483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.375988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.376430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.377183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.377660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.378073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.426740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:13:59.439541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Getting quotas for user 8526d208810247feaf96b54f55452d07 and project ba69efb209b4468f8d3d69cf0850c320. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:13:59.472073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:13:59.476094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:13:59.530189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:13:59.581103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-838a7810-ec83-4ca5-9e7e-f0c870dd6122 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.059695 Aug 30 18:13:59.583055 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 500/927] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:13:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:13:59.596650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:13:59.598322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:13:59.621307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.622514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.623462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:13:59.625768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:13:59.633252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:13:59.634733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:00.000202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.017635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.022388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.024203 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb391569-f84f-4844-9916-40c51ced38f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1361 microversion: 2.25 time: 1.089506 Aug 30 18:14:00.039549 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 428/928] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:13:58 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1361 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:00.046942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:00.047883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:00.056265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:00.057378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:00.058186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:00.059264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:00.059901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:00.060473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:00.209954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.225749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9107323-0787-421a-b6c2-1cbfb81f9e0f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.639292 Aug 30 18:14:00.227136 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 501/929] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:13:59 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:00.233234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d24aeac8-f5b2-4188-ba1e-3be1fdb77e2b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:00.233858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d24aeac8-f5b2-4188-ba1e-3be1fdb77e2b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:00.447252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d24aeac8-f5b2-4188-ba1e-3be1fdb77e2b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.458257 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d24aeac8-f5b2-4188-ba1e-3be1fdb77e2b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1224 microversion: 2.1 time: 0.229978 Aug 30 18:14:00.471000 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 502/930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:00 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1224 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:00.481958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:00.483474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:00.503731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:00.504689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:00.505394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:00.506664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:00.507375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:00.514088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:00.923986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:00.946671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09266495-19e0-49e3-b64b-288e842afe2c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.473391 Aug 30 18:14:00.949387 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 503/931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:00 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:00.957641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344ab242-92c2-416b-8571-f6190835c516", "name": "network-vif-deleted", "tag": "b4803740-78fe-4c7f-80ac-eac09cc341ae"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:01.008647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.015275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.017317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.045085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] Creating event network-vif-deleted:b4803740-78fe-4c7f-80ac-eac09cc341ae for instance 344ab242-92c2-416b-8571-f6190835c516 on n-h1-854119-10 Aug 30 18:14:01.068807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cddcdcd3-b7c1-441e-8327-3e5a699d2838 req-1fcc0342-c6a2-44e3-8e12-b4f8b7849cd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116260 Aug 30 18:14:01.072319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.074551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 504/932] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:01.086659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:01.087038 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b34924df-12c2-4b79-96ac-0fa7a99286d4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1490 microversion: 2.1 time: 1.043769 Aug 30 18:14:01.090707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:01.102550 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 429/933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:00 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1490 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:01.106396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.107220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.107999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.109240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.110027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.111976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.116996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:01.120990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:01.138854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.139742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.140597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.145348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.148156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.148892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.197700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.198772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.199388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.200167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lazy-loading 'fault' on Instance uuid 344ab242-92c2-416b-8571-f6190835c516 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:01.301142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87eded75e64169b15feb9cab2eec4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d8b8f4da3840bf9e7c463a785bb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.320303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37275f70-fc40-4f8b-936d-1edc01c1da8c tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 200 len: 1353 microversion: 2.1 time: 0.243613 Aug 30 18:14:01.320903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 505/934] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:01 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 1353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:01.337466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:01.340771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:01.351026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.351799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.352860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.353803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.354879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.355767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.692222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.707342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.709461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.711833 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5753c58-cb9f-4cac-ae78-c8a40d9e7c0f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1557 microversion: 2.25 time: 0.607710 Aug 30 18:14:01.713327 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 430/935] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:01 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1557 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:01.720014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:01.720939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:01.729043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.730101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.730864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.731939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:01.732787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:01.733858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:01.979798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:01.996372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7476db1-b8ff-4993-9e87-e9120aa4b481 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1220 microversion: 2.1 time: 0.281361 Aug 30 18:14:02.000833 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 431/936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:01 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1220 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:02.019387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.022995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.048585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.049368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.050083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.054478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.057328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.060537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.064704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:02.079151 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b788c9a-cd7e-416f-8cf4-2eb9e8752603 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.752809 Aug 30 18:14:02.080427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 506/937] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:01 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:02.094939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.097417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.112231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.113051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.113731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.114762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.115530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.116157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.534871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:02.562285 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ed16934-c916-4fc8-a1a7-9ce25da2742a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 2051 microversion: 2.25 time: 0.558449 Aug 30 18:14:02.564664 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 432/938] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 2051 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:02.571637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.572687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.603600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.604637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.605567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.607356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.608144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.608811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.761843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:02.773693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf483973-7e6f-4cc8-95c3-bc79388dd313 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.691236 Aug 30 18:14:02.778900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 507/939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:02.786453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.791966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.805156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.808611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.811375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.812772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.813491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.821949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.858837 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 HTTP/1.1 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '344ab242-92c2-416b-8571-f6190835c516'} Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:02.864363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:02.871846 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:02.880645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:02.882093 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b2eb3d7d-3966-4ccf-80f0-e5b2a62cad41 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 404 len: 111 microversion: 2.1 time: 0.101492 Aug 30 18:14:02.883774 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 508/940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:02.904951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:02.907028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:02.931552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.932940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.934489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:02.936313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:02.937414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:02.938575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.029624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:03.055874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3201a4a7-1d8e-49b0-8cf9-2c0d46f5f1a4 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1478 microversion: 2.1 time: 0.489100 Aug 30 18:14:03.078380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 433/941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1478 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:03.079209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.081660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.101600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.103189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.104708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.106822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.107976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.108964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.144173 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc HTTP/1.1 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'df0645fd-c385-4382-8b86-09b48861cccc'} Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:03.149202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.162507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.168485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:03.170479 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23df939e-9dd9-42f2-9696-cbf94afc9bcb tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 404 len: 111 microversion: 2.1 time: 0.103677 Aug 30 18:14:03.172308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 434/942] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:03 2022] DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:03.183134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.185036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.211671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.213231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.214465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.216467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.218963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.220592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.381291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:03.397539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c3ab24dd-97a4-411a-ba91-868470f53bed tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1294 microversion: 2.1 time: 0.222965 Aug 30 18:14:03.399587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 435/943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1294 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:03.409003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.410753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.423025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.424595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.425788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.427875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.429088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.429976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.725339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:03.743033 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb070355-f200-426e-ab07-b0565435e068 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.340403 Aug 30 18:14:03.752736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 436/944] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:03.761425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:03.773502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.774703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.782008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3103e6cb-e840-4309-ab3a-cf3466b060c6 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 2051 microversion: 2.25 time: 0.896437 Aug 30 18:14:03.783523 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 509/945] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:02 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 2051 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:03.786480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.787361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.788167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.789410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.790254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.791124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.833312 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc HTTP/1.1 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'df0645fd-c385-4382-8b86-09b48861cccc'} Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.835553 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e8a3b627-7fc4-42ec-b9ca-701617c38b29 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 404 len: 111 microversion: 2.1 time: 0.082981 Aug 30 18:14:03.843835 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 437/946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:03.851293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.857471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.857471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.857471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.859486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.859486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.860034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.904627 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d057f928-822a-42ba-859b-deeccb7b7559 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.057969 Aug 30 18:14:03.904627 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 438/947] 10.222.0.25 () {60 vars in 1217 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:14:03.915872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:03.915872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:03.925479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.925959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.926644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:03.928007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:03.928554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:03.930121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.089753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2018238360", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "3a696fd2-0400-4468-b7f1-f50cf22f982c"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:04.181397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:04.187674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] validate_networks() for [('3a696fd2-0400-4468-b7f1-f50cf22f982c', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:04.202233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-602b0a90-be6a-432f-aef8-a17fde53c572 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.295453 Aug 30 18:14:04.203803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 439/948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:03 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:04.213560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80ddc361-f387-4c00-b468-f3b905761902 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '.version_select at 0x7f4e56998ca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:04.259214 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80ddc361-f387-4c00-b468-f3b905761902 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483351753" status: 202 len: 0 microversion: 2.1 time: 0.053080 Aug 30 18:14:04.261749 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 440/949] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483351753 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:14:04.282811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:04.283359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:04.312551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.313054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.313496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.314247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.314815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.315245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.476517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c900dcde-d07a-41d3-9e17-37f0cabebb10 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913/action" status: 202 len: 0 microversion: 2.25 time: 0.206005 Aug 30 18:14:04.479250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 441/950] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:14:04 2022] POST /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:04.502265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:04.505963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:04.527615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.530846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.531973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:04.536156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:04.538270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:04.541315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.104638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:05.132917 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a94ad9b-7530-4235-8d30-ac490a728974 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1478 microversion: 2.1 time: 0.649739 Aug 30 18:14:05.160943 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 442/951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:04 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1478 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:05.171725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:05.172710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:05.194514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.196172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.197174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.199320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.200398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.201758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.353227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:05.366392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:05.376279 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72428832-1f6a-4ae6-a0ad-10ee3934e4a3 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1282 microversion: 2.1 time: 0.212994 Aug 30 18:14:05.378234 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 443/952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:05 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:05.387878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:05.388773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:05.405270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.405848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.406301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.407249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.407703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.408141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.683806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:05.693411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:05.694809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:05.695799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:05.696774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:05.756489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.757319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.759146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.762690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:05.764123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:05.770542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:05.896004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:05.948730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Getting quotas for project d9836eb8ab034fa28b441266c4b0a325. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:05.966568 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7097e6e6-e032-4cf0-a432-9ef61972cb66 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 2036 microversion: 2.25 time: 0.581300 Aug 30 18:14:05.982393 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 444/953] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:05 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 2036 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:05.982653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Getting quotas for user c4c5229054ca4dbc864425bfbc0a914e and project d9836eb8ab034fa28b441266c4b0a325. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:06.008326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:06.023044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:06.063125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.064230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.066104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:06.067230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.068871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.071074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.072257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.079017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:06.207596 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7f4f107-5fac-4f1f-8f20-073a6e8f8748 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.421662 Aug 30 18:14:06.212228 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 510/954] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:14:06.225210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "name": "network-vif-plugged", "status": "completed", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:06.240972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.241473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.241912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.285247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] Creating event network-vif-plugged:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:14:06.307839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-faa765ef-a649-4d37-b786-96f99d308dcd req-0c0a430d-6713-49fa-9c9c-3e180765d6dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086944 Aug 30 18:14:06.308927 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 511/955] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:06.315865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:06.331458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:06.362495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.369673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.370930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.372879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.379290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.380054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.562404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:06.573885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f974541b-fd57-408b-a6cc-3fa3095952a2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1514 microversion: 2.1 time: 0.599248 Aug 30 18:14:06.575466 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 445/956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:05 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1514 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:06.583783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": "auto"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:06.589563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:06.620513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.621339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.622004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.623011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:06.623452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:06.623888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:06.695966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'flavor' on Instance uuid 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:06.719310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:14:07.013237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:07.032670 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0039f513-42f2-4132-839c-3a6d292147a9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1323 microversion: 2.1 time: 0.721434 Aug 30 18:14:07.033867 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 512/957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:06 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1323 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:07.039403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6eaa7ccb-8553-46ed-901c-4456cf755272 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:07.071852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6eaa7ccb-8553-46ed-901c-4456cf755272 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1368620075" status: 202 len: 0 microversion: 2.1 time: 0.034622 Aug 30 18:14:07.075278 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 513/958] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:14:07 2022] DELETE /compute/v2.1/flavors/1368620075 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:14:07.087848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:07.090991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:07.104951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:07.110906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:07.111510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:07.112501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:07.112983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:07.113413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:08.083231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:08.139228 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c292b8a-3aeb-4e21-b9eb-bbada81fb039 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1478 microversion: 2.1 time: 1.050126 Aug 30 18:14:08.148184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 514/959] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:07 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1478 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:08.181453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:08.184006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:08.224403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:08.227786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:08.228576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:08.233237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:08.235913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:08.238618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.055553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:09.079923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:09.083837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:09.091648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bade5dd0-9536-4bc9-86bb-e65ed952b8be tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1258 microversion: 2.26 time: 0.938749 Aug 30 18:14:09.093359 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 515/960] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:08 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1258 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:09.109253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:09.110451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:09.133308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.158870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.160073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.173499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.175177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.176184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.538923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:09.570253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54ad823a-aa8c-46bc-aa06-23ff7cc2fece tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 0.474776 Aug 30 18:14:09.593828 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 516/961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:09 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:09.598889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ee810e7-e3d1-48c9-a2fe-8a77dafc42f1 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:09.641351 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ee810e7-e3d1-48c9-a2fe-8a77dafc42f1 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.046103 Aug 30 18:14:09.642388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 517/962] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:14:09 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:09.653094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:09.654002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:09.661739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.662543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.663182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:09.664082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:09.664719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:09.665374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.001396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1302157-29ff-4b13-82f7-fe38536e589b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913/action" status: 202 len: 0 microversion: 2.25 time: 3.424285 Aug 30 18:14:10.002438 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 446/963] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:14:06 2022] POST /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913/action => generated 0 bytes in 3426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:10.013529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:10.015785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:10.040976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.051262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.051697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.058699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.060589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.061078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.102878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:10.144372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b2c2068-2e50-42a9-bf9b-f86acbf245fa tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1520 microversion: 2.1 time: 0.496702 Aug 30 18:14:10.145585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 518/964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:09 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:10.192199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-plugged", "status": "completed", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:10.249502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.257905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.261905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.321521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] Creating event network-vif-plugged:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:14:10.335306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d961b163-0230-409c-a450-6b765df3d7c3 req-360dfa6f-78d2-4dff-9924-d7b1e851b0ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187474 Aug 30 18:14:10.337179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 519/965] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:10.370516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f25fbd-7818-40e2-9a03-e0cd21113f3d", "tag": "33ff3323-8630-41f3-9829-caa7b3fd97e2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:10.407450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.411331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.412395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.474614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] Creating event network-changed:33ff3323-8630-41f3-9829-caa7b3fd97e2 for instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d on n-h2-854119-10 Aug 30 18:14:10.502168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-011fb2b4-81c8-4c8e-897f-b8a487d66743 req-8b892b42-7242-4e48-8f8a-cbfacc5f4062 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159229 Aug 30 18:14:10.503377 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 520/966] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:10.527328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:10.533226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:10.559565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.560408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.563703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:10.564485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:10.568368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:10.568807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.242582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.257733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:11.273374 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d6730685-35bd-47eb-9f60-c3893a661815 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1478 microversion: 2.1 time: 0.763178 Aug 30 18:14:11.276036 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 521/967] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:10 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1478 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:11.286209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbebdb0c-ed7d-408e-b84a-d71e87866766 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:11.327909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbebdb0c-ed7d-408e-b84a-d71e87866766 tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/840514432" status: 202 len: 0 microversion: 2.1 time: 0.049655 Aug 30 18:14:11.331448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 522/968] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:14:11 2022] DELETE /compute/v2.1/flavors/840514432 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:14:11.342995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:11.348215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:11.357889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.358913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.359771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.361595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.362644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.363362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.613217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.633044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.636342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc63b6d7-00a3-41ec-a17d-e6da2d263220 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1520 microversion: 2.1 time: 1.631506 Aug 30 18:14:11.650409 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 447/969] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:10 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1520 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:11.650773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.652734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:11.657581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89611e12-b8f0-4360-9b4d-d47ad7bfe321 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.320989 Aug 30 18:14:11.657952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:11.657952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:11.663781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 523/970] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:11 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:11.675489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:11.676395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:11.689124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.694459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.697645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.698575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.699241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.699486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.703838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.704647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.705452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:11.706828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:11.708521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:11.709341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:12.114870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:12.127867 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd31be1e-dbec-43ad-aeea-86bcde574162 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 0.462449 Aug 30 18:14:12.149048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 524/971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:11 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:12.155054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:12.155692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:12.173783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.174713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.175393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:12.176394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.177053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.188035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:12.434473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:12.456690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:12.460939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:12.464114 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c448503-3138-4527-a4e8-d7a51eb32611 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 0.823111 Aug 30 18:14:12.466202 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 448/972] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:11 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:12.478919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3503b1a-e66a-4efa-b592-e0167389175a tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:12.523381 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3503b1a-e66a-4efa-b592-e0167389175a tempest-ServersWithSpecificFlavorTestJSON-168920417 tempest-ServersWithSpecificFlavorTestJSON-168920417-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053593 Aug 30 18:14:12.528555 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 449/973] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:14:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:12.538992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1c56d79-96a8-40a2-8116-247c3464f7b3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'create', calling method: .version_select at 0x7f4e5695a700>, body: {"pool": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:12.687215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:12.707595 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c76b3af0-b4db-4967-9ffe-3450a89d59a4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1520 microversion: 2.1 time: 0.556351 Aug 30 18:14:12.724543 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 525/974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:12 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:12.725130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:12.741522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:12.755124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.756891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.758175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:12.760122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:12.761490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:12.762600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.413539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:13.426365 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54fbe779-4257-4ce9-b580-24990f461e3e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1478 microversion: 2.1 time: 0.713082 Aug 30 18:14:13.428179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 526/975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:12 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1478 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:13.433758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317ac0-9deb-4c18-820c-6582f4fe9a80", "name": "network-vif-unplugged", "status": "completed", "tag": "ceeb1086-155a-49f1-b606-3b792d472871"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:13.444536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.445325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.446063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.467727 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] Creating event network-vif-unplugged:ceeb1086-155a-49f1-b606-3b792d472871 for instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 on n-h2-854119-10 Aug 30 18:14:13.473848 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-452c907b-1722-4370-8c1a-5dfc185474cb req-c758334f-23cf-4a58-b0f7-672f2f3db4a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044100 Aug 30 18:14:13.475120 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 527/976] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:13.483017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:13.483902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:13.492724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.493318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.493918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.494940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.495641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.496259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.515805 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 HTTP/1.1 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '344ab242-92c2-416b-8571-f6190835c516'} Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:13.517557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8910ee34-4dec-4816-8664-a370450cf21f tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 404 len: 111 microversion: 2.1 time: 0.043248 Aug 30 18:14:13.526873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 528/977] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:13 2022] DELETE /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:13.530455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:13.531129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:13.538836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.539423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.540623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.540623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.540990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.541729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.816717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:13.832427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:13.835422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:13.838400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-def5a092-b1fe-440d-8224-9e6caf7c7f36 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.312678 Aug 30 18:14:13.840132 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 529/978] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:13 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:13.852091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:13.853197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:13.864899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.866063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.867026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.869264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:13.870328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:13.871396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:13.872537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:14.986382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.001240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18a27565-356c-4425-b63e-6620b1d4c62b tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 1.159294 Aug 30 18:14:15.001877 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 530/979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:13 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:15.033460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:15.034621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:15.067518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.079256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.080557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.083021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.083924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.084762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.494005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.505670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.507700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.508903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64754024-8e71-4d47-8156-85ae2afec68f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 0.499711 Aug 30 18:14:15.517687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 531/980] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:15 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:15.532096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:15.533593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: 344ab242-92c2-416b-8571-f6190835c516] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:15.553652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.554761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.555697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.557847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.559224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.560049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.586508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 HTTP/1.1 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '344ab242-92c2-416b-8571-f6190835c516'} Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:15.589799 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance 344ab242-92c2-416b-8571-f6190835c516 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-88f8adce-7521-4384-9ec2-a79702b0fb10 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516" status: 404 len: 111 microversion: 2.1 time: 0.068741 Aug 30 18:14:15.595367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 532/981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:15 2022] GET /compute/v2.1/servers/344ab242-92c2-416b-8571-f6190835c516 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:15.602426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:15.603526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:15.615651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.616433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.617123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.619024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.619202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.619797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.820459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:15.831838 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20d1afc9-1290-41ff-a3c6-fd3b0d49b135 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1520 microversion: 2.1 time: 0.236522 Aug 30 18:14:15.832577 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 533/982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:15 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:15.839252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9f808d-db67-4977-8c4a-8147f63e6651", "tag": "e72c2170-7292-424b-bf6b-dfaf0a39cde3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:15.851526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.852227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.852936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.878407 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] Creating event network-changed:e72c2170-7292-424b-bf6b-dfaf0a39cde3 for instance 5a9f808d-db67-4977-8c4a-8147f63e6651 on n-h1-854119-10 Aug 30 18:14:15.883852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:15.886105 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-006581b6-8cdb-42c2-9519-c86964a1f75a req-60e6863a-c515-4a1a-a3b1-7564be2e10ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052079 Aug 30 18:14:15.886776 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 534/983] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:15.895583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:15.896300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:15.903749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.904243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.904678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:15.905393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:15.905843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:15.906267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.044437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:16.073581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.092715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-559b0e56-3799-4c13-8bce-45639b389f4e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1464 microversion: 2.1 time: 0.201624 Aug 30 18:14:16.093338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 535/984] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:15 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:16.106117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b48c5-5ba4-4ec3-9b6d-43841332c913", "name": "network-vif-unplugged", "status": "completed", "tag": "0eca8698-165b-4ee7-a71e-96c553b7c4fc"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:16.114511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:16.119631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.120113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.120764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.136883 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] Creating event network-vif-unplugged:0eca8698-165b-4ee7-a71e-96c553b7c4fc for instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 on n-h2-854119-10 Aug 30 18:14:16.146042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fe3fd414-f80b-4a75-ad64-e899ea59c0c0 req-9bb42a51-f98c-4dcb-8991-0bb4d2d8f15a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048190 Aug 30 18:14:16.147082 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 536/985] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:16.153015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.153903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.163081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.163867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.164393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.165526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.166790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.167387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.207410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1c56d79-96a8-40a2-8116-247c3464f7b3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.676846 Aug 30 18:14:16.222399 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 450/986] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:14:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:16.248373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317ac0-9deb-4c18-820c-6582f4fe9a80", "name": "network-vif-plugged", "status": "completed", "tag": "ceeb1086-155a-49f1-b606-3b792d472871"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:16.284404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.287199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.287941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.316740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] Creating event network-vif-plugged:ceeb1086-155a-49f1-b606-3b792d472871 for instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 on n-h2-854119-10 Aug 30 18:14:16.330826 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a8eb5afd-503c-4ca4-bafd-f9b6efcee840 req-e35dcb92-c4b8-494d-a07d-9bf82cf3d802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091961 Aug 30 18:14:16.332599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 451/987] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:16.345049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.346448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.357975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.360023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.361249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.362503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.363078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.363748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.412920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc HTTP/1.1 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'df0645fd-c385-4382-8b86-09b48861cccc'} Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:16.415011 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8cacd1d1-6729-4ebc-9fbe-a3969dff74d2 tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 404 len: 111 microversion: 2.1 time: 0.082818 Aug 30 18:14:16.426928 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 452/988] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:16 2022] DELETE /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:16.452009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.453263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.453462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.466934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.470531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.472323 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a6aa263-23dd-45df-ab0d-a4adfc8ced67 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.323862 Aug 30 18:14:16.473846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 537/989] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:16.480049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.481035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.488284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.488885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.489440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.491120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.491793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.492413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.499603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.500263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.502233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.503132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.503766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.504725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.750305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.771467 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-672ad3e2-9ce5-4bb0-af9a-90e21f93535d tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 0.350457 Aug 30 18:14:16.772263 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 453/990] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:16.785053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.788205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] [instance: df0645fd-c385-4382-8b86-09b48861cccc] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.803029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.804239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.804823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.805770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.806630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.807692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.824856 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] HTTP exception thrown: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Request method failure captured: Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc HTTP/1.1 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlKgKvsMPztnAHQDVa6Ibzb5rZpeLrU2sutw9ZoGfPC1oK0qhdiU9OYZDPomY_lP1KQXPXz30rGUfl0BpdQl5dbsfH-QjHWLzLTwIRTcf_RIu5vTMd43WmttJUXE0JvuKfcH2s3GRdWQgE04MB2SpT6Zxwpor_ZBngjnaxb-A4B1njM Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43d8b8f4da3840bf9e7c463a785bb6a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 43d8b8f4da3840bf9e7c463a785bb6a4 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539 Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: bb87eded75e64169b15feb9cab2eec4b Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2097201539-project Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'df0645fd-c385-4382-8b86-09b48861cccc'} Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.826682 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] Returning 404 to user: Instance df0645fd-c385-4382-8b86-09b48861cccc could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ddf140e3-418e-4e31-afaf-941dc9fd18ad tempest-ServersWithSpecificFlavorTestJSON-2097201539 tempest-ServersWithSpecificFlavorTestJSON-2097201539-project] 10.222.0.25 "GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc" status: 404 len: 111 microversion: 2.1 time: 0.054098 Aug 30 18:14:16.831248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 454/991] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/df0645fd-c385-4382-8b86-09b48861cccc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:16.833977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1827960915", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "f4538093-5c5a-48b8-b165-6029db69e2b1"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:16.914414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] validate_networks() for [('f4538093-5c5a-48b8-b165-6029db69e2b1', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:16.917695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:16.932565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c6138b80-0742-485c-82e6-4df667e5668c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1464 microversion: 2.1 time: 0.456563 Aug 30 18:14:16.933537 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 538/992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1464 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:16.947293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:16.949255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:16.963323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.964439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.965067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:16.966025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:16.966674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:16.967500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.482030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:17.482934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:17.483373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:17.484089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:17.485604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:17.505268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.506124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.506957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.508387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.509548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.510675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.538424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Getting quotas for project f87bb886242a4732bf31db42bde24ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:17.547036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Getting quotas for user a547e08e089e4911a3035ef8416dca57 and project f87bb886242a4732bf31db42bde24ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:17.569598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:17.571954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:17.633818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:17.651574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9cef44c6-f5f0-4c32-8efa-4538bbd64dde tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821065 Aug 30 18:14:17.652740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 455/993] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:14:17.657031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:17.658301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:17.658894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:17.667427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:17.668449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.669143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.669378 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bd9f5cf-608e-409b-b497-498d48beb1ef tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 0.734215 Aug 30 18:14:17.670543 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 539/994] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:16 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:17.670714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.671681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.672450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.673196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.682111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:17.689168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:17.707122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.708068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.709049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.710566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:17.712505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:17.713359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:17.819020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:17.819760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:17.821264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:17.821927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:17.822829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:17.900804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:17.912775 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91e23f9c-3b0e-4b2e-968d-58590f0196ca tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1520 microversion: 2.1 time: 0.258408 Aug 30 18:14:17.927069 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 456/995] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:17 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:17.985005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:17.999127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.000178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.000977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.002095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.003330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.004392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.042391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:18.054501 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36d4ee12-bd7f-48c8-843e-aeb990b81641 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 1068 microversion: 2.1 time: 0.380679 Aug 30 18:14:18.057847 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 540/996] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:17 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 1068 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 18:14:18.069242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.070945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.095853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.096987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.097989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.099694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.100419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.101021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.349045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6b3d742-9643-459f-972c-7dcba9781268 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.367116 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6b3d742-9643-459f-972c-7dcba9781268 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.437687 Aug 30 18:14:18.369717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 457/997] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:18.379151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f93a56a7-50c5-4f87-a022-dddff890bdb1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.380509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f93a56a7-50c5-4f87-a022-dddff890bdb1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.534919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f93a56a7-50c5-4f87-a022-dddff890bdb1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:18.553658 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f93a56a7-50c5-4f87-a022-dddff890bdb1 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1224 microversion: 2.1 time: 0.180771 Aug 30 18:14:18.570714 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 458/998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1224 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:18.590804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.591598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.595494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:18.608418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.609725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.610850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.612879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.613812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.615600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.640839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:18.654237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:18.656153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:18.658813 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3fce43b4-dda6-49bf-8e81-14352f5d8fa7 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.598147 Aug 30 18:14:18.662750 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 541/999] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:18.689947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.690969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.704030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.704689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.705142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.705972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.708585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.709271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.835323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:18.847423 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9097c775-b9dd-4048-967f-8fb127b7ad32 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 0.274364 Aug 30 18:14:18.848583 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 459/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:18.853540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7b48c5-5ba4-4ec3-9b6d-43841332c913", "tag": "0eca8698-165b-4ee7-a71e-96c553b7c4fc"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:18.865011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.865501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.865970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.879867 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] Creating event network-changed:0eca8698-165b-4ee7-a71e-96c553b7c4fc for instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 on n-h2-854119-10 Aug 30 18:14:18.885612 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e7fc95bc-d390-4168-bbb2-f1d4a01523ed req-56735090-5ff5-4ef6-b4be-d6b3abc8ff18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035439 Aug 30 18:14:18.886454 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 460/1001] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:18.895040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8796a3fe-24d8-4ae5-81c2-d7f7dad04081 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.917948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8796a3fe-24d8-4ae5-81c2-d7f7dad04081 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027027 Aug 30 18:14:18.918921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 461/1002] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:18.923860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f25fbd-7818-40e2-9a03-e0cd21113f3d", "name": "network-vif-plugged", "status": "completed", "tag": "33ff3323-8630-41f3-9829-caa7b3fd97e2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:18.935436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.935905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.936339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.948978 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] Creating event network-vif-plugged:33ff3323-8630-41f3-9829-caa7b3fd97e2 for instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d on n-h2-854119-10 Aug 30 18:14:18.954611 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f08c254c-7b23-43e1-9495-54e5d04c81b5 req-4a41b3e9-8af5-4ddd-b03b-c87e051d6220 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034406 Aug 30 18:14:18.955268 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 462/1003] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:18.964151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:18.964151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:18.969823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.970539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.971215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.972431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:18.973000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:18.973691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:18.998954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.007711 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92dcdbdd-c0a6-4822-b5d2-89539130947d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.343789 Aug 30 18:14:19.008303 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 542/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.013616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65b19d6a-8f0d-42e1-ada5-c993d061e106 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.023153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65b19d6a-8f0d-42e1-ada5-c993d061e106 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013505 Aug 30 18:14:19.032847 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 543/1005] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:19.039156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.040214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.048473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.049405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.050074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.051125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.051871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.052370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.522669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.536634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2231e876-700b-48da-af10-bd56c594e2cc tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1505 microversion: 2.1 time: 0.501714 Aug 30 18:14:19.538032 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 544/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.546617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.577536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.578784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f008d675-38d9-423c-adb5-a80cda76891f tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.587906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.591725 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4b380323-358e-4b3b-8941-8f2028cc8181 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 0.635186 Aug 30 18:14:19.593621 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 463/1007] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:18 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:19.614716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.615086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f008d675-38d9-423c-adb5-a80cda76891f tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049878 Aug 30 18:14:19.615851 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 545/1008] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:19.626303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.633414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.635480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.636487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.637142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.637747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.639204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.641361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.642296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.650494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.651632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.651774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.652454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.652917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.653349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.792670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:19.805191 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-628eff7c-d082-49e8-8d78-e496868bab7c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1276 microversion: 2.1 time: 0.187992 Aug 30 18:14:19.807402 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 546/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.822786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aed9bdef-4297-46c5-9752-197d195f19b5 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.881219 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aed9bdef-4297-46c5-9752-197d195f19b5 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.064355 Aug 30 18:14:19.884494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 547/1010] 10.222.0.25 () {58 vars in 1165 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:19.925490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:19.940571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:19.970160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.971213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.971948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:19.975219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:19.976712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:19.978150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.140914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.155306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67f527ad-74e4-4a30-bfa9-18a2a1e28e48 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 200 len: 1505 microversion: 2.1 time: 0.554824 Aug 30 18:14:20.156232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 464/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:20.162596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:20.163554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:20.187094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.188404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.189391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.190764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.191707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.192740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.690916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.722571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.726190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.728542 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f7b2480-b2a3-4520-927b-46f3d8f21f10 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.825995 Aug 30 18:14:20.734800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 548/1012] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:19 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:20.754779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6056c25c-711e-4ad8-bbf4-395df35f99f5 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:20.787002 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6056c25c-711e-4ad8-bbf4-395df35f99f5 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038728 Aug 30 18:14:20.789144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 549/1013] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:20.806106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:20.808543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:20.811079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:20.822060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.825744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.826540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.827886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.828619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.829618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.850024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-196df48a-5fb3-4f1a-bc46-efaf8e7486dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1324 microversion: 2.1 time: 0.691532 Aug 30 18:14:20.866384 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 465/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:20 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1324 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:20.881283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:20.881283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:20.896043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.896885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.897619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.898865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:20.899646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:20.901120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:20.972884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:14:21.003723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:21.205982 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6ae5028-8185-4303-99c3-9e74a7feb3f3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 204 len: 0 microversion: 2.1 time: 0.345681 Aug 30 18:14:21.207568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 466/1015] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:20 2022] DELETE /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:21.223539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.224923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:21.250084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.251088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.253360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.255252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.258725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.261143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.616736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:21.650183 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edf0fbab-2587-4427-bbba-711a0db84181 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.853094 Aug 30 18:14:21.651600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 550/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:20 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:21.670583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0e6b4ed-c89b-48d0-80d2-99d6111e6c09 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.702237 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0e6b4ed-c89b-48d0-80d2-99d6111e6c09 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.047124 Aug 30 18:14:21.703732 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 551/1017] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:21.713325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.714173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:21.721847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.723088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.723791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.724906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.725640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.726370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.761157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:21.774388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:21.776136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:21.787514 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4002348-26cc-4420-bc40-0298b4a56cfc tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 0.577648 Aug 30 18:14:21.788160 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 467/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:21.805778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-666051986", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a4549ce9-8c04-485f-9303-8f662d038aa7"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:21.900960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] validate_networks() for [('a4549ce9-8c04-485f-9303-8f662d038aa7', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:21.923682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:21.935455 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7f2cf9a-185e-43ba-9f2d-bc28398f5260 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1282 microversion: 2.1 time: 0.229544 Aug 30 18:14:21.935455 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 552/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:21.943182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee0a3fa5-0ef2-4f3d-86fd-d6d5ffa8c3e4 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.980528 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee0a3fa5-0ef2-4f3d-86fd-d6d5ffa8c3e4 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043674 Aug 30 18:14:21.992940 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 553/1020] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:21.992940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:21.992940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:21.996263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.996263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.996263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:21.996940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:21.997362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:21.998683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:22.446117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:22.460575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:22.463927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:22.466110 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b9038f6f-3f50-4665-85d9-5b51b978ab47 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1567 microversion: 2.25 time: 0.483298 Aug 30 18:14:22.467901 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 554/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:21 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1567 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:22.476758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:22.478522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:22.490441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:22.491788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:22.492815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:22.494454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:22.495552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:22.496518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.269071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:23.293778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b549baa-83d1-429a-b365-247c0980d6bd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1522 microversion: 2.1 time: 0.823921 Aug 30 18:14:23.295563 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 555/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:22 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1522 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:23.311688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bc002a2-11ea-4d91-bbb4-46444792dd91 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:23.327613 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bc002a2-11ea-4d91-bbb4-46444792dd91 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030815 Aug 30 18:14:23.328442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:23.329928 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 556/1023] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:23.331023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:23.333851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:23.335017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:23.337602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:23.347767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9f808d-db67-4977-8c4a-8147f63e6651", "name": "network-vif-plugged", "status": "completed", "tag": "e72c2170-7292-424b-bf6b-dfaf0a39cde3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:23.373144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.373970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.374601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.390716 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] Creating event network-vif-plugged:e72c2170-7292-424b-bf6b-dfaf0a39cde3 for instance 5a9f808d-db67-4977-8c4a-8147f63e6651 on n-h1-854119-10 Aug 30 18:14:23.393318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.397403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.398901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-90ec18c5-de13-4ed8-b3c3-6103fd6011f9 req-4f940498-abac-46e7-bec9-e08f044f8e86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063160 Aug 30 18:14:23.399922 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 557/1024] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:23.412363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:23.413082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:23.414276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.422122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.423445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.424505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.439463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.439956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.440390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.441454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.441920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.442406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.494021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:23.509505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for user ab2acdcb76554cbf9c45566a19d03f35 and project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:23.568179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:23.575671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:23.717143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2e068b4-c25d-4f7a-9928-40db55cb92a3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927825 Aug 30 18:14:23.727912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 468/1025] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:14:23.733042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:23.733674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:23.766858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.768470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.770248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.772673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:23.773940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:23.775083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:23.982785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.001762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-97f33675-857b-45fd-8242-53e344025f93 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.600007 Aug 30 18:14:24.005997 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 558/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:23 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:24.015218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.016903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:24.029897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.031323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.032459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.034274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.035218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.036037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.438947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.453860 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e193a666-743c-4a72-8121-27703e031a51 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 0.445642 Aug 30 18:14:24.456709 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 559/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:24 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:24.467462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.468418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:24.476361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.477199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.477829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.478623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.479320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.479744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.521337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:14:24.652725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-94dc5dc1-1dba-4f42-b6a7-97305bf10dd2 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 204 len: 0 microversion: 2.1 time: 0.189685 Aug 30 18:14:24.659553 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 560/1028] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:24 2022] DELETE /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:14:24.660772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21a25dfc-f0c1-4adc-b4e3-a7c16bae9c86 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.722604 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21a25dfc-f0c1-4adc-b4e3-a7c16bae9c86 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.067712 Aug 30 18:14:24.723233 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 561/1029] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:14:24 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:24.738731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.741897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:24.751962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.752471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.753033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.753820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.754278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.754873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.937138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.947922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.949769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:24.951317 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2488cdac-25b8-4380-a159-5aa76a9a8e0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1542 microversion: 2.25 time: 0.227092 Aug 30 18:14:24.952383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 562/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:24 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1542 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:24.966026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:24.967668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:24.982655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.983987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.985082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:24.986952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:24.988322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:24.989846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.102651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.115257 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9769ea4-d563-4650-9a19-d19e62373b06 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1221 microversion: 2.1 time: 0.161125 Aug 30 18:14:25.116255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 563/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:24 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:25.123636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07317ac0-9deb-4c18-820c-6582f4fe9a80", "name": "network-vif-deleted", "tag": "ceeb1086-155a-49f1-b606-3b792d472871"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:25.143434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.144495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.145332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.174265 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] Creating event network-vif-deleted:ceeb1086-155a-49f1-b606-3b792d472871 for instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 on n-h2-854119-10 Aug 30 18:14:25.186144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6de6d826-df93-4d7b-84be-544806ebde29 req-27a786ad-0863-45f9-bb2d-224d6411061c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067452 Aug 30 18:14:25.188472 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 564/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:25.201230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.202194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:25.212170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.213551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.214656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.216228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.217259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.218242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.221171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.227744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:25.248327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.252398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.262663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10a5818a-f803-468e-9cb4-2247d95d3e44 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1362 microversion: 2.26 time: 1.536062 Aug 30 18:14:25.277839 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 469/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:23 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1362 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:25.293131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23d0dc01-c2b5-4ed2-8295-93598090fed2 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.311375 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23d0dc01-c2b5-4ed2-8295-93598090fed2 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031252 Aug 30 18:14:25.312487 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 470/1034] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:25.328459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b56c8870-934a-4e42-81a1-ffb52c040549 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '.version_select at 0x7f4e568ffa60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.334745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b56c8870-934a-4e42-81a1-ffb52c040549 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.335320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b56c8870-934a-4e42-81a1-ffb52c040549 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.336271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b56c8870-934a-4e42-81a1-ffb52c040549 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.394584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b56c8870-934a-4e42-81a1-ffb52c040549 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.080387 Aug 30 18:14:25.413447 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 471/1035] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:25.413447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.413447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:25.433101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.434917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.438082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.440061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.440643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.441087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.711562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.747296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6522b071-04b0-4c0c-81d0-fd4d9244d5dd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1528 microversion: 2.1 time: 0.555676 Aug 30 18:14:25.748694 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 565/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1528 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:25.777167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a27e728d-d68f-4b0e-8c4e-75e2bb0dd7e3 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.855104 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a27e728d-d68f-4b0e-8c4e-75e2bb0dd7e3 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.102949 Aug 30 18:14:25.856736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 566/1037] 10.222.0.25 () {58 vars in 1144 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:25.870984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.871768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:25.879679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.879922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.880582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.881693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.882213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.882643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.891830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:25.910450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ef9d8ea-3b4f-4b3e-a095-f2f216e28cec tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.507856 Aug 30 18:14:25.911707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 472/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:25.917422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:25.918569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:25.926274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.927137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.928079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:25.928985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:25.929595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:25.930188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.290866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:26.304772 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2a1a38d-ccc1-4bf9-9f42-91099afea466 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 0.391340 Aug 30 18:14:26.309533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 473/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:26.314780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89f1ab69-39b0-4e34-b9cf-817ec46d7558 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:26.343188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-89f1ab69-39b0-4e34-b9cf-817ec46d7558 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026878 Aug 30 18:14:26.344186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 474/1040] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:26.353303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:26.360449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:26.369415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.376909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.377719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.378704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.378979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:26.381410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.381942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.500221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4838a9f9-fca9-4adc-a14a-a5a00b47222b tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 2036 microversion: 2.25 time: 0.641575 Aug 30 18:14:26.508879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 567/1041] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:25 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 2036 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:26.556058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:26.562324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:26.568235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:26.569708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0fb05a1-8664-46b0-a5ec-1b929d78b251 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1277 microversion: 2.1 time: 0.223126 Aug 30 18:14:26.576152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 475/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:26 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:26.590093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c79159e-da75-4431-8a27-630e4f5de408 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:26.625071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.625876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.626663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.660693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.663760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.670616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.672530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c79159e-da75-4431-8a27-630e4f5de408 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.088058 Aug 30 18:14:26.689342 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 476/1043] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Aug 30 18:14:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:26.855402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b196be61-15ff-463e-809d-06cde47e2659", "tag": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:26.910865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:26.911700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:26.912460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:26.955545 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] Creating event network-changed:49ef7eb4-d408-451a-bad8-f36e4ffcaff2 for instance b196be61-15ff-463e-809d-06cde47e2659 on n-h2-854119-10 Aug 30 18:14:26.977159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-dfe885ca-8cc5-404b-886d-9ecee2712143 req-73738a23-dbf4-437d-993e-0a7228af5081 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285709 Aug 30 18:14:26.982950 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 477/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:27.005000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff9f0d48-f8f4-450e-8e1c-316300689c0a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: .version_select at 0x7f4e569024c0>, body: {"keypair": {"name": "tempest-keypair-883248818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFTKKMc4d0EEHH3MjsUXqpAVTN31Iscm5iXL9VDgVme/+aPDiXR91Kh7N4HV5cNzL1rbXhYbsZfUE24BXFBzVfaobhXGMu312JMc56/PcA5HOYssmaV+iyB+QxjhGNuzQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:27.070010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ff9f0d48-f8f4-450e-8e1c-316300689c0a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for project 29f43bac114c41ed96e7c7d50864818b. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:27.088131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ff9f0d48-f8f4-450e-8e1c-316300689c0a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for user 6774c9dbc6b44018a09893dabeee643a and project 29f43bac114c41ed96e7c7d50864818b. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:27.170214 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff9f0d48-f8f4-450e-8e1c-316300689c0a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.179996 Aug 30 18:14:27.174578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 478/1045] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:14:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:14:27.204790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c6cac8a-815a-41f4-8bbf-b32c79f75a22 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:27.238972 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c6cac8a-815a-41f4-8bbf-b32c79f75a22 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.062787 Aug 30 18:14:27.248614 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 479/1046] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 18:14:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:27.266028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:27.274778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:27.283480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:27.297810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:27.302130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.305147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:27.307095 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c3066d6-f243-4879-8769-b421e0dd449c tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1546 microversion: 2.26 time: 0.796473 Aug 30 18:14:27.307589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.308242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:27.309014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.309485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.310019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:27.316672 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 568/1047] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:26 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1546 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:27.327899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:27.332727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:27.358540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.359640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.360325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:27.363903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:27.364753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:27.365407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.007354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:28.031152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-35712b5d-a1ad-4d3a-aae6-b6969c23db2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1528 microversion: 2.1 time: 0.780604 Aug 30 18:14:28.035792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 480/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:27 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1528 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:28.044651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ba06061-9a92-4f21-a5c3-d8980760c1f0 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:28.078936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ba06061-9a92-4f21-a5c3-d8980760c1f0 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041425 Aug 30 18:14:28.080249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 481/1049] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:28.086258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:28.088727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:28.103247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:28.122176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.122176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.122176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.125891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.126711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.127492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.132983 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-713002a6-478e-4790-9a4e-1e3f0f86947a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.814205 Aug 30 18:14:28.137258 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 569/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:27 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:28.149218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56e663a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:28.170243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.172698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.174302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.175718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:28.200482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.201624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.202586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.203616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.204322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.204964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.304379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.312862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.314079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.363246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.364822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.366186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.403979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:28.494363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3afabaa9-8ebc-4f28-a133-39c51dfb79fd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-532908737" status: 201 len: 0 microversion: 2.26 time: 0.353436 Aug 30 18:14:28.506326 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 570/1051] 10.222.0.25 () {62 vars in 1377 bytes} [Tue Aug 30 18:14:28 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-532908737 => generated 0 bytes in 361 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 18:14:28.508335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:28.511212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:28.524323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.524970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.532550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:28.534690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:28.536059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:28.537584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.112737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:29.150876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:29.154040 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71e86060-1afc-4a54-9325-1c5333e319b9 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 1.072122 Aug 30 18:14:29.155671 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 482/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:28 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.167969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17a85872-9373-4163-b8e6-df8617a249cd tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.186923 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60fbcbbe-02fd-45d1-91ef-40a571d9052a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 0.683712 Aug 30 18:14:29.190751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 571/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:28 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.228159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be7aad49-9beb-4ba9-ae20-670831a731b5 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56e665e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.249770 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17a85872-9373-4163-b8e6-df8617a249cd tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.090973 Aug 30 18:14:29.251494 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 483/1054] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.261560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.263296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:29.270896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7aad49-9beb-4ba9-ae20-670831a731b5 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.271472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7aad49-9beb-4ba9-ae20-670831a731b5 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.276898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.277782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7aad49-9beb-4ba9-ae20-670831a731b5 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.278741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.279875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.281743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.282962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.284094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.311996 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be7aad49-9beb-4ba9-ae20-670831a731b5 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-532908737" status: 204 len: 0 microversion: 2.26 time: 0.119971 Aug 30 18:14:29.319448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 572/1055] 10.222.0.25 () {60 vars in 1358 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-532908737 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:29.331523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f25fbd-7818-40e2-9a03-e0cd21113f3d", "name": "network-vif-deleted", "tag": "33ff3323-8630-41f3-9829-caa7b3fd97e2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:29.349539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.350186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.350693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.379056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] Creating event network-vif-deleted:33ff3323-8630-41f3-9829-caa7b3fd97e2 for instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d on n-h2-854119-10 Aug 30 18:14:29.385391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-344cf377-55a8-4f02-99ad-8c4c9e368328 req-ac9d48f5-1b4c-4077-924f-f6271fe7f48a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064446 Aug 30 18:14:29.386628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 573/1056] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:29.402122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.402866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:29.411301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.411871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.412336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.413072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.413552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.413984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.577866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:29.590361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7014dbc2-fe9c-4f06-8bbf-8c605f1f833a tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1309 microversion: 2.1 time: 0.336468 Aug 30 18:14:29.591377 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 484/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.615873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91357720-13c6-4594-9d90-c76b5d113774 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.653938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91357720-13c6-4594-9d90-c76b5d113774 tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060540 Aug 30 18:14:29.655261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 485/1058] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.669387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56998430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.687897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.689190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.689887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.691284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:29.699016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.699939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.700601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.701580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.702452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.703123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.755162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:29.755891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.756696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.757423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:29.769486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11d843bd-5a38-4f9a-ac26-5f468c3c2b00 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.380659 Aug 30 18:14:29.773506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 574/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:29.797125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c540ecc7-3d94-4147-995e-621eedee214d tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.825869 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c540ecc7-3d94-4147-995e-621eedee214d tempest-FlavorsV2TestJSON-1721852050 tempest-FlavorsV2TestJSON-1721852050-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049977 Aug 30 18:14:29.827143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 575/1060] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:29.827943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:29.951178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b3a5fff-895a-4d78-8d84-cba7680a89b4 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 204 len: 0 microversion: 2.26 time: 0.294005 Aug 30 18:14:29.953879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 486/1061] 10.222.0.25 () {60 vars in 1295 bytes} [Tue Aug 30 18:14:29 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:29.974862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-741c3743-2455-4f6c-b458-268b03e25e06 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e576a6280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:29.988770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-741c3743-2455-4f6c-b458-268b03e25e06 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:29.989438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-741c3743-2455-4f6c-b458-268b03e25e06 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:29.989895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-741c3743-2455-4f6c-b458-268b03e25e06 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.005182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-741c3743-2455-4f6c-b458-268b03e25e06 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 12 microversion: 2.26 time: 0.042844 Aug 30 18:14:30.006023 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 576/1062] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:14:29 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:14:30.022433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e5696a430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.036085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.037372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.037594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.038121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.046099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.047261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.047802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.050680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.050680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.050680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.106706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.108127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.108388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.129453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.130120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.130941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.180872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.181646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.194546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:30.196543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.197050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.197531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.198437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.198772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.199202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.239349 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4dd3f58-7035-4e14-8973-ebabe58e7fb8 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-981044787" status: 201 len: 0 microversion: 2.26 time: 0.220591 Aug 30 18:14:30.240912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 487/1063] 10.222.0.25 () {62 vars in 1377 bytes} [Tue Aug 30 18:14:30 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-981044787 => generated 0 bytes in 225 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 18:14:30.257219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.258146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.273546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.278699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.282761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.284028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.284852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.285602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.543116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:30.557634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c799c5b-c28f-4b1f-af1a-43c6dcf626eb tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 0.380250 Aug 30 18:14:30.565024 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 577/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:14:30.574238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09cfd84f-599b-43d6-9705-bfb52b37e801 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56e7d0d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.594224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09cfd84f-599b-43d6-9705-bfb52b37e801 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.594750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09cfd84f-599b-43d6-9705-bfb52b37e801 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.595186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09cfd84f-599b-43d6-9705-bfb52b37e801 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.612631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09cfd84f-599b-43d6-9705-bfb52b37e801 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 35 microversion: 2.26 time: 0.045510 Aug 30 18:14:30.619991 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 578/1065] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 35 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:30.629788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56dfe670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.634036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:30.642625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.643308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.643760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.644627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.657584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.658112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.658599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.659352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.659833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.660637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.698535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.699359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.700130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.740008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:30.758976 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a4c46c1-d1e9-467e-a5b3-ca461a3bbaf9 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-981044787" status: 204 len: 0 microversion: 2.26 time: 0.137266 Aug 30 18:14:30.760472 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 579/1066] 10.222.0.25 () {60 vars in 1361 bytes} [Tue Aug 30 18:14:30 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-981044787 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:30.766453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.767502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.774785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.775466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.776370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.777500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.778248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.779012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.818658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.819452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.820768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.821420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lazy-loading 'fault' on Instance uuid 56f25fbd-7818-40e2-9a03-e0cd21113f3d {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:30.892491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8526d208810247feaf96b54f55452d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69efb209b4468f8d3d69cf0850c320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:30.907364 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ccee2462-70a0-4caa-afc9-a0606d239b6e tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 200 len: 1314 microversion: 2.1 time: 0.145422 Aug 30 18:14:30.923049 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 580/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:30.929156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-094e2844-daf3-480a-9b6d-496c8933edd0 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56de9820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.939434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-094e2844-daf3-480a-9b6d-496c8933edd0 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.940327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-094e2844-daf3-480a-9b6d-496c8933edd0 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.940992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-094e2844-daf3-480a-9b6d-496c8933edd0 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.954712 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-094e2844-daf3-480a-9b6d-496c8933edd0 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 12 microversion: 2.26 time: 0.029995 Aug 30 18:14:30.956089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 581/1068] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 12 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:30.965189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:30.966371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:30.991868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.993242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.994117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:30.996132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:30.997534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:30.998635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.070790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:31.083364 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a940116-3d88-450a-ba11-a06e10401947 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 0.838579 Aug 30 18:14:31.085303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 488/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:31.107623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56afe940>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.122929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.123715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.124431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.125116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.135713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.137098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.138298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.140001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.140902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.141790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.179597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.180792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.182149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.192497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:31.206973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:31.238313 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ad4c505-5978-43b7-8c12-c7d82fc2ba0a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 204 len: 0 microversion: 2.26 time: 0.140835 Aug 30 18:14:31.247327 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 489/1070] 10.222.0.25 () {60 vars in 1295 bytes} [Tue Aug 30 18:14:31 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:31.256950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e5695a9d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.283485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.284830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.285491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.286124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.300335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.301338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.302106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.303421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.304014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.305344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.404928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.406102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.407352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.431979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.432626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.433210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.469615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:31.489250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b912f53a-227f-4f82-a62c-37fda69fd670 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-632223745" status: 201 len: 0 microversion: 2.26 time: 0.238783 Aug 30 18:14:31.496322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 490/1071] 10.222.0.25 () {62 vars in 1377 bytes} [Tue Aug 30 18:14:31 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-632223745 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 18:14:31.505267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd547e1-673a-4754-9a1c-3d4a9807b825", "tag": "99d8e338-aa4a-4a26-97e4-8effa5a33695"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:31.512538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:31.518215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.519080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.519569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.539884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] Creating event network-changed:99d8e338-aa4a-4a26-97e4-8effa5a33695 for instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 on n-h1-854119-10 Aug 30 18:14:31.548607 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-df06434d-a283-45c8-b726-90c5a50664a6 req-06e60bfa-7665-4232-8043-82024288b70a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050498 Aug 30 18:14:31.550287 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 491/1072] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:31.558150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e571d5670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.579928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.579928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.579928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.581368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.589949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.590262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.590745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.591692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.592563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.593130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.627624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.628253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.628699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.640666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.641205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.641642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.649162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:31.674677 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68050ac6-0ac5-4942-9fc2-8f84142999a5 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.716796 Aug 30 18:14:31.679082 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 582/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:30 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:31.696641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.701562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.703734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:31.714687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.715902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.716599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.717766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.719207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.719919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.722070 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-278aea0f-1e18-4301-8173-a21d0ddb1c7a tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-932109005" status: 201 len: 0 microversion: 2.26 time: 0.170029 Aug 30 18:14:31.727432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 492/1074] 10.222.0.25 () {62 vars in 1377 bytes} [Tue Aug 30 18:14:31 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-932109005 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 18:14:31.728352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:31.734676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56998430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.756626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.765576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.765993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.766538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.779652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.780357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.780797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.781524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.781980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.782437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.815038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.816172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.818278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.860955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:31.893123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7d3a809a-821f-4917-b88e-dce0a4180b96 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 204 len: 0 microversion: 2.26 time: 0.162232 Aug 30 18:14:31.894433 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 493/1075] 10.222.0.25 () {60 vars in 1295 bytes} [Tue Aug 30 18:14:31 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:31.910095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b477188-5688-4dde-bb9d-de6c87fc4acd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e568a0b80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.927073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b477188-5688-4dde-bb9d-de6c87fc4acd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.928531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b477188-5688-4dde-bb9d-de6c87fc4acd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.929442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b477188-5688-4dde-bb9d-de6c87fc4acd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.948440 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b477188-5688-4dde-bb9d-de6c87fc4acd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 12 microversion: 2.26 time: 0.047307 Aug 30 18:14:31.954453 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 494/1076] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:14:31 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:14:31.966650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:31.968583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 56f25fbd-7818-40e2-9a03-e0cd21113f3d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:31.979971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.980607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.981057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:31.982093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:31.982650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:31.983307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.001032 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d HTTP/1.1 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '56f25fbd-7818-40e2-9a03-e0cd21113f3d'} Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.002904 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 56f25fbd-7818-40e2-9a03-e0cd21113f3d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:32.011086 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-79a536fe-d219-44e4-b474-e05f7689dbec tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d" status: 404 len: 111 microversion: 2.1 time: 0.045713 Aug 30 18:14:32.014019 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 495/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:31 2022] GET /compute/v2.1/servers/56f25fbd-7818-40e2-9a03-e0cd21113f3d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:32.020994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e5696a1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.029958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.030653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.031112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.031592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.038910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.039398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.039828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.040542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.040989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.041624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.094614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.095578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.096718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.099759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:32.119882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bdca33ec-9051-4c36-8f67-d072c87f3a6d tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 0.434766 Aug 30 18:14:32.136478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 583/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:31 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:32.138535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:32.150826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae07e7bd-9b5c-49f8-a710-5e5ad8776d77 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e56de9040>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.179261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61e36c06-86ae-4fe1-9a37-f3c20c911f7f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 204 len: 0 microversion: 2.26 time: 0.163790 Aug 30 18:14:32.186536 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 496/1079] 10.222.0.25 () {60 vars in 1295 bytes} [Tue Aug 30 18:14:32 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:32.186536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.186998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.204504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.205004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.205445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.206186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.206682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.207119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.222007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ae07e7bd-9b5c-49f8-a710-5e5ad8776d77 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Image not found. Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae07e7bd-9b5c-49f8-a710-5e5ad8776d77 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306 HTTP/1.1 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b69dbd59-380d-43e1-a166-a9546b968306'} Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b69dbd59-380d-43e1-a166-a9546b968306 to delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b69dbd59-380d-43e1-a166-a9546b968306 could not be found. Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.225818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:14:32.233562 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.241467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae07e7bd-9b5c-49f8-a710-5e5ad8776d77 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:32.241769 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae07e7bd-9b5c-49f8-a710-5e5ad8776d77 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306" status: 404 len: 62 microversion: 2.1 time: 0.100295 Aug 30 18:14:32.243303 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 584/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:32 2022] DELETE /compute/v2.1/images/b69dbd59-380d-43e1-a166-a9546b968306 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:14:32.263641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56daa0d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.297815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.298890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.300069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.301707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.338465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.349148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.349489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.355419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.355973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.356576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.408622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.409113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.409754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.421063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.421877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.422691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.471734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:32.506736 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29029d50-d117-4dea-a1f2-067cf276989e tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-2110676291" status: 201 len: 0 microversion: 2.26 time: 0.260977 Aug 30 18:14:32.509773 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 585/1081] 10.222.0.25 () {62 vars in 1380 bytes} [Tue Aug 30 18:14:32 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-2110676291 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 18:14:32.520573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.521776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.537134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.538566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.539567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.541538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.542750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.543808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.582850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 HTTP/1.1 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '566744c6-79e2-421c-8020-0d662f154579'} Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:32.586182 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.590894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:32.592843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d296fa9-dfb1-4a94-b144-378e98c61904 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 404 len: 111 microversion: 2.1 time: 0.079196 Aug 30 18:14:32.592843 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 586/1082] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:32 2022] DELETE /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:32.605176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56e66310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.634976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.642798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.654918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.658519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.686693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.687587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.695214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.696900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.697917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.698708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.812086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.815455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.816215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.845096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.845882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.846539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.879366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:32.892454 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-458d4443-d949-4e8b-9592-51a07600562a tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 0.711093 Aug 30 18:14:32.897581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 497/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:32 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:32.903646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.905220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:32.910274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 566744c6-79e2-421c-8020-0d662f154579] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.936579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.937408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.938025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.940129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.941975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7ae8b5d-87fb-4025-b06b-42b2ef6e6525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-376567554" status: 201 len: 0 microversion: 2.26 time: 0.348211 Aug 30 18:14:32.942805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.943450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.950489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 587/1084] 10.222.0.25 () {62 vars in 1377 bytes} [Tue Aug 30 18:14:32 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags/tempest-tag-376567554 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 18:14:32.956035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:32.967285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:32.974313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.975317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.975943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.976706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:32.977176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:32.977607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:32.984763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 HTTP/1.1 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '566744c6-79e2-421c-8020-0d662f154579'} Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.986387 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 566744c6-79e2-421c-8020-0d662f154579 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:32.991036 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e25bfadc-95a0-4175-a017-2dbcbc879e72 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579" status: 404 len: 111 microversion: 2.1 time: 0.088942 Aug 30 18:14:32.993941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 498/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:32 2022] GET /compute/v2.1/servers/566744c6-79e2-421c-8020-0d662f154579 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:33.002931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Action: 'update_all', calling method: .version_select at 0x7f4e568a0e50>, body: {"tags": ["tempest-tag-1399962577", "tempest-tag-1101353505"]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:33.024927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.026612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.026612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.026982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.046194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.046718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.047161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.047901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.048349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.048765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.132587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.133431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.143703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.213927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:33.235247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:33.248592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00c51907-eecc-4b88-abdc-afb7d08704fe tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.296602 Aug 30 18:14:33.249198 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 588/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:32 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.286683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91d5a833-ac46-4841-83b8-2e99aeb04f2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e56de9670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.309438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d24e62c6-f396-414d-87e2-9c74fb14c2bf tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 62 microversion: 2.26 time: 0.310359 Aug 30 18:14:33.322909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 499/1087] 10.222.0.25 () {62 vars in 1312 bytes} [Tue Aug 30 18:14:32 2022] PUT /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 62 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.355265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.360794 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91d5a833-ac46-4841-83b8-2e99aeb04f2c tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266258920" status: 202 len: 0 microversion: 2.1 time: 0.092786 Aug 30 18:14:33.360966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.362331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 589/1088] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:14:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266258920 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:14:33.374543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04d0cdeb-7fbc-4eaf-b064-5e503e5d4ec6 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56daab80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.390313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04d0cdeb-7fbc-4eaf-b064-5e503e5d4ec6 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.391045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.391668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.392226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.396218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04d0cdeb-7fbc-4eaf-b064-5e503e5d4ec6 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.397062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04d0cdeb-7fbc-4eaf-b064-5e503e5d4ec6 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.398578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.399103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.399549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.424740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04d0cdeb-7fbc-4eaf-b064-5e503e5d4ec6 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 200 len: 62 microversion: 2.26 time: 0.054619 Aug 30 18:14:33.428104 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 590/1089] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 18:14:33 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 62 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.449601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '.version_select at 0x7f4e56ef7670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.477459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.478644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.479538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.480551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:33.481556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.497616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.499415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.500915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.503311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.504105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.507036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.574646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.575107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.575847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.616235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'flavor' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:33.674817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-501368d0-32e0-49b1-b7cf-70cf36cb0525 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags" status: 204 len: 0 microversion: 2.26 time: 0.233753 Aug 30 18:14:33.677290 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 591/1090] 10.222.0.25 () {60 vars in 1295 bytes} [Tue Aug 30 18:14:33 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651/tags => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:33.695716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.696681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.709130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.710687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.711390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.712314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.714535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.715199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.774969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:14:33.787272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:33.803786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46ec14a9-4807-485f-bf8c-02219b0e8394 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 0.477743 Aug 30 18:14:33.804554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 500/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:33 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:33.944002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:33.946466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:33.959750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.960647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.961342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.962294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:33.964412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:33.969625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:33.995589 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c4f3841-12ff-465d-a2ba-79bdcb23f236 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 204 len: 0 microversion: 2.26 time: 0.306352 Aug 30 18:14:34.000230 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 592/1092] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:14:33 2022] DELETE /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:14:34.019059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:34.023262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:34.036792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.038002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.038803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.039859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.040605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.041924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.390602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.399784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.401667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.403128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d55c641d-7f39-4836-9e44-9bed963aeebd tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1552 microversion: 2.26 time: 0.395758 Aug 30 18:14:34.419046 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 593/1093] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:34 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1552 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:34.426394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1156129425", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "2a276390-21e3-480e-8639-5bd55ca03773"}], "security_groups": [{"name": "tempest-securitygroup--74199664"}], "key_name": "tempest-keypair-883248818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:34.440427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.455258 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47aec8c3-ffaf-4950-bb3c-18848a5e1458 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 0.520891 Aug 30 18:14:34.457350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 501/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:33 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:34.474964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:34.475586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:34.507121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.510611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.511274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.518099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.518838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.519411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.781444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] validate_networks() for [('2a276390-21e3-480e-8639-5bd55ca03773', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:34.873647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:34.875042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:34.891381 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c97612a-99b5-43f2-a7b9-6f7d5c2590ef tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.431978 Aug 30 18:14:34.892530 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 502/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:34 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:34.898879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b196be61-15ff-463e-809d-06cde47e2659", "name": "network-vif-plugged", "status": "completed", "tag": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:34.918496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.919670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.920400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.941872 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] Creating event network-vif-plugged:49ef7eb4-d408-451a-bad8-f36e4ffcaff2 for instance b196be61-15ff-463e-809d-06cde47e2659 on n-h2-854119-10 Aug 30 18:14:34.949389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-61a08f7b-55a5-490b-a090-5481586a9efc req-4d52b2a1-5d89-4477-9799-c0913e25af72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054728 Aug 30 18:14:34.950070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 503/1096] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:34.958561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:34.959411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:34.968044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.969035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.969566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:34.970414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:34.971122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:34.971769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:35.757451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:35.758433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:35.759500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:35.760472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:35.760988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:35.790133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:35.792612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:35.793335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:35.795318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:35.796062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:35.796701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:35.826727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:35.843144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for user 6774c9dbc6b44018a09893dabeee643a and project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:35.890088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:35.893028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:36.024275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba76cd83-8e1c-4463-8e56-1158d271bc7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 1.603550 Aug 30 18:14:36.025420 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 594/1097] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:14:34 2022] POST /compute/v2.1/servers => generated 404 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:14:36.050975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:36.051884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:36.096507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.097407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.099141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.100618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.101414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.102047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.320595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.344624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d211e6e5-01d2-4039-9b57-52aec0f5efe8 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1324 microversion: 2.1 time: 1.393113 Aug 30 18:14:36.345236 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 504/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:34 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1324 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:36.364457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:36.365364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:36.373180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.374079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.375095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.376146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.376904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.377582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.594616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.643729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.651285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.656777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b78ec7a-fb95-4d2f-ad33-a491cbd349ac tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1552 microversion: 2.26 time: 0.622427 Aug 30 18:14:36.673008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 595/1099] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:36 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1552 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:36.703750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:36.704950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:36.718457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.719926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.721145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.722467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:36.723561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:36.724844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:36.921367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:36.951520 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0404399-7e80-4073-abc3-b282f006ef72 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 0.595457 Aug 30 18:14:36.969228 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 505/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:36 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:36.985444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:36.987986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:36.999626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.000632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.002287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.003272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.003842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.004366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.104652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=18 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:37.244419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:37.275868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:37.282505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:37.301014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-315bad0c-8895-4c97-9246-998a53f32d5b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1289 microversion: 2.25 time: 0.329210 Aug 30 18:14:37.302299 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 506/1101] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:36 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1289 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:37.319081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f96c05e-3eae-4260-9407-5cdb46f13dcd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '.version_select at 0x7f4e5683e550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:37.398053 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2f96c05e-3eae-4260-9407-5cdb46f13dcd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Image not found. Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f96c05e-3eae-4260-9407-5cdb46f13dcd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/68c1bcb2-aca6-4710-bd7b-bfb56aecdf27 HTTP/1.1 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '68c1bcb2-aca6-4710-bd7b-bfb56aecdf27'} Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 68c1bcb2-aca6-4710-bd7b-bfb56aecdf27 to delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 68c1bcb2-aca6-4710-bd7b-bfb56aecdf27 could not be found. Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:37.401357 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f96c05e-3eae-4260-9407-5cdb46f13dcd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f96c05e-3eae-4260-9407-5cdb46f13dcd tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/images/68c1bcb2-aca6-4710-bd7b-bfb56aecdf27" status: 404 len: 62 microversion: 2.1 time: 0.099888 Aug 30 18:14:37.414117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 507/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:37 2022] DELETE /compute/v2.1/images/68c1bcb2-aca6-4710-bd7b-bfb56aecdf27 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:14:37.417822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:37.417822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:37.472546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.473793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.474951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.476507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.477579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.478778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.656209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:37.671075 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84ab0866-e4cb-41f4-9800-9c7604d3f380 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.995636 Aug 30 18:14:37.673236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 596/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:36 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:37.687406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:37.687929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:37.709451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.709853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.710295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.727013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.735217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.735679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.793893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 HTTP/1.1 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87'} Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:37.798500 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:37.809639 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:37.824295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:37.826479 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b90dd713-52d8-4f39-a1fb-3029d339d6c5 tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 404 len: 111 microversion: 2.1 time: 0.151614 Aug 30 18:14:37.827879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 597/1104] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:14:37 2022] DELETE /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:37.841483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9f808d-db67-4977-8c4a-8147f63e6651", "name": "network-vif-deleted", "tag": "e72c2170-7292-424b-bf6b-dfaf0a39cde3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:37.863551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.866537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.867614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.900210 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] Creating event network-vif-deleted:e72c2170-7292-424b-bf6b-dfaf0a39cde3 for instance 5a9f808d-db67-4977-8c4a-8147f63e6651 on n-h1-854119-10 Aug 30 18:14:37.911532 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4844b1e0-5331-4973-a671-7c7d01706d18 req-3b571664-9263-4d6f-94a7-2963eda91570 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080954 Aug 30 18:14:37.913555 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 598/1105] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:37.928153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:37.931263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:37.953854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.955088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.956029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:37.957443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:37.958329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:37.959369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.015403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:38.044175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.046368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.047728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.049225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lazy-loading 'fault' on Instance uuid 5a9f808d-db67-4977-8c4a-8147f63e6651 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:14:38.164714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:38.194948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:38.200645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4c5229054ca4dbc864425bfbc0a914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9836eb8ab034fa28b441266c4b0a325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:38.205917 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ea132f1-10a3-47d2-b8d5-d4b647ed0e1f tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 200 len: 1352 microversion: 2.26 time: 0.287772 Aug 30 18:14:38.207751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 599/1106] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:37 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 1352 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:38.258710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:38.261298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] [instance: 2ee35143-2128-4f32-9513-d0a3dee51d87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:38.286230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:38.311888 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f64b2b94-2144-461e-b37a-c1b92a8f0b00 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 200 len: 1521 microversion: 2.1 time: 0.904261 Aug 30 18:14:38.312407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.313658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.314849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.317857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.319460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.320557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.333808 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 508/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:37 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 1521 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:38.342406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:38.351332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:38.390966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.391781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.392499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.393686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.394483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.395165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.407905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] HTTP exception thrown: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Request method failure captured: Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 HTTP/1.1 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLpSbRBSOX3eOTgZepznooL8GlVDoesOoYF2mVshJhtMEHqiABsuNhYh3SI1Vu-nvhK9c433lvNg4lEv25JXhkXceF8jfEq1l8wP-ElTGj5lQdldPathSqPCkyWj6a64yw0CcUb7E4ig8mlFtgqqAIwSeftq_7leNeNftTpgV6G0Hg Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba69efb209b4468f8d3d69cf0850c320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ba69efb209b4468f8d3d69cf0850c320 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8526d208810247feaf96b54f55452d07 Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2044055985-project Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2ee35143-2128-4f32-9513-d0a3dee51d87'} Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.414176 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. Aug 30 18:14:38.428437 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:14:38.443584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] Returning 404 to user: Instance 2ee35143-2128-4f32-9513-d0a3dee51d87 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:38.451873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4563fdaf-8e89-465c-971f-0b75b7aa9afe tempest-ImagesOneServerNegativeTestJSON-2044055985 tempest-ImagesOneServerNegativeTestJSON-2044055985-project] 10.222.0.25 "GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87" status: 404 len: 111 microversion: 2.1 time: 0.238301 Aug 30 18:14:38.453040 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 600/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:38 2022] GET /compute/v2.1/servers/2ee35143-2128-4f32-9513-d0a3dee51d87 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:14:38.462784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:38.464652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:38.477641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.479373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.481198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:38.483403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:38.484487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:38.485561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:39.247905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:39.269355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:39.275209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:39.280249 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfaddd11-09e5-445e-aac1-93ddaeff111a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1337 microversion: 2.25 time: 0.825411 Aug 30 18:14:39.283209 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 601/1109] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:38 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1337 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:39.295821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: .version_select at 0x7f4e589fe280>, body: {"addFloatingIp": {"address": "172.25.2.122"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:39.308094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:39.334201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:39.335593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:39.336837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:39.338869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:39.340712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:39.341954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:39.504149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:14:39.505750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquired lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:14:39.554977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:39.571225 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-81a73366-fc6b-46bc-ac97-ccb90a6540c9 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 1.241355 Aug 30 18:14:39.572301 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 509/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:38 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:39.593484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:39.594481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:39.604777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:39.605504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:39.606185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:39.607173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:39.607998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:39.608587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.041874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:40.063728 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cacea815-9815-4935-a701-eb7b9c2e344e tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.480188 Aug 30 18:14:40.066926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 510/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:39 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:40.079593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:40.081759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] [instance: 5a9f808d-db67-4977-8c4a-8147f63e6651] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:40.095881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.096487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.097257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.099758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.100827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.101911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.135342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] HTTP exception thrown: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Request method failure captured: Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 HTTP/1.1 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlNr3qyQszkglXLmubOt2Qq-54NZVOVOfr36q0pkSFlwjQ-ka23eih6qDvWv7FQRUDHyPi5IjhVb5wJzDw4XvZJByatJeDeW4D0J9xqfofo9nPVODH6ycASnKbpdtfntc5chlaCG1_X80vfc-6UhwQkRO_6k_Yim_6EO3vmKQI_iKzk Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.26 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d9836eb8ab034fa28b441266c4b0a325 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerTagsTestJSON-907663763 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9836eb8ab034fa28b441266c4b0a325"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9836eb8ab034fa28b441266c4b0a325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9836eb8ab034fa28b441266c4b0a325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9836eb8ab034fa28b441266c4b0a325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerTagsTestJSON-907663763 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d9836eb8ab034fa28b441266c4b0a325 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerTagsTestJSON-907663763 Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerTagsTestJSON-907663763-project Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c4c5229054ca4dbc864425bfbc0a914e Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerTagsTestJSON-907663763-project Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5a9f808d-db67-4977-8c4a-8147f63e6651'} Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:40.153870 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] Returning 404 to user: Instance 5a9f808d-db67-4977-8c4a-8147f63e6651 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:40.163069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-607ae930-0e8f-4a02-b273-8768aa73a915 tempest-ServerTagsTestJSON-907663763 tempest-ServerTagsTestJSON-907663763-project] 10.222.0.25 "GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651" status: 404 len: 111 microversion: 2.26 time: 0.088218 Aug 30 18:14:40.167018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 511/1112] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:40 2022] GET /compute/v2.1/servers/5a9f808d-db67-4977-8c4a-8147f63e6651 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:14:40.332082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:40.333788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:40.347094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.348588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.350104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.352301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:40.353521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:40.354665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:40.653179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:40.669715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:40.673227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:40.676285 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60cf35d5-e866-445c-b4b2-acfd3992e141 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1343 microversion: 2.25 time: 0.351467 Aug 30 18:14:40.677594 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 512/1113] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:40 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1343 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:14:41.150518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd547e1-673a-4754-9a1c-3d4a9807b825", "name": "network-vif-plugged", "status": "completed", "tag": "99d8e338-aa4a-4a26-97e4-8effa5a33695"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:41.164299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.165098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.165731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.212961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] Creating event network-vif-plugged:99d8e338-aa4a-4a26-97e4-8effa5a33695 for instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 on n-h1-854119-10 Aug 30 18:14:41.243997 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8a8e2329-0369-4ece-ba0d-84a0f0e41062 req-e9da0a0a-8101-4bd7-99b1-58ed0a696566 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.560054 Aug 30 18:14:41.247771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 513/1114] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:41.311727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:41.315591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:41.386050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.388185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.393241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:41.395397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:41.396946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:41.398284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:42.480745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:42.494483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e010f4f3-75a7-404d-8788-675ae886b87f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1317 microversion: 2.1 time: 1.241480 Aug 30 18:14:42.495274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 514/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:41 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1317 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:42.518839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:42.519581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:42.528599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:42.529143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:42.529637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:42.530403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:42.530914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:42.531341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:42.657229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:14:43.379535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:43.398786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bdd10309-9984-4733-a6b6-49f5cdd0c146 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1473 microversion: 2.1 time: 0.880671 Aug 30 18:14:43.431566 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 515/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:42 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1473 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:43.455111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:43.466122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:43.493207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:43.496533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:43.497313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:43.503567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:43.512247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:43.513281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:44.969156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Updating instance_info_cache with network_info: [{"id": "358c71c5-7010-4e0a-9842-f183ccefc05e", "address": "fa:16:3e:30:f5:61", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap358c71c5-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:14:44.994572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Releasing lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:14:44.995477 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b39f7258-7d6c-4194-ab3f-4f80fa765fff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action" status: 202 len: 0 microversion: 2.1 time: 5.709149 Aug 30 18:14:44.996120 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 602/1117] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:39 2022] POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action => generated 0 bytes in 5710 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:14:45.012807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:45.058476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.059336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.081819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.145847 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] Creating event network-changed:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:14:45.168256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-dd68d6b6-7645-437f-a912-3122410a6a19 req-0265a629-0ebf-49a7-94d0-a56e915a24aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168094 Aug 30 18:14:45.171911 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 603/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:45.195689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:45.206716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:45.247960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.256695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.257816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.259589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.266690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.267924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.769536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:45.803466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:45.807086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:45.816286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:45.832649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-793f37e9-3ff0-42bd-b626-aa712ca826e9 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1409 microversion: 2.25 time: 2.378640 Aug 30 18:14:45.835024 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 516/1119] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:43 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1409 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:45.843848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:45.857226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:45.857461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:45.858880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:45.872837 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20004473-351c-44b7-be7a-4e88c631c804 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1507 microversion: 2.1 time: 0.698126 Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.887216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.896209 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 604/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:45 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1507 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:45.904271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.122"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:45.908872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:45.921460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.922201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.922959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.924733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:45.927145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:45.928596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:45.978326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:14:45.979341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquired lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:14:46.438964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:46.471804 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59419e24-8b1c-420b-b020-2b32d663178d tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 0.625951 Aug 30 18:14:46.473791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 517/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:45 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:46.487677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:46.489208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:46.502513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:46.503547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:46.504494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:46.506132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:46.507248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:46.508228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:47.468585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:47.483314 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-315b3862-9099-490e-aba6-1359d9a0f639 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1507 microversion: 2.1 time: 1.005764 Aug 30 18:14:47.501257 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 518/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:46 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1507 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:48.108268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecc732e0-f48b-4f1b-a41e-84611af941ca tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-951314075", "id": 1519685281, "os-flavor-access:is_public": "False"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:48.140280 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecc732e0-f48b-4f1b-a41e-84611af941ca tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.637671 Aug 30 18:14:48.141318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 519/1123] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:14:47 2022] POST /compute/v2.1/flavors => generated 438 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:48.147871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:48.149573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:48.159315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:48.161580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:48.162594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:48.163766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:48.164615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:48.165614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:49.082519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:49.106400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:49.108498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:49.109885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac145814-9c6c-4f3f-b4ac-ac3a5e2fbfed tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1409 microversion: 2.25 time: 0.967547 Aug 30 18:14:49.110676 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 520/1124] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:48 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1409 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:49.127500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:49.147679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:49.149599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:49.150305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:49.182964 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] Creating event network-changed:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h2-854119-10 Aug 30 18:14:49.188900 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8ccea6da-60f3-4214-9dea-8220e1ec26c4 req-38689195-f37f-4dba-b60a-e2a0428ce606 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076679 Aug 30 18:14:49.199596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 521/1125] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:49.205260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:49.205959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:49.213777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:49.214811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:49.215438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:49.216354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:49.217008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:49.218196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:50.418872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:50.443373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-27a5295c-0ccd-457a-84e0-0d01c6a3fff8 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 1.237725 Aug 30 18:14:50.445260 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 522/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:49 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:50.463481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:50.477191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:50.495144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:50.500582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:50.502089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:50.503827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:50.505032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:50.506111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:50.704929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:50.757463 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dfae9214-a564-408b-b24a-9ec4f3d4b385 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "PUT /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1079 microversion: 2.1 time: 0.310012 Aug 30 18:14:50.758540 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 523/1127] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:14:50 2022] PUT /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1079 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:50.765063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-43c5c3e8-f480-4f7f-a097-9b7c547b9511 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:50.998767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-43c5c3e8-f480-4f7f-a097-9b7c547b9511 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1519685281/action" status: 200 len: 97 microversion: 2.1 time: 0.236353 Aug 30 18:14:51.004767 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 524/1128] 10.222.0.25 () {60 vars in 1200 bytes} [Tue Aug 30 18:14:50 2022] POST /compute/v2.1/flavors/1519685281/action => generated 97 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:14:51.028995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:51.032940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:51.065067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:51.071264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:51.072344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:51.076929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:51.081357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:51.082368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:51.677362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:51.713058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:51.716048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:51.727274 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f0f8dd2-8c07-47d2-bba1-9cedce9e472f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1409 microversion: 2.25 time: 0.720238 Aug 30 18:14:51.728479 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 525/1129] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:51 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1409 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:51.752320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:51.753370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:51.776524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:51.777344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:51.778085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:51.779386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:51.791039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:51.794292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:52.429316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:52.455884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ee47a2e-2c1a-4169-8e28-27810698af1d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1505 microversion: 2.1 time: 0.725735 Aug 30 18:14:52.465324 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 526/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:51 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:52.481945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc5bd807-b93a-4237-bb87-b2597cb80064 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:52.713304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.neutron [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] re-assign floating IP 172.25.2.122 from instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d Aug 30 18:14:52.888073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:14:52.946159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-fc5bd807-b93a-4237-bb87-b2597cb80064 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc5bd807-b93a-4237-bb87-b2597cb80064 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Request method failure captured: Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/flavors/1519685281/action HTTP/1.1 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 67 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlOU3bDJGADnd9Cqzm10QaTuCS-qDtSST2bEHHNxgPQ5P8BKV2Skql4s6ok-vFBjxVe5jvVNzX_1tQHIR7k6ewN4tial6B02l-4Fn6caC0Cn_VLgppFt7ITl0ZgIEwH4BY3xvScJNHaAQIqTZtwe0ell4TTAumcSyCUSQD4JVubtIUc Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: f04660508aa64fd98370c3b2b2ce4060 Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: exception: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1519685281', 'body': {'addTenantAccess': {'tenant': '2bdef0f6d4434b438ebaf876a4eaf16b'}}} Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-2bdef0f6d4434b438ebaf876a4eaf16b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.953392 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:14:52.961908 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-2bdef0f6d4434b438ebaf876a4eaf16b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 18, 14, 52, 938468), 'updated_at': None, 'flavor_id': 35, 'project_id': '2bdef0f6d4434b438ebaf876a4eaf16b'}] Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. Aug 30 18:14:52.970917 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:52.977663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc5bd807-b93a-4237-bb87-b2597cb80064 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 2bdef0f6d4434b438ebaf876a4eaf16b combination. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:52.991732 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc5bd807-b93a-4237-bb87-b2597cb80064 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1519685281/action" status: 409 len: 152 microversion: 2.1 time: 0.511222 Aug 30 18:14:53.001985 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 527/1131] 10.222.0.25 () {60 vars in 1200 bytes} [Tue Aug 30 18:14:52 2022] POST /compute/v2.1/flavors/1519685281/action => generated 152 bytes in 535 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:14:53.014774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-unplugged", "status": "completed", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:53.047353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:53.048392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:53.049803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:53.082472 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] Creating event network-vif-unplugged:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:14:53.101121 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-593a602f-41c4-4653-87e3-33db8ed7292c req-7d85961d-ed2b-4c8a-b0b0-13aa72b9ad6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096508 Aug 30 18:14:53.105639 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 528/1132] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:53.134190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:53.138381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:53.173245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:53.174144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:53.174970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:53.176277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:53.180835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:53.182572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:53.935129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:53.957069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68fc0b83-a89d-4521-9333-8ec77b635887 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 0.848349 Aug 30 18:14:53.972659 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 529/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:53 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:53.987046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:53.988484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:54.014217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:54.017253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:54.018093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:54.019682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:54.020533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:54.022492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:54.669732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:54.695713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9313175f-6bbc-41cf-9cb9-c9e53d1d4092 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1505 microversion: 2.1 time: 0.720718 Aug 30 18:14:54.702599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 530/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:53 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1505 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:54.744954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:54.802206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:54.803261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:54.803987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:54.883204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] Creating event network-changed:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:14:54.900309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-121c9cc7-3fe1-4643-9dc7-15c0800aea90 req-4c594723-4a41-4896-a8fe-15092a2deb49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193462 Aug 30 18:14:54.903661 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 531/1135] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:54.915273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:54.918161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:54.931769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:54.933074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:54.934237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:54.936097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:54.937425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:54.938482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:54.954267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Updating instance_info_cache with network_info: [{"id": "358c71c5-7010-4e0a-9842-f183ccefc05e", "address": "fa:16:3e:30:f5:61", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap358c71c5-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:14:54.999360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:14:55.752996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:55.770210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:55.772576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:55.776164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-54536119-3de5-4c12-bd9d-bb364d6fe714 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1409 microversion: 2.25 time: 0.869895 Aug 30 18:14:55.780733 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 532/1136] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:54 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1409 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:55.789906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e0e9fb6-b6d1-4f44-84d7-4cb2e0050b6e tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:55.914309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:56.173922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:14:56.209294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e0e9fb6-b6d1-4f44-84d7-4cb2e0050b6e tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1519685281/action" status: 200 len: 21 microversion: 2.1 time: 0.427083 Aug 30 18:14:56.213522 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 533/1137] 10.222.0.25 () {60 vars in 1200 bytes} [Tue Aug 30 18:14:55 2022] POST /compute/v2.1/flavors/1519685281/action => generated 21 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:14:56.235446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:56.238845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:56.253671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.258676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.259132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.269143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.269685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.270194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.498841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:56.507406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:56.510394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:56.511555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:56.512587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:56.703609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Updating instance_info_cache with network_info: [{"id": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2", "address": "fa:16:3e:ae:90:92", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap49ef7eb4-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:14:56.720784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:56.725759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Releasing lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:14:56.727586 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e670cd2-52f0-4f05-8797-05bddd56a87c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659/action" status: 202 len: 0 microversion: 2.1 time: 10.830752 Aug 30 18:14:56.729115 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 605/1138] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:45 2022] POST /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659/action => generated 0 bytes in 10834 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:14:56.734599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.735111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.735752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.736721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.737629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.738224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.774699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4377415-3bb4-4e9e-82a3-00e4d81459a0 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "POST /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825/action" status: 202 len: 1111 microversion: 2.1 time: 0.559522 Aug 30 18:14:56.775726 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 534/1139] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:56 2022] POST /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825/action => generated 1111 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 18:14:56.795980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:56.796638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:56.811239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.812126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.812753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.813720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:56.814375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:56.814962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:56.949957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13e47b3c-6a8a-41cd-b70d-0538fa5bf192 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56ebd9d0>, body: {"keypair": {"name": "tempest-keypair-168289001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSHGER5ys5iu79Zvy+ptH4fBis7zsWzy4PNOagNE+vFT8Xkxy+S6JSSyeTvaZRb0eKM1Pzw8m8N9b4VNJIJvVcHm/acpc3XTUkiLmzO8XfXAmea0tA2ZBzTl9/qPo7jg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:56.989558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-13e47b3c-6a8a-41cd-b70d-0538fa5bf192 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:57.002471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-13e47b3c-6a8a-41cd-b70d-0538fa5bf192 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:57.068128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13e47b3c-6a8a-41cd-b70d-0538fa5bf192 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.334402 Aug 30 18:14:57.077220 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 606/1140] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:14:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:14:57.089066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "name": "network-vif-plugged", "status": "completed", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:57.111454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:57.111838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:57.112281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:57.139899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] Creating event network-vif-plugged:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h2-854119-10 Aug 30 18:14:57.145866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1335468e-235c-432e-8113-167095ea1cd1 req-ba21ccbf-a61b-46c7-aa0d-a24f86e19663 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066625 Aug 30 18:14:57.146943 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 607/1141] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:57.235076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-767471094", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "445576bb-99fb-47b7-aa8f-b3a8f1af7c27"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:57.326509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] validate_networks() for [('445576bb-99fb-47b7-aa8f-b3a8f1af7c27', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:14:57.615156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:57.627256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92ca5f2e-4146-4b14-9b56-28cd758d732a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 0.836169 Aug 30 18:14:57.642878 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 535/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:56 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:57.649528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4168524c-8d92-47a8-b63f-cc968dfd066c tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:57.694413 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4168524c-8d92-47a8-b63f-cc968dfd066c tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1519685281" status: 202 len: 0 microversion: 2.1 time: 0.049850 Aug 30 18:14:57.695371 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 536/1143] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:14:57 2022] DELETE /compute/v2.1/flavors/1519685281 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:14:57.702896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: .version_select at 0x7f4e589b4b80>, body: {"removeFloatingIp": {"address": "172.25.2.122"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:58.203530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:14:58.205655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:14:58.207233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:14:58.208338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:14:58.209433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:14:58.254997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.256758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.257858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:58.264651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:58.272004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.274130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.278970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:58.291941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.292363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.294014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:58.298789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.301216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.305156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:58.339514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Getting quotas for project 0056a7a8b2fc4497a61f73751eaeed29. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:14:58.356383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Getting quotas for user 013ace46f78c44fda2b666fb2ef598f8 and project 0056a7a8b2fc4497a61f73751eaeed29. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:14:58.385357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:14:58.391623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:14:58.538310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e5eb972-b03b-4d63-946b-2b205b04ce1e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389420 Aug 30 18:14:58.541478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 608/1144] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:14:58.579624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:58.580487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:58.607738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.611587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.612670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:58.615319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:58.622737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:58.626431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.035970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.063347 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] HTTP exception thrown: Floating IP 172.25.2.122 is not associated with instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d. Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Request method failure captured: Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action HTTP/1.1 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 49 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlNWqafb8gCTx47jvg5Ch0x8G8mFBtNHqm1jwKELiooZb-83HgcEgZNtL6xWGVMtylIJzMMGEMq5FEBeiOxXv6T7OQ4GQNhRhquRB416LuUfdFm71SMjwArLs52hH9bevl_zzhorjdHxFRIg383uE11FMnvD4ipx3rgXyTkdEDimjvE Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a547e08e089e4911a3035ef8416dca57 Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: {"removeFloatingIp": {"address": "172.25.2.122"}} Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: exception: Floating IP 172.25.2.122 is not associated with instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d. Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'c0cfa889-9e0e-45aa-8f14-d4b39a05701d', 'body': {'removeFloatingIp': {'address': '172.25.2.122'}}} Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.122 is not associated with instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d. Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.122 is not associated with instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d. Aug 30 18:14:59.066562 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:14:59.071141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Returning 409 to user: Floating IP 172.25.2.122 is not associated with instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:14:59.071359 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53807e5c-4a62-4e3d-8f97-c26ba702be55 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.516083 Aug 30 18:14:59.071503 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2328a08d-7e45-48f4-be50-0031bfd7cdff tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action" status: 409 len: 146 microversion: 2.1 time: 1.373209 Aug 30 18:14:59.076222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 537/1145] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:57 2022] POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action => generated 146 bytes in 1380 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:14:59.103424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.104502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:59.106262 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 609/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:58 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:59.122221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b196be61-15ff-463e-809d-06cde47e2659", "tag": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:59.130627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.132937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.133471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.134830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.135698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.137020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.142709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.142909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.144106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.186225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] Creating event network-changed:49ef7eb4-d408-451a-bad8-f36e4ffcaff2 for instance b196be61-15ff-463e-809d-06cde47e2659 on n-h2-854119-10 Aug 30 18:14:59.194073 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3b3716ea-17b3-4894-97c2-b03d005cd6b3 req-910eeaa3-57d1-4f9b-988b-63307248d06c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084660 Aug 30 18:14:59.196149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 610/1147] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:59.204287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ea2c357-e199-4e85-ae73-db2040790df3 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56cc88b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.224229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ea2c357-e199-4e85-ae73-db2040790df3 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-168289001" status: 200 len: 511 microversion: 2.2 time: 0.025960 Aug 30 18:14:59.232584 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 611/1148] 10.222.0.25 () {60 vars in 1255 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-168289001 => generated 511 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:14:59.241818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af0c6c35-9edd-400e-b3e9-00a49a11de93 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.307803 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af0c6c35-9edd-400e-b3e9-00a49a11de93 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071193 Aug 30 18:14:59.318401 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 612/1149] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:59.318401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0fcd9743-d463-46a1-9d3d-092046225a41 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.318401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0fcd9743-d463-46a1-9d3d-092046225a41 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:59.480136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0fcd9743-d463-46a1-9d3d-092046225a41 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.495270 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0fcd9743-d463-46a1-9d3d-092046225a41 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1231 microversion: 2.1 time: 0.184281 Aug 30 18:14:59.519561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 613/1150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1231 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:59.538805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:14:59.540079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:14:59.554444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.555671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.556657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.559533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.562866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.567070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.611586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.643323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.648227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.652691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f32c0cd6-1332-45e1-b2e9-5ff1f8b6b115 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1605 microversion: 2.25 time: 0.575032 Aug 30 18:14:59.669907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 538/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1605 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:14:59.692652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.122"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:59.883046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:14:59.903436 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-502dfa5a-be05-4fb0-9278-9fa008a14b7b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 0.381293 Aug 30 18:14:59.913457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 614/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:14:59 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:14:59.940822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-plugged", "status": "completed", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:14:59.954479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:14:59.956197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:14:59.956747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:14:59.991293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] Creating event network-vif-plugged:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:15:00.003465 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1de93d85-1bd0-45e9-b653-8e334448918a req-a948c008-e0df-4e3f-a394-94d5225563f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087077 Aug 30 18:15:00.004281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 615/1153] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:00.022190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb8e110e-c086-42e7-8da1-b1a4b1fed8a2 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56daaa60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:00.047305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:00.061094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.071649 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb8e110e-c086-42e7-8da1-b1a4b1fed8a2 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-168289001" status: 204 len: 0 microversion: 2.2 time: 0.065666 Aug 30 18:15:00.072803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 616/1154] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Aug 30 18:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-168289001 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:00.078044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.078549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.079354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.092510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.093022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.096591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05b2c6ac-10c0-407c-8e1f-7a571b2b9919 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1095543271", "id": 2024169340, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:00.163362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05b2c6ac-10c0-407c-8e1f-7a571b2b9919 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.089671 Aug 30 18:15:00.176331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 617/1155] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:00.190139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:00.190846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:00.214314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.215045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.215309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.216056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.216531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.219573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.521982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4140cc1-4c03-4e30-836f-fe25abc8837b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.344398 Aug 30 18:15:00.523052 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 618/1156] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:15:00 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-interface => generated 285 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:15:00.537008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-16b0ff85-97b4-494d-8fd2-90176ff850c9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56d419d0>, body: {"keypair": {"name": "tempest-keypair-859869620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBumE7sgg074TlGSINgnJST7QCxsbgeqRWEQm1ujza6RJdbTNtsaXcQwAS0Tx/QXtQerhUE1UyK9KCyfUEN9BfHkA7yZe178MG/8UroBaT5mlSssf8EIieC/JX2eNUOXQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:00.580012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-16b0ff85-97b4-494d-8fd2-90176ff850c9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:00.595826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-16b0ff85-97b4-494d-8fd2-90176ff850c9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:00.695577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-16b0ff85-97b4-494d-8fd2-90176ff850c9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.171035 Aug 30 18:15:00.712397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 619/1157] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:00.734663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:00.736145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:00.765608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.766873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.767897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:00.779768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:00.781105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:00.781592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.134113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:01.134945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquired lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:01.278101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:01.307401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06b46f7a-77ab-4562-8140-bc1d955b01a7 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.584707 Aug 30 18:15:01.309247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 620/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:00 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:01.322145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-408b3689-0e75-4ba7-95b5-6d55a49cb8fc tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:01.355355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-408b3689-0e75-4ba7-95b5-6d55a49cb8fc tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-408b3689-0e75-4ba7-95b5-6d55a49cb8fc tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Request method failure captured: Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/flavors/2024169340/os-flavor-access HTTP/1.1 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOU3bDJGADnd9Cqzm10QaTuCS-qDtSST2bEHHNxgPQ5P8BKV2Skql4s6ok-vFBjxVe5jvVNzX_1tQHIR7k6ewN4tial6B02l-4Fn6caC0Cn_VLgppFt7ITl0ZgIEwH4BY3xvScJNHaAQIqTZtwe0ell4TTAumcSyCUSQD4JVubtIUc Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: f04660508aa64fd98370c3b2b2ce4060 Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: exception: Access list not available for public flavors. Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'flavor_id': '2024169340'} Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 30 18:15:01.367963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:01.394845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-408b3689-0e75-4ba7-95b5-6d55a49cb8fc tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:01.396427 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-408b3689-0e75-4ba7-95b5-6d55a49cb8fc tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2024169340/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.084109 Aug 30 18:15:01.397412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 621/1159] 10.222.0.25 () {58 vars in 1209 bytes} [Tue Aug 30 18:15:01 2022] GET /compute/v2.1/flavors/2024169340/os-flavor-access => generated 91 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:01.413876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:01.415802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:01.434684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.437195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.438040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.439114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.439843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.440478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.755404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:01.780573 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa852138-4e10-4115-afcd-4fec70f4ed36 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1291 microversion: 2.1 time: 0.373063 Aug 30 18:15:01.791742 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 622/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:01 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1291 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:01.794117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98b92745-f7bc-425d-852a-c56ebb0c8852 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56d41c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:01.839082 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98b92745-f7bc-425d-852a-c56ebb0c8852 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859869620" status: 204 len: 0 microversion: 2.2 time: 0.050527 Aug 30 18:15:01.841295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 623/1161] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Aug 30 18:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859869620 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:01.847732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:01.848857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:01.857670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.858381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.858814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:01.860052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:01.860665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:01.861107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:02.382471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:02.395415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe194e65-1ec5-4393-8e8b-67572bb2550a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1479 microversion: 2.1 time: 0.551029 Aug 30 18:15:02.396303 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 624/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:01 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1479 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:02.415458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25a09d15-e50d-49ac-9bdd-7716c4305257 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:02.468577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25a09d15-e50d-49ac-9bdd-7716c4305257 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2024169340" status: 202 len: 0 microversion: 2.1 time: 0.070392 Aug 30 18:15:02.469837 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 625/1163] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:15:02 2022] DELETE /compute/v2.1/flavors/2024169340 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:02.483756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62a76b84-4690-4acb-bc53-a630b04a8c19 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56f7dc10>, body: {"keypair": {"name": "tempest-keypair-818856941", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:02.525858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Building network info cache for instance {{(pid=122590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:15:02.549522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-62a76b84-4690-4acb-bc53-a630b04a8c19 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:02.559862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-62a76b84-4690-4acb-bc53-a630b04a8c19 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:02.640540 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62a76b84-4690-4acb-bc53-a630b04a8c19 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.164843 Aug 30 18:15:02.641974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 626/1164] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:02 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:02.658621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:02.659629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:02.686366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:02.694751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:02.696399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:02.696693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:02.702216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:02.703272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:02.704028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:02.810075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:03.611768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:03.621703 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b1a257c-9263-493b-89dc-b35cf0b6a0af tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.978127 Aug 30 18:15:03.636433 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 627/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:02 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:03.641957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-08b5f7e5-e5d6-4481-be2a-fe4384ce9419 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:03.664267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-08b5f7e5-e5d6-4481-be2a-fe4384ce9419 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026008 Aug 30 18:15:03.665312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 628/1166] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:15:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:03.670996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b196be61-15ff-463e-809d-06cde47e2659", "tag": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:03.682230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:03.683185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:03.684156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.697772 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] Creating event network-changed:49ef7eb4-d408-451a-bad8-f36e4ffcaff2 for instance b196be61-15ff-463e-809d-06cde47e2659 on n-h2-854119-10 Aug 30 18:15:03.709107 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5ba60df0-7560-433c-9f88-afa6c50a781e req-c9de3027-71bd-4736-a146-0beaf70fc6ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041521 Aug 30 18:15:03.709722 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 629/1167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:03.715626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f482b59-2352-496a-9b7a-7828c91501e9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56d410d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:03.757299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f482b59-2352-496a-9b7a-7828c91501e9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818856941" status: 204 len: 0 microversion: 2.2 time: 0.045258 Aug 30 18:15:03.768361 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 630/1168] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Aug 30 18:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818856941 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:03.773061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:03.774676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:03.791247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:03.792767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:03.793652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.795758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:03.797803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:03.797803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.895946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Updating instance_info_cache with network_info: [{"id": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2", "address": "fa:16:3e:ae:90:92", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap49ef7eb4-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:15:03.931697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Releasing lock "refresh_cache-b196be61-15ff-463e-809d-06cde47e2659" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:03.932962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e90c8b73-8b8c-4340-ac00-d8d9f3ed5513 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659/action" status: 202 len: 0 microversion: 2.1 time: 4.258935 Aug 30 18:15:03.937505 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 539/1169] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:14:59 2022] POST /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659/action => generated 0 bytes in 4267 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:15:03.947824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:03.948768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:03.956006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:03.956820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:03.957437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.958409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:03.959092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:03.959682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:03.984700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:04.007211 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6139659-741c-4132-adf1-f1f909c962d9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1289 microversion: 2.1 time: 0.245855 Aug 30 18:15:04.008325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 631/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:03 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1289 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:04.014884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af5842f1-9c08-4ba2-841b-4b4a5a9d2c55 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1252427574", "id": 890657841, "os-flavor-access:is_public": "False"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:04.062444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af5842f1-9c08-4ba2-841b-4b4a5a9d2c55 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052665 Aug 30 18:15:04.063575 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 632/1171] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/flavors => generated 436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:04.069239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0a750e7-69be-41e0-b3a6-af5847c5859a tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56cbd280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-9705650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp2b6zdfDKaHC1fOqioV+SXq4pI+XbAoTlfgHDRb9HCvytA1bonX5T5+RrheSjvHMBUZDBRs/dVjQHE8BaWa7zWkVMQV0OrWtB5pWhBZZnhAZtRtCqOLMdhqqXwD2VHJQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:04.089582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d0a750e7-69be-41e0-b3a6-af5847c5859a tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:04.096700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d0a750e7-69be-41e0-b3a6-af5847c5859a tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:04.136111 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0a750e7-69be-41e0-b3a6-af5847c5859a tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.2 time: 0.071052 Aug 30 18:15:04.138744 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 633/1172] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:04.149462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:04.150579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:04.159739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.160391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.160941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.162138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.162841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.163398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.196121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:04.290127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:04.306624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03932460-9726-4f33-9981-18863b1009be tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1464 microversion: 2.1 time: 0.362151 Aug 30 18:15:04.309200 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 540/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:03 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:04.364365 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a98aee93-9b8a-4e23-ad75-b3573c977839 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 204 len: 0 microversion: 2.1 time: 0.223662 Aug 30 18:15:04.365490 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 634/1174] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:04 2022] DELETE /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:04.378774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18f59ead-e3ed-48b5-8789-1d0328ad483f tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56d410d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1441190052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMAJWUmgo+yHf/HO0rx1y6b1lJ0c1G2F1XJsfkuSF92/Njg17UX9Wa8DmpzURuO3VdWAUwwZ9L7sKtEjrw3V7Mrzw9QTEj/u886iq9m8l7cY5vI/K0vfaEMbYJ94sW2aw=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:04.402993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-18f59ead-e3ed-48b5-8789-1d0328ad483f tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:04.411941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-18f59ead-e3ed-48b5-8789-1d0328ad483f tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:04.452286 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18f59ead-e3ed-48b5-8789-1d0328ad483f tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083856 Aug 30 18:15:04.454381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 635/1175] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:04.460499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:04.467289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:04.485184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.488646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.489807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.491112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.491934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.492652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.732302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9785d26-0158-4b7d-8aca-130d779c2734 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 0 microversion: 2.1 time: 0.276455 Aug 30 18:15:04.738296 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 636/1176] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:04.744780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.122"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:04.752883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:04.767808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.770026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.770531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.772790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:04.775564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:04.779757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:04.845559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:04.846413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquired lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:05.084066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87e55abc-02d9-4870-9a99-ece648892e60 tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:05.089666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87e55abc-02d9-4870-9a99-ece648892e60 tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4a3a497890514b9c8c97f9b7fb6f80da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdef0f6d4434b438ebaf876a4eaf16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87e55abc-02d9-4870-9a99-ece648892e60 tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Request method failure captured: Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/flavors/890657841/action HTTP/1.1 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 67 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlOSgJVcxUUpEXqk-mlhy2uX02kfiTxePKU95iJco93-hlEBQv9CxMjdKubg9Y3_GtEj90_hI4LZZOLFntV1zUDt0ubFsANxIt6UHc6E758FqJsfbJJtG3xSANRbkDMo_RCzAWGtEJDxrTNz7vgEuVPecq9V2ZxDdm0K_pw-35DqdV8 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2bdef0f6d4434b438ebaf876a4eaf16b Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2bdef0f6d4434b438ebaf876a4eaf16b Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FlavorsAccessNegativeTestJSON-911986317-project Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 4a3a497890514b9c8c97f9b7fb6f80da Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-911986317-project Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '890657841', 'body': {'addTenantAccess': {'tenant': '2bdef0f6d4434b438ebaf876a4eaf16b'}}} Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:15:05.098689 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87e55abc-02d9-4870-9a99-ece648892e60 tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87e55abc-02d9-4870-9a99-ece648892e60 tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] 10.222.0.25 "POST /compute/v2.1/flavors/890657841/action" status: 403 len: 130 microversion: 2.1 time: 0.789307 Aug 30 18:15:05.107369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 541/1177] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/flavors/890657841/action => generated 130 bytes in 794 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:05.120631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-695a9106-f52d-4763-bad1-c72451e5ec49 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56785940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-380996270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdH8Re6rvpab+oRuUJdAnA3yc9p7qsyMLkFv2d83FtSzs2gD2lx9DlL1JCjfAFL7itNEv+UfLSPaO/lyGGA2Di/SOlsNP70FaOiNNMItkbdLwhaAu7cJ4HUEk3qldET4g=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:05.173540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-695a9106-f52d-4763-bad1-c72451e5ec49 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:05.187337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-695a9106-f52d-4763-bad1-c72451e5ec49 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:05.228045 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-695a9106-f52d-4763-bad1-c72451e5ec49 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.118916 Aug 30 18:15:05.228969 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 542/1178] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:05.235695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:05.255854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.256692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.257315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.273611 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] Creating event network-changed:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h2-854119-10 Aug 30 18:15:05.283315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ced1961d-2795-4163-b9bd-418be3df982c req-bd33b995-29b4-4dfc-876d-8f08a871c5d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051894 Aug 30 18:15:05.284531 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 543/1179] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:05.307584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:05.309101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:05.327018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.328309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.329652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.332862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.333946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.334787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.667191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:05.677754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5c280ed-19b7-479c-81d5-599798528cc4 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.391228 Aug 30 18:15:05.708057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 544/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:05 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:05.723149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:05.725224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:05.748250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.749469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.750618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.756536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.757509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.761800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.818206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:05.885940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:05.887211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:05.895239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:05.897594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lazy-loading 'fault' on Instance uuid ff1eddd1-e89f-4938-b544-f76bf03f647b {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:15:06.424969 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-494d042e-0a4f-4550-a3e7-b07a2382f3f2 tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1600 microversion: 2.1 time: 0.713284 Aug 30 18:15:06.427805 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 545/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:05 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1600 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:06.445464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:06.450839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:06.466977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:06.468216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:06.469083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:06.470608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:06.471545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:06.472428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.074228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:07.088630 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1ccf2c2-9741-46c6-90a1-7cf148330ef9 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 0.656664 Aug 30 18:15:07.089390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 546/1182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:06 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:07.105800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-443b1b3e-4bf6-4803-b62c-af7782b266de tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:07.160586 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-443b1b3e-4bf6-4803-b62c-af7782b266de tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/890657841" status: 202 len: 0 microversion: 2.1 time: 0.069947 Aug 30 18:15:07.161552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 547/1183] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:15:07 2022] DELETE /compute/v2.1/flavors/890657841 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:07.188300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6dd46ad-e150-4a47-bb1b-5e5572e46ea5 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e567851f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:07.203730 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-e6dd46ad-e150-4a47-bb1b-5e5572e46ea5 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:15:07.224300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6dd46ad-e150-4a47-bb1b-5e5572e46ea5 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1138 microversion: 2.2 time: 0.055013 Aug 30 18:15:07.236372 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 548/1184] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Aug 30 18:15:07 2022] GET /compute/v2.1/os-keypairs => generated 1138 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:07.252029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:07.262480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:07.302022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.302936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.304366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.306015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.307624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.308408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.503030 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a64837d2-c000-4956-9139-73a0f5eed5bb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action" status: 202 len: 0 microversion: 2.1 time: 0.264329 Aug 30 18:15:07.508929 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 549/1185] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:07 2022] POST /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:07.517265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:07.518660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:07.530900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.531766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.532833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:07.534430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:07.535904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:07.536869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:08.307389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:08.816364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:08.859939 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d18fdfa-6c45-4680-b65d-43331fb1ac03 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 1.350682 Aug 30 18:15:08.863848 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 550/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:07 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:08.900264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-269ab657-a0a6-4961-ab10-52fca6739ce9 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:08.971212 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-269ab657-a0a6-4961-ab10-52fca6739ce9 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092371 Aug 30 18:15:08.971825 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 551/1187] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:08.982840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc4f9e69-e503-4036-92c3-fc5c24897cf9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e568275e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:09.035229 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc4f9e69-e503-4036-92c3-fc5c24897cf9 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-380996270" status: 204 len: 0 microversion: 2.2 time: 0.056848 Aug 30 18:15:09.036549 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 552/1188] 10.222.0.25 () {60 vars in 1318 bytes} [Tue Aug 30 18:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-380996270 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:09.042118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:09.042774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:09.067849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.068410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.068796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.069545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.070015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.070480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.413449 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73df0aba-0096-4e1c-8362-aa1800990ffb tempest-ServersAdminTestJSON-1324812359 tempest-ServersAdminTestJSON-1324812359-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1617 microversion: 2.1 time: 0.375529 Aug 30 18:15:09.414055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 553/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:09 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1617 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:09.445109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b196be61-15ff-463e-809d-06cde47e2659", "name": "network-vif-deleted", "tag": "49ef7eb4-d408-451a-bad8-f36e4ffcaff2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:09.463413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.464314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.464914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.486050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] Creating event network-vif-deleted:49ef7eb4-d408-451a-bad8-f36e4ffcaff2 for instance b196be61-15ff-463e-809d-06cde47e2659 on n-h2-854119-10 Aug 30 18:15:09.496119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e002c5e7-8dc0-43cf-abf2-c7b5dd1e8edf req-09855ef4-42cb-465b-8f18-dfd6dc94d831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063210 Aug 30 18:15:09.497522 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 554/1190] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:09.508316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:09.509498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:09.526319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.527255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.527956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.529586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:09.530744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:09.531732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:09.906288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:09.916434 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6633a909-d39e-4191-ac17-5a85fb09074f tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 0.417166 Aug 30 18:15:09.917045 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 555/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:09 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:09.945099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41a4805b-7051-4af6-84a5-b3df0a6298ce tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1392536237", "id": 413334062, "os-flavor-access:is_public": "False"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:10.020316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41a4805b-7051-4af6-84a5-b3df0a6298ce tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.097531 Aug 30 18:15:10.025846 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 556/1192] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:09 2022] POST /compute/v2.1/flavors => generated 436 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:10.036397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82131bdc-aeff-4ebe-b824-afd67e03b742 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56785160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:10.092375 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82131bdc-aeff-4ebe-b824-afd67e03b742 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1441190052" status: 204 len: 0 microversion: 2.2 time: 0.062471 Aug 30 18:15:10.096484 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 557/1193] 10.222.0.25 () {60 vars in 1321 bytes} [Tue Aug 30 18:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1441190052 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:10.108318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:10.112826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:10.127294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:10.128556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:10.130457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:10.132326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:10.133345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:10.134288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:10.173476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:10.396572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:15:10.420164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03a5ce0f-35eb-42e8-9ecf-9b64b9c602f9 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 204 len: 0 microversion: 2.1 time: 0.320186 Aug 30 18:15:10.421713 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 558/1194] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:10 2022] DELETE /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:10.439790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:10.441641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:10.456712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:10.457777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:10.458753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:10.461723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:10.464282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:10.465766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:10.956610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:10.974973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c654c09-13be-4b0e-a58c-8f846be1bdfb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.549844 Aug 30 18:15:10.983659 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 559/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:10 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:11.005797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ba3b194-c2db-4693-a86e-a781f5936983 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:11.255249 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ba3b194-c2db-4693-a86e-a781f5936983 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/413334062/action" status: 200 len: 96 microversion: 2.1 time: 0.270051 Aug 30 18:15:11.264132 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 560/1196] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:15:10 2022] POST /compute/v2.1/flavors/413334062/action => generated 96 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:15:11.264898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec32485e-c664-4916-99c9-e2bb4baf1b76 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56772550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:11.287101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:11.309714 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec32485e-c664-4916-99c9-e2bb4baf1b76 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-9705650" status: 204 len: 0 microversion: 2.2 time: 0.051324 Aug 30 18:15:11.310828 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 561/1197] 10.222.0.25 () {60 vars in 1312 bytes} [Tue Aug 30 18:15:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-9705650 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:11.316571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:11.317249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:11.325216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.325721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.326158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.326965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.327426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.327846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.686548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:11.717900 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-211cd9d5-5c9e-4ea8-b12a-924e56b99001 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1468 microversion: 2.1 time: 0.405406 Aug 30 18:15:11.729634 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 562/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:11 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1468 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:11.744461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:11.750135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:11.767002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.773087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.782482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.784494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:11.785636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:11.786708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:11.893052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Updating instance_info_cache with network_info: [{"id": "358c71c5-7010-4e0a-9842-f183ccefc05e", "address": "fa:16:3e:30:f5:61", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap358c71c5-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:15:11.921581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Releasing lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:11.925303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74d30814-68ac-496c-a3d5-c2d2758e45d3 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action" status: 202 len: 0 microversion: 2.1 time: 7.188617 Aug 30 18:15:11.928695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 637/1199] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:04 2022] POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action => generated 0 bytes in 7194 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:15:11.945394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be58cc6f-2fc4-4de1-80fb-d7b735cee53f tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:11.972097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be58cc6f-2fc4-4de1-80fb-d7b735cee53f tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4a3a497890514b9c8c97f9b7fb6f80da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdef0f6d4434b438ebaf876a4eaf16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be58cc6f-2fc4-4de1-80fb-d7b735cee53f tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Request method failure captured: Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/flavors/413334062/action HTTP/1.1 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 70 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOSgJVcxUUpEXqk-mlhy2uX02kfiTxePKU95iJco93-hlEBQv9CxMjdKubg9Y3_GtEj90_hI4LZZOLFntV1zUDt0ubFsANxIt6UHc6E758FqJsfbJJtG3xSANRbkDMo_RCzAWGtEJDxrTNz7vgEuVPecq9V2ZxDdm0K_pw-35DqdV8 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2bdef0f6d4434b438ebaf876a4eaf16b Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2bdef0f6d4434b438ebaf876a4eaf16b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2bdef0f6d4434b438ebaf876a4eaf16b Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-911986317 Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsAccessNegativeTestJSON-911986317-project Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 4a3a497890514b9c8c97f9b7fb6f80da Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-911986317-project Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: {"removeTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '413334062', 'body': {'removeTenantAccess': {'tenant': '2bdef0f6d4434b438ebaf876a4eaf16b'}}} Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can( Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 18:15:11.979837 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be58cc6f-2fc4-4de1-80fb-d7b735cee53f tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be58cc6f-2fc4-4de1-80fb-d7b735cee53f tempest-FlavorsAccessNegativeTestJSON-911986317 tempest-FlavorsAccessNegativeTestJSON-911986317-project] 10.222.0.25 "POST /compute/v2.1/flavors/413334062/action" status: 403 len: 133 microversion: 2.1 time: 0.053197 Aug 30 18:15:11.996817 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 638/1200] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:15:11 2022] POST /compute/v2.1/flavors/413334062/action => generated 133 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:12.005885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-30e5e22f-fe67-491c-81f8-e0ee1faf6442 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e56dc3940>, body: {"keypair": {"name": "tempest-keypair-1862740099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOKieX4WjrbZAA0FW6A7ZkvGnMCevtgmurUbH3LQRIX/tkKagdfNj1x2AaRkwPnaHA9JYF6DEDyq4wpuoIMDZLXpSCmXQV+RMZusPtxjLpon9PGm4//bP1yOfIw2ajDGg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:12.040193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-30e5e22f-fe67-491c-81f8-e0ee1faf6442 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:12.050954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-30e5e22f-fe67-491c-81f8-e0ee1faf6442 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:12.105270 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-30e5e22f-fe67-491c-81f8-e0ee1faf6442 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.108784 Aug 30 18:15:12.107188 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 639/1201] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Aug 30 18:15:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:15:12.120289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c930ad-6ffb-4955-8138-6eea11fd8024", "tag": "5e8e95c7-9368-4762-9af3-51d141254d37"}, {"name": "network-changed", "server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:12.146057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:12.147104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:12.147953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:12.186198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Creating event network-changed:5e8e95c7-9368-4762-9af3-51d141254d37 for instance 67c930ad-6ffb-4955-8138-6eea11fd8024 on n-h2-854119-10 Aug 30 18:15:12.187821 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] Creating event network-changed:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:15:12.207213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-61cfd1ba-5367-473c-9e6f-e9bcf1052e8b req-33e6b0d0-282c-416e-9a14-8fb3fbd7c4ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096312 Aug 30 18:15:12.217096 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 640/1202] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:12.227814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd55966b-d431-4dde-87d6-316fb2681a81 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '.version_select at 0x7f4e56dc3550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:12.993115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:13.023611 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-444d128f-6b3c-4083-89d2-57d36d2da613 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 1.291171 Aug 30 18:15:13.027803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 563/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:11 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:13.044442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:13.050519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:13.071542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.080145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.081320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:13.083516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.095958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.097063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:13.652066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd55966b-d431-4dde-87d6-316fb2681a81 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e4112a48-b3f5-43f6-a3a6-eb6ae475284f" status: 200 len: 185 microversion: 2.1 time: 1.431129 Aug 30 18:15:13.669330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 641/1204] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:15:12 2022] GET /compute/v2.1/os-floating-ips/e4112a48-b3f5-43f6-a3a6-eb6ae475284f => generated 185 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:13.690449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2a613b46-599d-4571-a212-918aec1fe903 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2bdef0f6d4434b438ebaf876a4eaf16b"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:13.846445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:13.864443 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd16a8a7-2527-436e-a36f-1790c7445370 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.831875 Aug 30 18:15:13.867803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 564/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:13 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:13.881757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-43903bca-e413-4d09-879c-0bbbadf84a47 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56785ca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:13.897384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-43903bca-e413-4d09-879c-0bbbadf84a47 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1862740099" status: 200 len: 513 microversion: 2.2 time: 0.027988 Aug 30 18:15:13.906192 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 565/1206] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Aug 30 18:15:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1862740099 => generated 513 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:13.921408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:13.922522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:13.925305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2a613b46-599d-4571-a212-918aec1fe903 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/413334062/action" status: 200 len: 21 microversion: 2.1 time: 0.254245 Aug 30 18:15:13.933786 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 642/1207] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:15:13 2022] POST /compute/v2.1/flavors/413334062/action => generated 21 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:15:13.936463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Action: 'action', calling method: .version_select at 0x7f4e58fd3e50>, body: {"removeFloatingIp": {"address": "172.25.2.122"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:13.951348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.955379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.956212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:13.960909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:13.962310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:13.964868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.299735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:14.327403 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff339bbc-8dd4-487e-8049-48721d4036b2 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1426 microversion: 2.1 time: 0.418375 Aug 30 18:15:14.342834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 566/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:13 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1426 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:14.362074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca82f428-51bd-4f21-9a62-5390e9137802 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56785040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:14.370330 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-ca82f428-51bd-4f21-9a62-5390e9137802 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:15:14.380835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca82f428-51bd-4f21-9a62-5390e9137802 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.038064 Aug 30 18:15:14.382275 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 567/1209] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Aug 30 18:15:14 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:14.395188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8a528b6-cc90-4a82-a061-9b3ebb8d35ba tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:14.484624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8a528b6-cc90-4a82-a061-9b3ebb8d35ba tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/413334062" status: 202 len: 0 microversion: 2.1 time: 0.098867 Aug 30 18:15:14.491028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 568/1210] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:15:14 2022] DELETE /compute/v2.1/flavors/413334062 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:14.504890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:14.513235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:14.515644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:14.539091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.539600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.540061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.540813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.542002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.546167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.547125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.548180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.548773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:14.549592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:14.552924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:14.555032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.149871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:15.151361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquired lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:15.203154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:15.252715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:15.291061 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-63d56ba7-7283-4fa8-9fcc-201fe032349b tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 0.801683 Aug 30 18:15:15.300534 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 569/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:14 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:15.309850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-deb66ecc-2807-42e8-9848-87f9215ea9ea tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e567e9430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:15.367762 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-deb66ecc-2807-42e8-9848-87f9215ea9ea tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862740099" status: 204 len: 0 microversion: 2.2 time: 0.062720 Aug 30 18:15:15.371792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 570/1212] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Aug 30 18:15:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862740099 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:15.385099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41681559-d539-4b15-b66d-6a2a1f70bdde tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:15.416730 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41681559-d539-4b15-b66d-6a2a1f70bdde tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042086 Aug 30 18:15:15.417969 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 571/1213] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:15:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:15.439219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f553a3ea-a776-4f55-8118-46fa32db023f", "name": "network-vif-deleted", "tag": "787937b9-94c5-4ff4-818d-fc551cf8251e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:15.471920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.472795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.474596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.493385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] Creating event network-vif-deleted:787937b9-94c5-4ff4-818d-fc551cf8251e for instance f553a3ea-a776-4f55-8118-46fa32db023f on n-h1-854119-10 Aug 30 18:15:15.506906 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-edee06ad-5491-401e-96b8-cfe218aec122 req-e77d2e0c-8d20-477e-ae0d-31b1fcddbac1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087084 Aug 30 18:15:15.511000 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 572/1214] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:15.520413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:15.521989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:15.532276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.534069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.534876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.536499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:15.537892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:15.538563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:15.570466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:15.997158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:16.010531 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5a78eb2-eb4b-467d-ba7c-de39587baa80 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.497665 Aug 30 18:15:16.024039 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 573/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:15 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:16.024039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:16.024039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:16.041763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.042262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.042752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:16.043494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.044205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.044883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:16.121039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.121459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.127632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:16.128792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lazy-loading 'fault' on Instance uuid f553a3ea-a776-4f55-8118-46fa32db023f {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:15:16.205184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:16.217404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b03e9e1-88fa-48ba-ab03-4c95840c0416 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 200 len: 1303 microversion: 2.1 time: 0.204458 Aug 30 18:15:16.219470 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 574/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:16 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:16.226642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Action: 'create', calling method: .version_select at 0x7f4e5679f4c0>, body: {"keypair": {"name": "tempest-keypair-1573860142", "type": "x509"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:16.266100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:16.281399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:16.318030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.processutils [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp9gbreu5h/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9gbreu5h/temp.key -subj /CN=5f88edd8039b4a24854d60d89a0bfa07 -extensions v3_req_client {{(pid=122590) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 18:15:16.433510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.processutils [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp9gbreu5h/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9gbreu5h/temp.key -subj /CN=5f88edd8039b4a24854d60d89a0bfa07 -extensions v3_req_client" returned: 0 in 0.114s {{(pid=122590) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 18:15:16.436546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.processutils [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp9gbreu5h/temp.key -password pass: {{(pid=122590) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 18:15:16.489391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.processutils [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp9gbreu5h/temp.key -password pass:" returned: 0 in 0.053s {{(pid=122590) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 18:15:16.567563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:15:16.595551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:16.602552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Getting quotas for user 5f88edd8039b4a24854d60d89a0bfa07 and project e5d39ec6df9a446a9d14f12c2ce19c00. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:16.630004 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b4f5518-25c3-4686-9229-9c404ee6cb77 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.408451 Aug 30 18:15:16.632018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 575/1217] 10.222.0.25 () {62 vars in 1198 bytes} [Tue Aug 30 18:15:16 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:16.639556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31909548-10ca-481f-98d6-47136451e817 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1809688566", "id": 775294537, "os-flavor-access:is_public": "False"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:16.687147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31909548-10ca-481f-98d6-47136451e817 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.053213 Aug 30 18:15:16.688489 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 576/1218] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:16 2022] POST /compute/v2.1/flavors => generated 436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:16.694330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c930ad-6ffb-4955-8138-6eea11fd8024", "name": "network-vif-plugged", "status": "completed", "tag": "5e8e95c7-9368-4762-9af3-51d141254d37"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:16.710509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.711355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.712129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:16.729700 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] Creating event network-vif-plugged:5e8e95c7-9368-4762-9af3-51d141254d37 for instance 67c930ad-6ffb-4955-8138-6eea11fd8024 on n-h2-854119-10 Aug 30 18:15:16.737993 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e708b525-f723-4cd6-8f54-3447b8bb064f req-0f6e32f0-410a-4977-9a3c-1b49ca7f70f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047864 Aug 30 18:15:16.739416 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 577/1219] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:16.747342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:16.748628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:16.757552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.758431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.759155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:16.761401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:16.762084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:16.763365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.063206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:17.073805 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a171e87-d7f5-4358-8641-378736efc4d3 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 0.332737 Aug 30 18:15:17.078637 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 578/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:16 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:17.154197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-325275574", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:17.246925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:15:17.720636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Updating instance_info_cache with network_info: [{"id": "358c71c5-7010-4e0a-9842-f183ccefc05e", "address": "fa:16:3e:30:f5:61", "network": {"id": "f4538093-5c5a-48b8-b165-6029db69e2b1", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1254755934-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87bb886242a4732bf31db42bde24ed7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap358c71c5-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:15:17.737090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Releasing lock "refresh_cache-c0cfa889-9e0e-45aa-8f14-d4b39a05701d" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:17.738399 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5611ecc9-9ded-4c31-ba8d-1a59d6c42333 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action" status: 202 len: 0 microversion: 2.1 time: 3.811281 Aug 30 18:15:17.739627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 643/1221] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:13 2022] POST /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d/action => generated 0 bytes in 3813 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:15:17.745456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:17.757582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.759063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.759733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.774681 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] Creating event network-changed:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:15:17.782144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e22c4a2a-b445-4527-80f4-1c4a4e886d5f req-d7bc5f91-1728-4ae4-a0cf-f0e86aa7ba4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040286 Aug 30 18:15:17.783463 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 644/1222] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:17.790831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0e8850f-cbe9-4f71-8602-3ed922565068 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e56d79280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:17.804907 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0e8850f-cbe9-4f71-8602-3ed922565068 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1573860142" status: 200 len: 1534 microversion: 2.2 time: 0.019723 Aug 30 18:15:17.806307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 645/1223] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Aug 30 18:15:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1573860142 => generated 1534 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:17.811971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd7cace3-bae7-4259-8662-a79f65e84fc1 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7ae32f91c44d4c009fca3f068619575b"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:17.838007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:15:17.838866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:15:17.839935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:15:17.840804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:15:17.841494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:15:17.855241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.856045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.856494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.857499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.858111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.858674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.893366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:17.897026 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fd7cace3-bae7-4259-8662-a79f65e84fc1 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] HTTP exception thrown: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd7cace3-bae7-4259-8662-a79f65e84fc1 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Request method failure captured: Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/flavors/775294537/action HTTP/1.1 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 70 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOU3bDJGADnd9Cqzm10QaTuCS-qDtSST2bEHHNxgPQ5P8BKV2Skql4s6ok-vFBjxVe5jvVNzX_1tQHIR7k6ewN4tial6B02l-4Fn6caC0Cn_VLgppFt7ITl0ZgIEwH4BY3xvScJNHaAQIqTZtwe0ell4TTAumcSyCUSQD4JVubtIUc Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6859e837fd28465fa6d16fc91abe3f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6859e837fd28465fa6d16fc91abe3f2c Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-813538980 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: f04660508aa64fd98370c3b2b2ce4060 Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: {"removeTenantAccess": {"tenant": "7ae32f91c44d4c009fca3f068619575b"}} Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '775294537', 'body': {'removeTenantAccess': {'tenant': '7ae32f91c44d4c009fca3f068619575b'}}} Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:17.900208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. Aug 30 18:15:17.904153 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:17.907584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd7cace3-bae7-4259-8662-a79f65e84fc1 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Returning 404 to user: Flavor access not found for 39 / 7ae32f91c44d4c009fca3f068619575b combination. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:17.908517 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd7cace3-bae7-4259-8662-a79f65e84fc1 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/775294537/action" status: 404 len: 124 microversion: 2.1 time: 0.100911 Aug 30 18:15:17.909242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 646/1224] 10.222.0.25 () {60 vars in 1197 bytes} [Tue Aug 30 18:15:17 2022] POST /compute/v2.1/flavors/775294537/action => generated 124 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:17.914326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:17.916976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:17.921209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:17.926862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.927710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.928795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.930074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:17.930906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:17.931786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:17.946401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:15:17.950691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:15:18.008547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9cc8283f-fec3-4434-9f5d-d3f4afb290b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925810 Aug 30 18:15:18.009356 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 579/1225] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:15:18.016058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.016726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: f553a3ea-a776-4f55-8118-46fa32db023f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.024765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.026203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.026702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.027493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.027976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.028389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.044730 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] HTTP exception thrown: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Request method failure captured: Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f HTTP/1.1 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMJjx8V4U-nDOZ4LLHpCR5qfr2Aiy7M7DYxwxeY9dVrS3AiXOsAySnsWeGfDyR-LErwaKo7-2cNkbVwETXqdbSmvA6bA9-zmsIMK1DN6nRWT39d4asMbW7vwFqYcrwgwMX6Wy0a2rwFBRfMoSHq2PvYj08Ubab0gci1fcYDWE9vzJE Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_57839407595a483c9ffcb2d9e405e068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 04f1cc0e60b04c5e9f3c3df65999a433 Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f553a3ea-a776-4f55-8118-46fa32db023f'} Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.047224 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Returning 404 to user: Instance f553a3ea-a776-4f55-8118-46fa32db023f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d96699b8-c5f8-433a-8b45-588f063ec0da tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f" status: 404 len: 111 microversion: 2.1 time: 0.037377 Aug 30 18:15:18.051807 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 580/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/servers/f553a3ea-a776-4f55-8118-46fa32db023f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:18.059789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.060287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.075895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.077765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.078453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.079493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.080316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.081014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.107640 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] HTTP exception thrown: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Request method failure captured: Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 HTTP/1.1 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlNWqafb8gCTx47jvg5Ch0x8G8mFBtNHqm1jwKELiooZb-83HgcEgZNtL6xWGVMtylIJzMMGEMq5FEBeiOxXv6T7OQ4GQNhRhquRB416LuUfdFm71SMjwArLs52hH9bevl_zzhorjdHxFRIg383uE11FMnvD4ipx3rgXyTkdEDimjvE Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a547e08e089e4911a3035ef8416dca57 Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b196be61-15ff-463e-809d-06cde47e2659'} Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:18.109381 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.114121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Returning 404 to user: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:18.115292 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f13a6f3-30ee-4b02-acc9-49cbf665ce88 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 404 len: 111 microversion: 2.1 time: 0.063993 Aug 30 18:15:18.116051 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 581/1227] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:18 2022] DELETE /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:18.122520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-865c6999-2c27-4222-a27e-5a840aff1d94 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e568a0160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.129388 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-865c6999-2c27-4222-a27e-5a840aff1d94 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:15:18.139314 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-865c6999-2c27-4222-a27e-5a840aff1d94 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.020935 Aug 30 18:15:18.140163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 582/1228] 10.222.0.25 () {60 vars in 1177 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:18.145881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-514d6663-8072-4e7b-a8f3-aa36a0b9b332 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.186399 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-514d6663-8072-4e7b-a8f3-aa36a0b9b332 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/775294537" status: 202 len: 0 microversion: 2.1 time: 0.044827 Aug 30 18:15:18.187826 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 583/1229] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:15:18 2022] DELETE /compute/v2.1/flavors/775294537 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:18.193138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6de198a-2abf-4e4a-910a-ebdeccaf447d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.194277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6de198a-2abf-4e4a-910a-ebdeccaf447d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.281522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6de198a-2abf-4e4a-910a-ebdeccaf447d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:18.297119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:18.297781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6de198a-2abf-4e4a-910a-ebdeccaf447d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1192 microversion: 2.1 time: 0.109079 Aug 30 18:15:18.311530 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 584/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:18.320172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.320690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.321363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d14f82d-e962-44df-a997-f5309a8d43b2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1516 microversion: 2.1 time: 0.411035 Aug 30 18:15:18.323559 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 647/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:17 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1516 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:18.337428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:18.337428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.337428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.337428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.338720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.339141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.339450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.341564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.341564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.366400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.367788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.368616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.370103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.370875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.371722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.406623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:18.521161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae41ad83-7cc5-42d3-94db-5339080d781f tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 204 len: 0 microversion: 2.1 time: 0.207469 Aug 30 18:15:18.526474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 585/1232] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:18 2022] DELETE /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:18.541436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.547740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: b196be61-15ff-463e-809d-06cde47e2659] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.562710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.563219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.563802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.564558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.565025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.565575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.580841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:18.596033 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b8e557e-596a-492f-a80a-9dbfd0f699a0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1331 microversion: 2.1 time: 0.270361 Aug 30 18:15:18.596995 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 648/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1331 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:18.602751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf6e1a29-e587-4e81-b8cc-d50daf659261 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] Calling method '.version_select at 0x7f4e57126310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.610338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] HTTP exception thrown: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Request method failure captured: Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 HTTP/1.1 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlNWqafb8gCTx47jvg5Ch0x8G8mFBtNHqm1jwKELiooZb-83HgcEgZNtL6xWGVMtylIJzMMGEMq5FEBeiOxXv6T7OQ4GQNhRhquRB416LuUfdFm71SMjwArLs52hH9bevl_zzhorjdHxFRIg383uE11FMnvD4ipx3rgXyTkdEDimjvE Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a547e08e089e4911a3035ef8416dca57 Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b196be61-15ff-463e-809d-06cde47e2659'} Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.614771 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. Aug 30 18:15:18.619721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:18.622380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Returning 404 to user: Instance b196be61-15ff-463e-809d-06cde47e2659 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:18.624815 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e08f73c5-0633-4ff9-a874-be112bfc6d17 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659" status: 404 len: 111 microversion: 2.1 time: 0.096567 Aug 30 18:15:18.626094 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 586/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/servers/b196be61-15ff-463e-809d-06cde47e2659 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:18.633763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c77f5e3-4330-445d-a180-c4cb6c9a0cf8 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.652206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf6e1a29-e587-4e81-b8cc-d50daf659261 tempest-KeyPairsV22TestJSON-1963630920 tempest-KeyPairsV22TestJSON-1963630920-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573860142" status: 204 len: 0 microversion: 2.2 time: 0.053355 Aug 30 18:15:18.653930 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 649/1235] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Aug 30 18:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573860142 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:18.660393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c77f5e3-4330-445d-a180-c4cb6c9a0cf8 tempest-FlavorsAccessNegativeTestJSON-813538980 tempest-FlavorsAccessNegativeTestJSON-813538980-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032663 Aug 30 18:15:18.661994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 587/1236] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:18.668967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0554f45-ac4a-45f8-ada9-86f3e9b82bdd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '.version_select at 0x7f4e5672cf70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.719535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:18.722954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:18.784062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.784664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.790156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:18.791917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:18.792527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:18.802561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.184746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:19.196793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d022c930-3b2d-4e1d-b62d-e124d64af7ac tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1470 microversion: 2.1 time: 0.541040 Aug 30 18:15:19.198287 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 650/1237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:18 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:19.323120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:19.323708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:19.331630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.334580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.335112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.335864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.336323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.336750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.455417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:19.467488 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aaf1e8ea-cb39-4a33-bf08-94fec49e11bd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1196 microversion: 2.1 time: 0.148971 Aug 30 18:15:19.472205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 651/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:19 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1196 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:15:19.483915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:19.484849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:19.493767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.494608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.495202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.496092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.496711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.497297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.848808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:19.894603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e272dde-1f9f-4e33-9a82-a60d8cdde270 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1522 microversion: 2.1 time: 0.420612 Aug 30 18:15:19.904356 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 652/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:19 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:19.922207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:19.926463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:19.957052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.961859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.963638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:19.966521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:19.970554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:19.971904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:20.006088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:20.709251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:20.742928 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf7441ca-f098-4c2c-a175-a81143814e54 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1533 microversion: 2.1 time: 0.834512 Aug 30 18:15:20.744809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 653/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:19 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1533 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:20.756910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:20.757936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:20.766489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:20.767377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:20.768003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:20.768891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:20.769983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:20.770621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.308172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:21.325875 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-435d2e07-29f0-4200-aa7d-d19842cdb90c tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1470 microversion: 2.1 time: 0.577277 Aug 30 18:15:21.326790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 654/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:20 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1470 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:21.355991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:21.356615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:21.362227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:21.363768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.364271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.364747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.365497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.378954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.379657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.507747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:21.519231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7899fa40-07c6-4683-a339-9f3de746344c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1262 microversion: 2.1 time: 0.179474 Aug 30 18:15:21.539999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 655/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:21 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1262 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:21.551499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3b0e289-4f6b-430f-ae67-d938365d882e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'create', calling method: .version_select at 0x7f4e56cb9d30>, body: {"pool": "9585baba-2122-4932-98c4-6da5756fbca9"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:21.567521 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0554f45-ac4a-45f8-ada9-86f3e9b82bdd tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e4112a48-b3f5-43f6-a3a6-eb6ae475284f" status: 202 len: 0 microversion: 2.1 time: 2.904221 Aug 30 18:15:21.568335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 588/1243] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:15:18 2022] DELETE /compute/v2.1/os-floating-ips/e4112a48-b3f5-43f6-a3a6-eb6ae475284f => generated 0 bytes in 2906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:21.575510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:21.575510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:21.594932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.595432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.600063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.602254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.602805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.603443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.867526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:21.880488 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-290d390c-5076-42b7-b870-3e7983a1be47 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1522 microversion: 2.1 time: 0.310962 Aug 30 18:15:21.884090 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 589/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:21 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:21.891877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:21.892867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:21.909350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.909980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.910691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.921229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:21.921962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:21.922480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:21.997027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:22.068441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:22.279281 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96fb1167-2d1f-4b3b-9bb2-28751b4a24ad tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 204 len: 0 microversion: 2.1 time: 0.392998 Aug 30 18:15:22.291939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 590/1245] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:21 2022] DELETE /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:22.318879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd547e1-673a-4754-9a1c-3d4a9807b825", "name": "network-vif-unplugged", "status": "completed", "tag": "99d8e338-aa4a-4a26-97e4-8effa5a33695"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:22.356144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.356633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.357143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:22.390499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] Creating event network-vif-unplugged:99d8e338-aa4a-4a26-97e4-8effa5a33695 for instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 on n-h1-854119-10 Aug 30 18:15:22.400426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-600c661b-efb1-41c8-be42-cc5c5cb8eead req-18259f11-42db-4b03-947b-ba04ac18e53e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105500 Aug 30 18:15:22.401070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 591/1246] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:22.417125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf7ec5e-78cd-406b-8bcb-2630a9feda5c", "name": "network-vif-deleted", "tag": "1de9f153-f51e-4774-b5b4-0d5a58cde445"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:22.455485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.455977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.456416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:22.486134 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] Creating event network-vif-deleted:1de9f153-f51e-4774-b5b4-0d5a58cde445 for instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c on n-h2-854119-10 Aug 30 18:15:22.500884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c4d42502-bab7-4f8d-906e-378331218040 req-5840a845-84f6-4f31-89be-5b40f6b3302e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094859 Aug 30 18:15:22.501631 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 592/1247] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:22.509598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:22.511666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:22.523642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.524425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.525089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:22.526008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.526810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.527414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:22.890068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:22.913948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59934d30-5cd1-4f17-abb4-d513282632e7 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1526 microversion: 2.1 time: 0.405755 Aug 30 18:15:22.930634 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 593/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:22 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1526 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:22.952345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:22.954171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:22.975246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.975988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.981460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:22.982463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:22.983051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:22.987322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:23.092548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:23.093150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:23.093504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:23.093971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lazy-loading 'fault' on Instance uuid 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:15:23.243211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:23.259677 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac542b12-abf4-47c3-8fd1-dcf22f15509b tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 200 len: 1304 microversion: 2.1 time: 0.325710 Aug 30 18:15:23.260100 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 594/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:22 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:23.273327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:23.276962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:23.295155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:23.297281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:23.299202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:23.302805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:23.304383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:23.306675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:23.718966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:23.731368 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69a11311-819b-4fbc-a568-fc931f452467 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.467553 Aug 30 18:15:23.736397 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 595/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:23 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:23.749363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:23.750374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:23.771042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:23.771979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:23.772578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:23.774035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:23.776504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:23.778489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.374027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:24.386697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-35d5d8ed-3bf1-4491-b51c-ec06f0a68d53 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1522 microversion: 2.1 time: 0.648677 Aug 30 18:15:24.388120 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 596/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:23 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:24.405885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:24.406842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:24.416661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.418890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.419852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.420946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.421594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.422214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.445636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:24.580811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3b0e289-4f6b-430f-ae67-d938365d882e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.040977 Aug 30 18:15:24.581568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 656/1252] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:15:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:24.592044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:24.593153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:24.600733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.601618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.602755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.604009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.604654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.605316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.629744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] HTTP exception thrown: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Request method failure captured: Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c HTTP/1.1 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMJjx8V4U-nDOZ4LLHpCR5qfr2Aiy7M7DYxwxeY9dVrS3AiXOsAySnsWeGfDyR-LErwaKo7-2cNkbVwETXqdbSmvA6bA9-zmsIMK1DN6nRWT39d4asMbW7vwFqYcrwgwMX6Wy0a2rwFBRfMoSHq2PvYj08Ubab0gci1fcYDWE9vzJE Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_57839407595a483c9ffcb2d9e405e068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 04f1cc0e60b04c5e9f3c3df65999a433 Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '9bf7ec5e-78cd-406b-8bcb-2630a9feda5c'} Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:24.631899 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Returning 404 to user: Instance 9bf7ec5e-78cd-406b-8bcb-2630a9feda5c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e856767b-46dc-4e3d-bf2b-ad9f16bd7772 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c" status: 404 len: 111 microversion: 2.1 time: 0.051006 Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 657/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:24 2022] GET /compute/v2.1/servers/9bf7ec5e-78cd-406b-8bcb-2630a9feda5c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.135"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:24.660253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:24.694980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:24.695375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquired lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:25.300189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:25.319827 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6775eba-e1cb-4537-9798-98ad88e60131 tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1526 microversion: 2.1 time: 0.929604 Aug 30 18:15:25.335325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 597/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:24 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1526 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:25.342948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:25.344106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:25.353366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:25.353878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:25.354324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:25.355102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:25.355570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:25.356212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:25.390725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:25.562992 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa8e14ce-8db3-4606-80b2-638faaeba04a tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 204 len: 0 microversion: 2.1 time: 0.231100 Aug 30 18:15:25.569400 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 598/1255] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:25 2022] DELETE /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:25.577610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:25.578438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:25.591018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:25.591528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:25.593564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:25.594534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:25.598611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:25.599798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:25.950729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:25.969051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b0e645f4-d1d3-4f0a-ad2d-e8467e0ca4a4 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.392529 Aug 30 18:15:25.994870 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 599/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:25 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:25.999867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd547e1-673a-4754-9a1c-3d4a9807b825", "name": "network-vif-plugged", "status": "completed", "tag": "99d8e338-aa4a-4a26-97e4-8effa5a33695"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:26.016523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.017006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.017442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:26.037826 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] Creating event network-vif-plugged:99d8e338-aa4a-4a26-97e4-8effa5a33695 for instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 on n-h1-854119-10 Aug 30 18:15:26.043496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-decd1319-e585-45d4-804c-61add43fe3e8 req-7fafa654-4554-4e8f-8a0c-990e6b29d90a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047298 Aug 30 18:15:26.051939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 600/1257] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:26.064550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:26.065491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:26.075965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.076465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.076892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:26.077625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.078081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.084915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:26.447154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:26.461871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be578190-633e-4dec-a1e0-b3822f9c8649 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1522 microversion: 2.1 time: 0.408333 Aug 30 18:15:26.466912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 601/1258] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:26 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:26.488619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:26.491347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:26.511723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.513163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.514208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:26.515643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.516428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.517144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:26.909257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:26.923323 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d5aa0389-633c-46ec-abd0-b9fad63a2323 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1470 microversion: 2.1 time: 0.453765 Aug 30 18:15:26.938778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 602/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:26 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:26.954690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc9bb091-4177-4564-a210-3751e1cfbfae", "tag": "fa8af5ca-a418-4416-b391-5e4fe71f8b1d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:26.980625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:26.981421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:26.987191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.014461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] Creating event network-changed:fa8af5ca-a418-4416-b391-5e4fe71f8b1d for instance fc9bb091-4177-4564-a210-3751e1cfbfae on n-h2-854119-10 Aug 30 18:15:27.032394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f7964258-46d1-4f1c-8db8-bf299b98bb95 req-4472ca2e-a975-46d2-a21d-8ad6fdb7eb99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091831 Aug 30 18:15:27.033186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 603/1260] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:27.038787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:27.039495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:27.061435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:27.062320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:27.062948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.063850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:27.064490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:27.065410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.214631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:27.224603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:27.225245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.225728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lazy-loading 'fault' on Instance uuid c0cfa889-9e0e-45aa-8f14-d4b39a05701d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:15:27.486541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a547e08e089e4911a3035ef8416dca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87bb886242a4732bf31db42bde24ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:27.542568 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e984c7b1-4634-4aa9-b781-38cc1fee871c tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 200 len: 1313 microversion: 2.1 time: 0.479167 Aug 30 18:15:27.543637 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 604/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:27 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:27.548755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:27.549503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:27.565135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:27.575103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:27.575704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.576595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:27.577165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:27.577689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:27.877628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:27.958901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:15:27.966331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:27.979393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-503b8caa-f9fb-4d23-bfad-78047c7c62bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.433350 Aug 30 18:15:27.982813 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 605/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:27 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:27.998752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:27.999554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:28.016264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:28.017056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:28.019308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:28.020583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:28.026725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:28.034785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:28.290602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:28.650074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:28.671857 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-302ee002-66c9-436b-82fb-a6d15780d590 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1522 microversion: 2.1 time: 0.686324 Aug 30 18:15:28.679170 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 606/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:27 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1522 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:28.698677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:28.701855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:28.734459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:28.739675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:28.742159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:28.747541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:28.751270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:28.752547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.075345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1cc0e60b04c5e9f3c3df65999a433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57839407595a483c9ffcb2d9e405e068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:29.103482 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfb166f0-1b0a-4aea-85a4-e2f0e9063653 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 200 len: 1428 microversion: 2.1 time: 0.422205 Aug 30 18:15:29.126766 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 607/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:28 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 1428 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:29.135645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c930ad-6ffb-4955-8138-6eea11fd8024", "tag": "5e8e95c7-9368-4762-9af3-51d141254d37"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:29.173653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.175374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.179336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.215242 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] Creating event network-changed:5e8e95c7-9368-4762-9af3-51d141254d37 for instance 67c930ad-6ffb-4955-8138-6eea11fd8024 on n-h2-854119-10 Aug 30 18:15:29.231421 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-31973b0d-f988-4b26-8d7b-9434a3848a7c req-0cd2843f-0f4b-4722-b5f4-b2087cb8d273 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101903 Aug 30 18:15:29.232866 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 608/1265] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:29.245518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-unplugged", "status": "completed", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:29.282929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.286896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.288123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.320015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] Creating event network-vif-unplugged:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:15:29.330095 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c3af8b26-fe9e-4adc-80d2-849bd7ea1c0b req-e1d7fe26-db1b-4a8f-a9b8-04b5e765edf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095210 Aug 30 18:15:29.335240 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 609/1266] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:29.342053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:29.350042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] [instance: c0cfa889-9e0e-45aa-8f14-d4b39a05701d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:29.372849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.374334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.375069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.377681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.379399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.387839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.410785 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] HTTP exception thrown: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Request method failure captured: Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d HTTP/1.1 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlNWqafb8gCTx47jvg5Ch0x8G8mFBtNHqm1jwKELiooZb-83HgcEgZNtL6xWGVMtylIJzMMGEMq5FEBeiOxXv6T7OQ4GQNhRhquRB416LuUfdFm71SMjwArLs52hH9bevl_zzhorjdHxFRIg383uE11FMnvD4ipx3rgXyTkdEDimjvE Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f87bb886242a4732bf31db42bde24ed7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f87bb886242a4732bf31db42bde24ed7 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-902452223 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a547e08e089e4911a3035ef8416dca57 Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-902452223-project Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'c0cfa889-9e0e-45aa-8f14-d4b39a05701d'} Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:29.426964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. Aug 30 18:15:29.433134 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:29.437859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] Returning 404 to user: Instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:29.442039 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a10f6b6-e4d6-4c83-9088-e24803dac9bc tempest-FloatingIPsAssociationTestJSON-902452223 tempest-FloatingIPsAssociationTestJSON-902452223-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d" status: 404 len: 111 microversion: 2.1 time: 0.104412 Aug 30 18:15:29.449054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 610/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:29 2022] GET /compute/v2.1/servers/c0cfa889-9e0e-45aa-8f14-d4b39a05701d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:29.471233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:29.479643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:29.516675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.519472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.519995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:29.520777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:29.521257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:29.521693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.431901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:30.442243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecc18fc1-2d21-418b-9eb3-3a9f92b83ca3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.991549 Aug 30 18:15:30.443318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 611/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:29 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:30.448701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfa889-9e0e-45aa-8f14-d4b39a05701d", "name": "network-vif-deleted", "tag": "358c71c5-7010-4e0a-9842-f183ccefc05e"}, {"server_uuid": "ff1eddd1-e89f-4938-b544-f76bf03f647b", "name": "network-vif-deleted", "tag": "d4708986-a2d4-4de2-961e-7f614e897615"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:30.461450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.462310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.463006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.488281 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Creating event network-vif-deleted:358c71c5-7010-4e0a-9842-f183ccefc05e for instance c0cfa889-9e0e-45aa-8f14-d4b39a05701d on n-h1-854119-10 Aug 30 18:15:30.489486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] Creating event network-vif-deleted:d4708986-a2d4-4de2-961e-7f614e897615 for instance ff1eddd1-e89f-4938-b544-f76bf03f647b on n-h1-854119-10 Aug 30 18:15:30.503324 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-467c4a54-0936-4985-974a-3612f7ffa049 req-1f4efb2f-8911-4788-98c4-745404a9075c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057907 Aug 30 18:15:30.505100 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 612/1269] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:30.764547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Calling method '.version_select at 0x7f4e5679f3a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:30.772829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.774212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.775480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.816879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.817594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.818693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.890267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.891082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.891701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.905517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.906293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.906940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.942556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.942835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.943675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.952321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f8895bba-ec41-4453-80ab-c9023e273e07 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2077 microversion: 2.53 time: 0.445093 Aug 30 18:15:30.953791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 613/1270] 10.222.0.25 () {60 vars in 1243 bytes} [Tue Aug 30 18:15:30 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2077 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:15:30.959146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:30.960316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:30.978400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.983461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.985852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:30.986885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:30.987573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:30.988204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.277996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:31.280591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:31.289373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93c6440c-20f6-4260-a7cb-8242f1a4e137 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1507 microversion: 2.1 time: 0.334095 Aug 30 18:15:31.290011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 614/1271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:30 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:31.300445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:31.302462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] [instance: ff1eddd1-e89f-4938-b544-f76bf03f647b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:31.312048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.312954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.313407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.314239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.314764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.315475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.335362 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] HTTP exception thrown: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Request method failure captured: Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b HTTP/1.1 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMJjx8V4U-nDOZ4LLHpCR5qfr2Aiy7M7DYxwxeY9dVrS3AiXOsAySnsWeGfDyR-LErwaKo7-2cNkbVwETXqdbSmvA6bA9-zmsIMK1DN6nRWT39d4asMbW7vwFqYcrwgwMX6Wy0a2rwFBRfMoSHq2PvYj08Ubab0gci1fcYDWE9vzJE Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57839407595a483c9ffcb2d9e405e068"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_57839407595a483c9ffcb2d9e405e068"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 57839407595a483c9ffcb2d9e405e068 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminTestJSON-1100056300 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 04f1cc0e60b04c5e9f3c3df65999a433 Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminTestJSON-1100056300-project Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff1eddd1-e89f-4938-b544-f76bf03f647b'} Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:31.337094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. Aug 30 18:15:31.342669 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:31.344334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] Returning 404 to user: Instance ff1eddd1-e89f-4938-b544-f76bf03f647b could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:31.345273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-feba70c5-4dc1-4d55-b3ac-dd4079709cf3 tempest-ServersAdminTestJSON-1100056300 tempest-ServersAdminTestJSON-1100056300-project] 10.222.0.25 "GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b" status: 404 len: 111 microversion: 2.1 time: 0.053898 Aug 30 18:15:31.345914 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 615/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:31 2022] GET /compute/v2.1/servers/ff1eddd1-e89f-4938-b544-f76bf03f647b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:31.351284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Calling method '.version_select at 0x7f4e568f61f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:31.357344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.358092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.358848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.375930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.376783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.377447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.416301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Updating instance_info_cache with network_info: [{"id": "5e8e95c7-9368-4762-9af3-51d141254d37", "address": "fa:16:3e:67:d8:24", "network": {"id": "445576bb-99fb-47b7-aa8f-b3a8f1af7c27", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-17943637-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0056a7a8b2fc4497a61f73751eaeed29", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e8e95c7-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:15:31.433973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.434632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.435039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.452373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Releasing lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:31.455042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4c07f9c-9a0d-4fca-bee0-1d3de906fef4 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 202 len: 0 microversion: 2.1 time: 6.814826 Aug 30 18:15:31.461536 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 658/1273] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:24 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 0 bytes in 6821 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:15:31.478543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.479973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.483905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.488697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:31.490673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:31.514626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.518501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.521109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.527958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.529913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.532352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.596101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:31.600628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:31.609046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:31.647155 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5049c0b-ea25-4612-8f65-b47b7243a554 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 767 microversion: 2.53 time: 0.297329 Aug 30 18:15:31.663261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 616/1274] 10.222.0.25 () {60 vars in 1222 bytes} [Tue Aug 30 18:15:31 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 767 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:15:31.688775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dcea8b25-dc38-409c-b9ad-5c65025890ac tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'create', calling method: .version_select at 0x7f4e568ff670>, body: {"pool": "9585baba-2122-4932-98c4-6da5756fbca9"} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:32.118102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:32.127548 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ad8b1fe-9a30-4108-9154-d5ea5b3ac710 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 200 len: 1507 microversion: 2.1 time: 0.663759 Aug 30 18:15:32.128147 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 659/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:31 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:32.140153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:32.141350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:32.148817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.150017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.150816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.152276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.153147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.153895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.679184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:32.690018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80a3d5e0-eb5a-4943-83fd-1b68baa0cf36 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.560304 Aug 30 18:15:32.693564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 660/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:32 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:32.703738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Calling method '.version_select at 0x7f4e56d41700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:32.718669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.719520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.720173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.773761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.775067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.775811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.792698 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca6a1692-564a-4499-a317-1d451b220e16 tempest-HypervisorAdminV253TestBase-1469763517 tempest-HypervisorAdminV253TestBase-1469763517-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/44b73b48-f944-40d5-812d-4f01af502562" status: 200 len: 794 microversion: 2.53 time: 0.097760 Aug 30 18:15:32.794409 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 661/1277] 10.222.0.25 () {60 vars in 1298 bytes} [Tue Aug 30 18:15:32 2022] GET /compute/v2.1/os-hypervisors/44b73b48-f944-40d5-812d-4f01af502562 => generated 794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:15:32.808895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:32.809250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:32.820953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.821457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.822025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.822962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:32.823635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:32.824226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:32.883273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:33.047713 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d08dc77-c429-405b-bd5a-c8afafa430f1 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 204 len: 0 microversion: 2.1 time: 0.251291 Aug 30 18:15:33.050095 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 662/1278] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:32 2022] DELETE /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:33.321192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-239953067", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a4549ce9-8c04-485f-9303-8f662d038aa7"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:33.511742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] validate_networks() for [('a4549ce9-8c04-485f-9303-8f662d038aa7', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:15:34.870496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:15:34.874651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:15:34.875829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:15:34.883787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:15:34.885308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:15:34.905657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:34.907311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:34.915429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:34.920411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:34.921236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:34.921981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:34.963488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:34.970236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Getting quotas for user ab2acdcb76554cbf9c45566a19d03f35 and project 0d3b0bb317f54a1d98e6fdf479a08b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:34.994605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:15:34.998592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:15:35.183742 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8212652e-fbf3-4fa9-81aa-dc2a16034c4f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875195 Aug 30 18:15:35.191677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 663/1279] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:15:35.197135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9bb091-4177-4564-a210-3751e1cfbfae", "name": "network-vif-plugged", "status": "completed", "tag": "fa8af5ca-a418-4416-b391-5e4fe71f8b1d"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:35.221509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:35.226850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:35.227692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:35.281580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] Creating event network-vif-plugged:fa8af5ca-a418-4416-b391-5e4fe71f8b1d for instance fc9bb091-4177-4564-a210-3751e1cfbfae on n-h2-854119-10 Aug 30 18:15:35.295986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f5ed83ba-1a29-4215-accc-c5ac9b0b05a7 req-c7c6b081-66ce-4627-88dd-bdb3a477366d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102427 Aug 30 18:15:35.299862 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 664/1280] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:35.312555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:35.318933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:35.336935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:35.337490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:35.353191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:35.372709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:35.377091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:35.377636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:36.035488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:36.063857 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9f5c993-4dd5-4b63-88c4-52d141d27fd0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.760220 Aug 30 18:15:36.067013 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 665/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:35 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:36.096932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b38960e-d909-4333-bc7a-7977372211d3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:36.107055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b38960e-d909-4333-bc7a-7977372211d3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:36.566597 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dcea8b25-dc38-409c-b9ad-5c65025890ac tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.899187 Aug 30 18:15:36.587413 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 617/1282] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:15:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:36.614500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: .version_select at 0x7f4e589b4c10>, body: {"addFloatingIp": {"address": "172.25.2.44"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:36.630906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:36.658119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:36.661146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:36.662900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:36.664825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:36.667618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:36.669530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:36.733553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b38960e-d909-4333-bc7a-7977372211d3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:36.747609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b38960e-d909-4333-bc7a-7977372211d3 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1217 microversion: 2.1 time: 0.669524 Aug 30 18:15:36.748485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 666/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:36 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1217 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:36.761128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:36.761128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquired lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:37.091497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:37.092273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:37.111119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:37.111827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:37.114430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:37.115395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:37.118210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:37.120358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:37.624494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:37.636100 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afd955a8-e26c-4070-9ff6-270919528e0a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1292 microversion: 2.1 time: 0.549679 Aug 30 18:15:37.637800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 667/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:37 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1292 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:15:37.648507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:37.662383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:37.691253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:37.692032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:37.692630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:37.693557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:37.694179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:37.694788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.249155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:15:39.320813 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e04aff5-fa99-4a19-b4a2-789c83907566 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 2344 microversion: 2.25 time: 1.664312 Aug 30 18:15:39.322269 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 668/1285] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:15:37 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 2344 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:15:39.328121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:39.332105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:39.360321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:39.364586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:39.365794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.366974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:39.376010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:39.376934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.489337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9.", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:15:39.490196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Releasing lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:39.490931 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.490931 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Request method failure captured: Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action HTTP/1.1 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 45 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlOfJdfGLve7BD_TYkMmIRB8GDTF5NQUrOi66kicL_MAHklU4in5WmRagTnGW8VsFrnwmx0xJC9a6WOgyycnWDeDTxi0wrruWLPSDg3kVlio_UO6Tnk5MuJn1VHM_PRmayokgdo69HIcMSXes1lca05to4t1yiBjYDdwhCw0kn1dnlQ Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 013ace46f78c44fda2b666fb2ef598f8 Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: {"addFloatingIp": {"address": "172.25.2.44"}} Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '67c930ad-6ffb-4955-8138-6eea11fd8024', 'body': {'addFloatingIp': {'address': '172.25.2.44'}}} Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:15:39.495369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] Aug 30 18:15:39.500419 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:39.506744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Returning 400 to user: Cannot associate floating IP 172.25.2.44 (b0a72b29-e71f-48af-a856-d74e4698d9cf) with port 5e8e95c7-9368-4762-9af3-51d141254d37 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9585baba-2122-4932-98c4-6da5756fbca9. Aug 30 18:15:39.506744 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-c09c1e80-c306-4e37-99c0-9fd445b2e391'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:39.506744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f4dee87-eac7-437f-a102-0c647c57c985 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 400 len: 380 microversion: 2.1 time: 2.906500 Aug 30 18:15:39.506744 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 618/1286] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:36 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 380 bytes in 2909 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:15:39.512674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd547e1-673a-4754-9a1c-3d4a9807b825", "name": "network-vif-deleted", "tag": "99d8e338-aa4a-4a26-97e4-8effa5a33695"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:39.562071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:39.565608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:39.566175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.609304 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] Creating event network-vif-deleted:99d8e338-aa4a-4a26-97e4-8effa5a33695 for instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 on n-h1-854119-10 Aug 30 18:15:39.617723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c4bd0651-43ac-4ec7-8f10-17a750af98ec req-ff034d76-a343-4691-9f55-397a2ff6609d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116375 Aug 30 18:15:39.619905 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 619/1287] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:39.626951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:39.628179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:39.629889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:39.640260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:39.643414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:39.644339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:39.645013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.646994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:39.647989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:39.648653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:39.689307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b3fb83e-584a-4cbd-8e9e-42ad204f6d63 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1275 microversion: 2.1 time: 0.360379 Aug 30 18:15:39.696021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 669/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:39 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:40.117760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:40.144765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-104ab8a5-4011-4fb9-b441-fc70a2c8fa56 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1472 microversion: 2.1 time: 0.522797 Aug 30 18:15:40.157563 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 620/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:39 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:40.173598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:40.189851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:40.191130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:40.192134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:40.199903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:40.201270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:40.202305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:40.315346 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91eaa790-ad86-4491-a18e-feeea62ae4ed tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.155522 Aug 30 18:15:40.316401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 621/1290] 10.222.0.25 () {60 vars in 1217 bytes} [Tue Aug 30 18:15:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:15:40.367848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86f1616c-5d30-401c-b17b-df038cf56766 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56cc8dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1231002389", "description": "tempest-description-241511002"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:40.651462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:40.652209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:40.652626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:40.655430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:40.656311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:40.656855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:40.662088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:40.766404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f3e86f6-dd35-4274-99b3-333094cbe140 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.446928 Aug 30 18:15:40.769284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 622/1291] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:15:40 2022] GET /compute/v2.1/os-services => generated 949 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:40.788788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0393788-ac42-4042-85ad-6601dfc070c1 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '.version_select at 0x7f4e568f6a60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:41.783136 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86f1616c-5d30-401c-b17b-df038cf56766 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.084736 Aug 30 18:15:41.784839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 670/1292] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:15:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:41.810117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1236838508", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:42.023251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:15:43.228836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:15:43.229729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:15:43.230740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:15:43.231601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:15:43.233173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:15:43.255653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.257471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.259389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.261151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.262185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.263325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.308403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:43.323886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:43.349316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:15:43.352550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:15:43.458159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d8807c0-9ebe-4482-b29d-b064b8485de1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665623 Aug 30 18:15:43.460650 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 671/1293] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:15:43.473718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:43.476445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:43.509889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.510796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.513017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.516224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.518667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.537250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.677355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0393788-ac42-4042-85ad-6601dfc070c1 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/b0a72b29-e71f-48af-a856-d74e4698d9cf" status: 202 len: 0 microversion: 2.1 time: 2.904182 Aug 30 18:15:43.678865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 623/1294] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:15:40 2022] DELETE /compute/v2.1/os-floating-ips/b0a72b29-e71f-48af-a856-d74e4698d9cf => generated 0 bytes in 2908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:43.684678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:43.688919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.698640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.699203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.700104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:43.711211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:43.711630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:43.794186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95eaf5d8-c57c-455d-8fb7-b13eda151a79 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-854119-10" status: 200 len: 581 microversion: 2.1 time: 0.113730 Aug 30 18:15:43.795384 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 624/1295] 10.222.0.25 () {58 vars in 1174 bytes} [Tue Aug 30 18:15:43 2022] GET /compute/v2.1/os-services?host=n-d-854119-10 => generated 581 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:43.800901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28a89990-8fdc-4776-9f35-feef97dfd0df tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56af4dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1269306472", "description": "tempest-description-1612110546"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:44.154747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:44.170754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b25037c2-1769-4657-aeab-26c676de53ad tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1317 microversion: 2.1 time: 0.705933 Aug 30 18:15:44.172804 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 672/1296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:43 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:44.185400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0c30c79-1b5a-4f39-adec-d0d5b2115d5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:44.185838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0c30c79-1b5a-4f39-adec-d0d5b2115d5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:44.240045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0c30c79-1b5a-4f39-adec-d0d5b2115d5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:44.825852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.scheduler.client.report [None req-c0c30c79-1b5a-4f39-adec-d0d5b2115d5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Deleted allocations for instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 Aug 30 18:15:44.829350 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28a89990-8fdc-4776-9f35-feef97dfd0df tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.032718 Aug 30 18:15:44.830296 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 625/1297] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:15:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:44.851497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48a92c7-9947-411d-9ca4-b58afb9d0a30", "tag": "2280d27b-f603-48bf-b7ef-ccc431b3abdd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:44.870830 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0c30c79-1b5a-4f39-adec-d0d5b2115d5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2" status: 204 len: 0 microversion: 2.1 time: 0.695164 Aug 30 18:15:44.871809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 673/1298] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:44 2022] DELETE /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:44.883243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:44.884593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:44.885409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:44.889572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.135"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:44.908748 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] Creating event network-changed:2280d27b-f603-48bf-b7ef-ccc431b3abdd for instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 on n-h1-854119-10 Aug 30 18:15:44.927014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e65318ee-45f3-4070-9a45-cc5f78ca346e req-9d6e9eb4-be61-43f6-b1bf-ad6ac277fa07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081235 Aug 30 18:15:44.927945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 626/1299] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:44.938060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:44.945657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:44.951972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:44.952426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:44.953246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:44.953696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:44.954116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.011283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69ae94aa-ed52-42e0-a41e-7bfd11c3cbbe tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.081709 Aug 30 18:15:45.024097 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 627/1300] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:15:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:45.029175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:45.029924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:45.042624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.043470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.043927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.044707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.045177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.053955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.108334 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 HTTP/1.1 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b6605714-fdea-43e2-9fdc-5de69b7fa4c2'} Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:45.112558 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f381ceb9-0431-4b56-90e2-55aa7f5a23f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2" status: 404 len: 111 microversion: 2.1 time: 0.094239 Aug 30 18:15:45.121809 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 628/1301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:45 2022] GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:15:45.130305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:45.140331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.143836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.151756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.152809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.162719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.167090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.223539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-da45fe9f-2caf-400d-81f2-08cae711d688 tempest-ServicesAdminTestJSON-1744839308 tempest-ServicesAdminTestJSON-1744839308-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.107701 Aug 30 18:15:45.234380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 629/1302] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:15:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:45.234899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3639db4c-23db-4e9f-a5ec-5fb209ca49db", "device": "/dev/xvdb"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:45.241826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:45.244667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.245195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.245693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.246419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.246938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.248391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.297457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:45.308002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.309059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.312693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.314839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.317355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.319736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.332439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:45.837493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:45.839505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquired lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:45.844818 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1e65b59b-a7db-4546-80fa-ed634d5ded6c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.610314 Aug 30 18:15:45.848582 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 630/1303] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Aug 30 18:15:45 2022] POST /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:15:45.860967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:45.866072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:45.895377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.898591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.899389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:45.904345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:45.908671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:45.911667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:47.558810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:47.596007 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ed5d166-b37d-41a6-9bea-22bfa6384464 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1317 microversion: 2.1 time: 1.744920 Aug 30 18:15:47.611468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 631/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:45 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1317 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:47.635282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-932901735", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "e9157186-1949-48da-b32c-e57cbda6866e"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:47.778186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] validate_networks() for [('e9157186-1949-48da-b32c-e57cbda6866e', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:15:47.863847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:15:49.914208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Updating instance_info_cache with network_info: [{"id": "5e8e95c7-9368-4762-9af3-51d141254d37", "address": "fa:16:3e:67:d8:24", "network": {"id": "445576bb-99fb-47b7-aa8f-b3a8f1af7c27", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-17943637-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0056a7a8b2fc4497a61f73751eaeed29", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5e8e95c7-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:15:49.937310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Releasing lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:49.939309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d1a0b16-988a-4b4f-a538-59a0e01afe09 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 202 len: 0 microversion: 2.1 time: 5.065458 Aug 30 18:15:49.941067 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 674/1305] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:44 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 0 bytes in 5068 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:15:49.951536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-27341175", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:50.073059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:15:50.405135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:15:50.406043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:15:50.406861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:15:50.407514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:15:50.408276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:15:50.438249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:50.443740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:50.447983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:50.451681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:50.456664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:50.460496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:50.533280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Getting quotas for project e4cf937841ce453fbbe4b18024234426. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:50.544646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Getting quotas for user b4e6813fec5f4f4fb4e7a31d2ace5d64 and project e4cf937841ce453fbbe4b18024234426. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:50.579044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:15:50.586657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:15:50.658172 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd6afc39-6db7-40de-a499-96cf25c86c7d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.044377 Aug 30 18:15:50.661900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 632/1306] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:15:51.085652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:15:51.086106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:15:51.086581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:15:51.087632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:15:51.088646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:15:51.104644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Calling method '.version_select at 0x7f4e568f6ee0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:51.110517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.111012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.111666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.112906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.113563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.114154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.147000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.150306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.152303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.154000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.155983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.157342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.163493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:15:51.181939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:15:51.221035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:15:51.223100 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-571faf4a-f497-4656-ba81-3429d0329757 tempest-AbsoluteLimitsTestJSON-1304035106 tempest-AbsoluteLimitsTestJSON-1304035106-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.559532 Aug 30 18:15:51.223846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:15:51.234537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 633/1307] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 18:15:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:51.253320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c930ad-6ffb-4955-8138-6eea11fd8024", "tag": "5e8e95c7-9368-4762-9af3-51d141254d37"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:51.283679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.285228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.288142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.293928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:51.329254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] Creating event network-changed:5e8e95c7-9368-4762-9af3-51d141254d37 for instance 67c930ad-6ffb-4955-8138-6eea11fd8024 on n-h2-854119-10 Aug 30 18:15:51.337089 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6262fe62-cd44-44be-b9a4-80924f49f7ac req-d76a6137-f67d-495a-9ce1-292d143be026 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099762 Aug 30 18:15:51.338580 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 634/1308] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:51.357758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:51.362511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:51.365688 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24c413c7-da6f-45ad-9898-7ba057b968a1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422809 Aug 30 18:15:51.371253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 675/1309] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:15:51.379427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-409d0a46-e4e2-4d49-8997-e86d38557177 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '.version_select at 0x7f4e56cbd550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:51.388921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.389502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.389842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.390607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.391065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.391540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.846950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:51.879376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a851a0e-a0fe-4358-aa11-1b72836c870c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1317 microversion: 2.1 time: 0.539257 Aug 30 18:15:51.888156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 635/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:51 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:51.931405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:51.937829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:51.977454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:51.979682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:51.982826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:51.985628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:52.008457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:52.011584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:52.309940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:52.360384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d07a1f9c-c067-4175-958f-fc93114a3d15 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1219 microversion: 2.1 time: 0.467874 Aug 30 18:15:52.364178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 636/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:51 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1219 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:52.391930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ca8bcbd-391f-4612-90b3-5402fae61d0f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:52.393714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ca8bcbd-391f-4612-90b3-5402fae61d0f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:52.986638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ca8bcbd-391f-4612-90b3-5402fae61d0f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:52.996988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ca8bcbd-391f-4612-90b3-5402fae61d0f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1219 microversion: 2.1 time: 0.630330 Aug 30 18:15:52.999249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 637/1312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:52 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1219 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:53.023060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48a92c7-9947-411d-9ca4-b58afb9d0a30", "name": "network-vif-plugged", "status": "completed", "tag": "2280d27b-f603-48bf-b7ef-ccc431b3abdd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:53.073383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:53.079718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:53.081471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:53.112003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] Creating event network-vif-plugged:2280d27b-f603-48bf-b7ef-ccc431b3abdd for instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 on n-h1-854119-10 Aug 30 18:15:53.128123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-41c162a3-2188-4d67-a49f-471249ab8faa req-84c7f586-6b20-4b23-91ea-2571995edeb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127113 Aug 30 18:15:53.129154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 638/1313] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:15:53.135130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:53.151429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:53.189818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:53.193795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:53.202947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:53.204253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:53.205122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:53.205888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:54.544572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:54.560452 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9112bede-4bd1-4b3e-90c0-9ddbb910e895 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1317 microversion: 2.1 time: 1.428769 Aug 30 18:15:54.561026 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 639/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:53 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1317 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:54.583258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:54.583258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:54.595961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:54.596467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:54.596917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:54.597670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:54.598149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:54.598702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:54.883135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:54.919514 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-594e4e35-095b-43c3-ad34-022cec728d77 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1273 microversion: 2.1 time: 0.357280 Aug 30 18:15:54.920203 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 640/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:54 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:54.925772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:54.933249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:54.948219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:54.950528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:54.951204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:54.953603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:54.955043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:54.963907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:55.206718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:55.211214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:15:55.242065 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a787f8b-e804-4fb4-b742-0b5585eb97a8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1277 microversion: 2.1 time: 0.320111 Aug 30 18:15:55.271827 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 641/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:54 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:55.686269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88e29542-3beb-4167-b308-70c334df593e tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Calling method '.version_select at 0x7f4e56af48b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:55.748556 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-88e29542-3beb-4167-b308-70c334df593e tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88e29542-3beb-4167-b308-70c334df593e tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/f4f4566e-4a77-410d-a29e-777011ce874e/metadata/os_distro HTTP/1.1 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'image_id': 'f4f4566e-4a77-410d-a29e-777011ce874e', 'id': 'os_distro'} Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f4f4566e-4a77-410d-a29e-777011ce874e Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:55.759444 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f4f4566e-4a77-410d-a29e-777011ce874e could not be found. Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:55.765038 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:15:55.772275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88e29542-3beb-4167-b308-70c334df593e tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:55.772275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88e29542-3beb-4167-b308-70c334df593e tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "DELETE /compute/v2.1/images/f4f4566e-4a77-410d-a29e-777011ce874e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.447197 Aug 30 18:15:55.777284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 642/1317] 10.222.0.25 () {58 vars in 1293 bytes} [Tue Aug 30 18:15:55 2022] DELETE /compute/v2.1/images/f4f4566e-4a77-410d-a29e-777011ce874e/metadata/os_distro => generated 62 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 18:15:55.785396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:55.788429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:55.817995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:55.821278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:55.822943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:55.823846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:55.825694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:55.827517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:55.927676 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-409d0a46-e4e2-4d49-8997-e86d38557177 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/780b3058-c47c-4e1a-9e7f-d237468bf1d0" status: 202 len: 0 microversion: 2.1 time: 4.554665 Aug 30 18:15:55.932888 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 676/1318] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:15:51 2022] DELETE /compute/v2.1/os-floating-ips/780b3058-c47c-4e1a-9e7f-d237468bf1d0 => generated 0 bytes in 4561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:15:55.972937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc62d10a-4f13-43f9-8ab9-557d14962b78 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Calling method '.version_select at 0x7f4e56de93a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:56.027690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-bc62d10a-4f13-43f9-8ab9-557d14962b78 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc62d10a-4f13-43f9-8ab9-557d14962b78 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/images/4fcd8510-d013-4553-a582-3b0867abd31a/metadata/os_version HTTP/1.1 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'image_id': '4fcd8510-d013-4553-a582-3b0867abd31a', 'id': 'os_version'} Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4fcd8510-d013-4553-a582-3b0867abd31a Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:56.036517 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4fcd8510-d013-4553-a582-3b0867abd31a could not be found. Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.041600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc62d10a-4f13-43f9-8ab9-557d14962b78 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.045305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bc62d10a-4f13-43f9-8ab9-557d14962b78 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "GET /compute/v2.1/images/4fcd8510-d013-4553-a582-3b0867abd31a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.098033 Aug 30 18:15:56.050395 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 677/1319] 10.222.0.25 () {58 vars in 1293 bytes} [Tue Aug 30 18:15:55 2022] GET /compute/v2.1/images/4fcd8510-d013-4553-a582-3b0867abd31a/metadata/os_version => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.063971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:56.066971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:56.086870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.087394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.087837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.088625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.089113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.089547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.177830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:56.187334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43484dc8-312b-4c76-b542-01b274988dc2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1273 microversion: 2.1 time: 0.132625 Aug 30 18:15:56.194960 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 678/1320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:56 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:56.210754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ba8247-6ad5-4844-ae28-45287a1c61d0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ba8247-6ad5-4844-ae28-45287a1c61d0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Request method failure captured: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action HTTP/1.1 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 34 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOfJdfGLve7BD_TYkMmIRB8GDTF5NQUrOi66kicL_MAHklU4in5WmRagTnGW8VsFrnwmx0xJC9a6WOgyycnWDeDTxi0wrruWLPSDg3kVlio_UO6Tnk5MuJn1VHM_PRmayokgdo69HIcMSXes1lca05to4t1yiBjYDdwhCw0kn1dnlQ Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 013ace46f78c44fda2b666fb2ef598f8 Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: {"addFloatingIp": {"address": ""}} Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '67c930ad-6ffb-4955-8138-6eea11fd8024', 'body': {'addFloatingIp': {'address': ''}}} Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '' Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:15:56.218709 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6ba8247-6ad5-4844-ae28-45287a1c61d0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6ba8247-6ad5-4844-ae28-45287a1c61d0 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 400 len: 142 microversion: 2.1 time: 0.024563 Aug 30 18:15:56.226297 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 679/1321] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:56 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:15:56.232574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48227187-9e72-41ab-af94-dca76f036c3f tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Calling method '.version_select at 0x7f4e56cc8dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:56.267438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-48227187-9e72-41ab-af94-dca76f036c3f tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48227187-9e72-41ab-af94-dca76f036c3f tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/images/263b8d89-32d1-41f2-aac5-8313206b7d37/metadata HTTP/1.1 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'image_id': '263b8d89-32d1-41f2-aac5-8313206b7d37'} Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 263b8d89-32d1-41f2-aac5-8313206b7d37 Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:56.269627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 263b8d89-32d1-41f2-aac5-8313206b7d37 could not be found. Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48227187-9e72-41ab-af94-dca76f036c3f tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.275818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48227187-9e72-41ab-af94-dca76f036c3f tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "GET /compute/v2.1/images/263b8d89-32d1-41f2-aac5-8313206b7d37/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046215 Aug 30 18:15:56.282338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 680/1322] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:15:56 2022] GET /compute/v2.1/images/263b8d89-32d1-41f2-aac5-8313206b7d37/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.288682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:56.295159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:56.309014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.309489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.312096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.313210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.316072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.316565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.358982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:15:56.359626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquired lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:15:56.542330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Releasing lock "refresh_cache-67c930ad-6ffb-4955-8138-6eea11fd8024" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:15:56.543390 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] HTTP exception thrown: floating IP not found Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Request method failure captured: Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action HTTP/1.1 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 41 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOfJdfGLve7BD_TYkMmIRB8GDTF5NQUrOi66kicL_MAHklU4in5WmRagTnGW8VsFrnwmx0xJC9a6WOgyycnWDeDTxi0wrruWLPSDg3kVlio_UO6Tnk5MuJn1VHM_PRmayokgdo69HIcMSXes1lca05to4t1yiBjYDdwhCw0kn1dnlQ Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 013ace46f78c44fda2b666fb2ef598f8 Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: exception: floating IP not found Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '67c930ad-6ffb-4955-8138-6eea11fd8024', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 30 18:15:56.545540 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 30 18:15:56.551647 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.554051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Returning 404 to user: floating IP not found {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.555247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f753a03-4ccb-4540-a69f-f09fb909f80c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 404 len: 67 microversion: 2.1 time: 0.277045 Aug 30 18:15:56.562093 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 681/1323] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:56 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 67 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.568587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:56.570079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:56.579248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.580117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.580728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.581815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.582509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.583111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.681723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:56.690313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d1fb7c3-850c-4d78-8af3-27a1d1c9aa5e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1277 microversion: 2.1 time: 0.126628 Aug 30 18:15:56.711616 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 682/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:56 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:56.722424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22434e50-4a03-422a-b51e-e9e87660351b tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Action: 'update_all', calling method: .version_select at 0x7f4e56e7d160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:56.752859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-22434e50-4a03-422a-b51e-e9e87660351b tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22434e50-4a03-422a-b51e-e9e87660351b tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/images/18522b3b-3c9e-4eb9-900c-22857ca33ca5/metadata HTTP/1.1 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 57 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'image_id': '18522b3b-3c9e-4eb9-900c-22857ca33ca5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 18522b3b-3c9e-4eb9-900c-22857ca33ca5 Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:56.755319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18522b3b-3c9e-4eb9-900c-22857ca33ca5 could not be found. Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:56.760297 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.766298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22434e50-4a03-422a-b51e-e9e87660351b tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.767399 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22434e50-4a03-422a-b51e-e9e87660351b tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "PUT /compute/v2.1/images/18522b3b-3c9e-4eb9-900c-22857ca33ca5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057027 Aug 30 18:15:56.768166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 683/1325] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:15:56 2022] PUT /compute/v2.1/images/18522b3b-3c9e-4eb9-900c-22857ca33ca5/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.773276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dac285ed-8a65-457d-bb74-71177cec4030 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:56.838524 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dac285ed-8a65-457d-bb74-71177cec4030 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dac285ed-8a65-457d-bb74-71177cec4030 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Request method failure captured: Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action HTTP/1.1 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 44 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOfJdfGLve7BD_TYkMmIRB8GDTF5NQUrOi66kicL_MAHklU4in5WmRagTnGW8VsFrnwmx0xJC9a6WOgyycnWDeDTxi0wrruWLPSDg3kVlio_UO6Tnk5MuJn1VHM_PRmayokgdo69HIcMSXes1lca05to4t1yiBjYDdwhCw0kn1dnlQ Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 013ace46f78c44fda2b666fb2ef598f8 Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: exception: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '67c930ad-6ffb-4955-8138-6eea11fd8024', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 30 18:15:56.840392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dac285ed-8a65-457d-bb74-71177cec4030 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dac285ed-8a65-457d-bb74-71177cec4030 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action" status: 404 len: 88 microversion: 2.1 time: 0.072600 Aug 30 18:15:56.847599 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 684/1326] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:15:56 2022] POST /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024/action => generated 88 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.850838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb709209-9fc7-4ab9-ad1c-8b6730f72062 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Action: 'update', calling method: .version_select at 0x7f4e56e7db80>, body: {"meta": {"os_distro": "alt"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:56.895180 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-eb709209-9fc7-4ab9-ad1c-8b6730f72062 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb709209-9fc7-4ab9-ad1c-8b6730f72062 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/images/ed1099ac-71c2-480f-aa14-819809358343/metadata/os_distro HTTP/1.1 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 30 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: {"meta": {"os_distro": "alt"}} Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'image_id': 'ed1099ac-71c2-480f-aa14-819809358343', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ed1099ac-71c2-480f-aa14-819809358343 Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:56.899627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed1099ac-71c2-480f-aa14-819809358343 could not be found. Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:56.904756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb709209-9fc7-4ab9-ad1c-8b6730f72062 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:56.908399 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb709209-9fc7-4ab9-ad1c-8b6730f72062 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "PUT /compute/v2.1/images/ed1099ac-71c2-480f-aa14-819809358343/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062534 Aug 30 18:15:56.922266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 685/1327] 10.222.0.25 () {60 vars in 1310 bytes} [Tue Aug 30 18:15:56 2022] PUT /compute/v2.1/images/ed1099ac-71c2-480f-aa14-819809358343/metadata/os_distro => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:56.928350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:56.929433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:56.947947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.948532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.949035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.949970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:56.950627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:56.951385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:56.998080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:15:57.240959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c132b929-3644-4aac-99ba-0ac0c3b1898c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 204 len: 0 microversion: 2.1 time: 0.316989 Aug 30 18:15:57.243030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 686/1328] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:15:56 2022] DELETE /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:15:57.250834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdfc0266-b7fa-4821-9230-d6857a5f6fe2 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Action: 'create', calling method: .version_select at 0x7f4e56dc1430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:15:57.285009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-bdfc0266-b7fa-4821-9230-d6857a5f6fe2 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] HTTP exception thrown: Image not found. Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdfc0266-b7fa-4821-9230-d6857a5f6fe2 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Request method failure captured: Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/images/4808ec40-d2ec-44e4-abda-7e0f2ae9602d/metadata HTTP/1.1 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 57 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPbMxJqXo1cydwFkJtCuNMUc4uNF2xurXnwoHerHl49e3mnWTcOqiZIPWEKd4QdMeLqSGBNcIneWE3fLIv7Tt7OSFWtoHwqH45aqZZcn1EaDmyQNbde2JZyDNR712H6Lql8lKn2YMKuD7sPYxyipIL-D1AbVS-wZNiZ8wKf4jwK-Ik Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f5830f021ad45a980046ec1b0b7878f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6f5830f021ad45a980046ec1b0b7878f Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5e8bf91b175c48a4aafbc6ea1413aa26 Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1194453127-project Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'image_id': '4808ec40-d2ec-44e4-abda-7e0f2ae9602d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4808ec40-d2ec-44e4-abda-7e0f2ae9602d Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:15:57.289609 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4808ec40-d2ec-44e4-abda-7e0f2ae9602d could not be found. Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:15:57.294728 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:15:57.301479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdfc0266-b7fa-4821-9230-d6857a5f6fe2 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:15:57.329499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:57.340466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-70c86ba5-aff3-4ff8-ab88-b6baf35a987e tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1317 microversion: 2.1 time: 1.559152 Aug 30 18:15:57.342445 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 643/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:55 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1317 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:57.352918 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bdfc0266-b7fa-4821-9230-d6857a5f6fe2 tempest-ImagesMetadataNegativeTestJSON-1194453127 tempest-ImagesMetadataNegativeTestJSON-1194453127-project] 10.222.0.25 "POST /compute/v2.1/images/4808ec40-d2ec-44e4-abda-7e0f2ae9602d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.107344 Aug 30 18:15:57.359141 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 687/1330] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Aug 30 18:15:57 2022] POST /compute/v2.1/images/4808ec40-d2ec-44e4-abda-7e0f2ae9602d/metadata => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:15:57.366510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:57.366932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:57.373210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:57.381478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:57.382100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:57.382789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:57.383754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:57.384303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:57.384745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:57.385499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:57.428810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:57.429685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:57.430485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:57.431855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:57.440524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:57.441323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:57.941161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:57.961130 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-546778c0-f389-43fd-a282-f12836216592 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1539 microversion: 2.1 time: 0.600671 Aug 30 18:15:57.983622 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 688/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:57 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1539 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:58.005067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:58.011523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:58.053204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:58.059561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:58.066898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:58.073878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:58.077221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:58.078053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:58.377839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:58.397584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c75be076-caa7-43b3-b44b-20e0228cb63f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 1.053622 Aug 30 18:15:58.412092 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 644/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:57 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:58.412351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:58.414467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:58.435449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:58.436296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:58.437941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:58.439181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:58.440420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:58.441423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:58.461234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:58.478958 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3bcbd2b-7b01-4ba5-a305-3f1829626412 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 0.491924 Aug 30 18:15:58.480672 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 689/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:57 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:58.991853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:58.992754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:59.005520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.006040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.009477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.010828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.011326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.011765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.374288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:59.387545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee2369d7-8d65-4370-84f9-42e21b69e12c tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1539 microversion: 2.1 time: 0.400025 Aug 30 18:15:59.388908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 690/1334] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:58 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1539 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:15:59.423153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:59.424500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:59.449368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.449368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.449368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.450652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.451613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.451780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.646474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:15:59.666840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e592ded3-4d39-49c4-a30c-c0854e9ea976 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1508 microversion: 2.1 time: 1.257762 Aug 30 18:15:59.669151 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 645/1335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:58 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1508 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:15:59.692809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:15:59.695685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:15:59.744385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.745308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.746159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.751915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:15:59.753665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:15:59.754647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:15:59.969807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:00.017145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-75ba8f69-6ed4-48cc-9f13-168a5e7ec6ae tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.597248 Aug 30 18:16:00.024706 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 691/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:59 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:16:00.042456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:00.044440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:00.062078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:00.065021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:00.066525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:00.069582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:00.070713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:00.071978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:00.451534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:00.475696 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1bb790d0-b359-47f9-aa60-ad13016f7ea8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 0.803967 Aug 30 18:16:00.490867 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 646/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:15:59 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:00.500698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:00.502481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:00.510889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:00.511650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:00.512301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:00.515438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:00.516512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:00.518298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.005907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:01.009133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:01.014555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbe6253b-db23-4bec-a3b8-9c33a596671e tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1539 microversion: 2.1 time: 0.522138 Aug 30 18:16:01.022103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 647/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:00 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1539 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:01.026655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-337d3e7e-855c-4d77-a3a9-18989db38bfe tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1508 microversion: 2.1 time: 0.999703 Aug 30 18:16:01.027452 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 692/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:00 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1508 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:01.047783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:01.048403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:01.051543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:01.054957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:01.063907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.064414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.064863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.065799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.066259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.066723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.069405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.071878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.072553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.074041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.075864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.076522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.145010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:01.187010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:01.218240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=22 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:01.265844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-982af628-7744-4aa0-b130-6b2197f523d2 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "PUT /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1080 microversion: 2.1 time: 0.218395 Aug 30 18:16:01.267191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 693/1340] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:16:01 2022] PUT /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1080 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:01.288457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:01.290073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:01.297733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.298587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.299205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.300267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.300907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.301492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.781699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:01.796936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c136107-c723-4f0a-b578-f08d0d5c286c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.756325 Aug 30 18:16:01.798921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 648/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:01 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:01.814586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:01.815664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:01.880212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.880959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.882272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.886638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:01.888319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:01.889775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:01.966141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:01.984643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1543b2a4-c516-4b3d-97bb-a87139bf0c5b tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1506 microversion: 2.1 time: 0.701457 Aug 30 18:16:01.985609 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 694/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:01 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:16:01.998067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:01.999813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:02.030312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.032434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.033332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.034879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.036108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.037133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.435850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:02.448207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa424a94-b725-4f59-985b-d094ef1d3d5b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 0.459575 Aug 30 18:16:02.449027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 695/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:01 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:02.462272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e0183a-6cab-4b65-92da-0d443f88252f", "tag": "090b32d5-c15e-4b8c-a9d0-1c59528f6de2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:02.516648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.518119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.519260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.576437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] Creating event network-changed:090b32d5-c15e-4b8c-a9d0-1c59528f6de2 for instance 38e0183a-6cab-4b65-92da-0d443f88252f on n-h1-854119-10 Aug 30 18:16:02.614873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-60d63685-8174-40ee-92aa-261e95c0a9ee req-2356382f-2ac5-493c-b949-a152a31971c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163425 Aug 30 18:16:02.617812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 696/1344] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:02.632088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:02.632837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:02.642591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.643652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.644581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.645571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.646254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.653193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.675320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:02.690193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:02.735391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-039f11fd-6b17-484b-8337-f2bd2fb0f0f4 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 2422 microversion: 2.25 time: 0.934784 Aug 30 18:16:02.736794 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 649/1345] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:01 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 2422 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:02.742881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:02.744041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:02.758753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.759445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.759899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.760646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:02.761110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:02.761538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:02.952191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013ace46f78c44fda2b666fb2ef598f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0056a7a8b2fc4497a61f73751eaeed29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:03.043556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:03.066279 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33a8134c-b92a-4b3a-b24e-b5bfd2f78442 tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 200 len: 1497 microversion: 2.1 time: 0.320176 Aug 30 18:16:03.068439 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 650/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:02 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:03.095857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": "auto"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:03.111093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:03.126384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:03.126688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:03.137918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:03.138429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:03.139158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:03.139833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:03.140738 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-681ac3f7-d24b-40e2-843e-5513bfdf6bdb tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1506 microversion: 2.1 time: 0.521401 Aug 30 18:16:03.143572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:03.144316 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 697/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:02 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:03.153190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:03.153814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:03.180950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:03.183786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:03.184561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:03.186614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:03.199291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'flavor' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:03.200848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:03.201556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:03.232022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:16:03.796108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:03.809325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91f296c8-f738-4604-9875-78745f4b79d9 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.659918 Aug 30 18:16:03.811353 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 698/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:03 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:03.829034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c930ad-6ffb-4955-8138-6eea11fd8024", "name": "network-vif-deleted", "tag": "5e8e95c7-9368-4762-9af3-51d141254d37"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:03.867795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:03.895464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:03.901607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:03.951881 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] Creating event network-vif-deleted:5e8e95c7-9368-4762-9af3-51d141254d37 for instance 67c930ad-6ffb-4955-8138-6eea11fd8024 on n-h2-854119-10 Aug 30 18:16:03.988841 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-68e8bcf4-bf63-4f21-a9e6-e1fcf32434f5 req-5b21f085-ba00-4912-8080-bbbe8b9e4a26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172508 Aug 30 18:16:03.992846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 699/1349] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:04.028241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:04.040244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:04.078773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.081035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.083418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.087879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.090966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.091783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.282803 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-49343ec5-cb0b-4b4b-9d3d-5b31427bfd5d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "PUT /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1082 microversion: 2.1 time: 0.287017 Aug 30 18:16:04.285845 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 700/1350] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:16:03 2022] PUT /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1082 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:04.294434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:04.295530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:04.305836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.307092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.307793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.308979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.309722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.312210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.708041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:04.726505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e4132a4-d9da-4583-8d0d-9cdc4723494c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 0.438040 Aug 30 18:16:04.750698 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 701/1351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:04 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:04.768548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:04.769436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] [instance: 67c930ad-6ffb-4955-8138-6eea11fd8024] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:04.776376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.777166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.777774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.778690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.779309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.779935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.796346 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] HTTP exception thrown: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Request method failure captured: Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 HTTP/1.1 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlOfJdfGLve7BD_TYkMmIRB8GDTF5NQUrOi66kicL_MAHklU4in5WmRagTnGW8VsFrnwmx0xJC9a6WOgyycnWDeDTxi0wrruWLPSDg3kVlio_UO6Tnk5MuJn1VHM_PRmayokgdo69HIcMSXes1lca05to4t1yiBjYDdwhCw0kn1dnlQ Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0056a7a8b2fc4497a61f73751eaeed29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0056a7a8b2fc4497a61f73751eaeed29 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 013ace46f78c44fda2b666fb2ef598f8 Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '67c930ad-6ffb-4955-8138-6eea11fd8024'} Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. Aug 30 18:16:04.798694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. Aug 30 18:16:04.802673 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:04.811508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] Returning 404 to user: Instance 67c930ad-6ffb-4955-8138-6eea11fd8024 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:04.812204 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-134091e6-edd9-4c07-99ff-0583029ac64a tempest-FloatingIPsAssociationNegativeTestJSON-570722715 tempest-FloatingIPsAssociationNegativeTestJSON-570722715-project] 10.222.0.25 "GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024" status: 404 len: 111 microversion: 2.1 time: 0.047701 Aug 30 18:16:04.812795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 702/1352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:04 2022] GET /compute/v2.1/servers/67c930ad-6ffb-4955-8138-6eea11fd8024 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:04.820614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:04.821642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:04.829711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.830508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.831152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:04.832091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:04.832708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:04.833343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:05.352553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:05.386065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afbc84c9-8dc2-43d6-b517-d44f73820fe5 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1508 microversion: 2.1 time: 0.567802 Aug 30 18:16:05.387143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 703/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:04 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:05.393955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe353ac-e200-4f1e-8552-890b2bd14e58", "tag": "1849ef43-2ba8-4321-a8a3-8b5e69532b14"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:05.405404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:05.406798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:05.407331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:05.441893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] Creating event network-changed:1849ef43-2ba8-4321-a8a3-8b5e69532b14 for instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 on n-h1-854119-10 Aug 30 18:16:05.470047 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4f0bab25-63cd-40ae-9cb4-0209d659918c req-bfe9a5f8-db79-4e63-9b54-89611d0ff01e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081125 Aug 30 18:16:05.471059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 704/1354] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:05.476385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:05.479100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:05.496398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:05.497086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:05.497831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:05.498939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:05.499562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:05.500152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:06.221264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:06.234590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7d75320-82b2-4ef5-bac1-b6a26b1c6a1c tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.762068 Aug 30 18:16:06.235639 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 705/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:05 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:06.248113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:06.253269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:06.269146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:06.275556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:06.279353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:06.284223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:06.285752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:06.288360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.080521 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa96c6a1-d2e0-4dc5-a708-93558b383b1a tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/action" status: 202 len: 0 microversion: 2.25 time: 4.007952 Aug 30 18:16:07.081785 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 651/1356] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:16:03 2022] POST /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/action => generated 0 bytes in 4013 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:16:07.089012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:07.090047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:07.098054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.099000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.099712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.100741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.101483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.102208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.184062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:07.197062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aef3b55a-e491-4399-8c4f-d2c666b4da91 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1508 microversion: 2.1 time: 0.958790 Aug 30 18:16:07.204430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 706/1357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:06 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1508 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:07.240317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:07.241095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:07.271308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.277948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.279748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.283151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.283772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.285508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.886997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:07.909575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:07.911469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:07.912770 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f576384f-7edc-4f27-8cb7-c0fe7fa5e0ae tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.682891 Aug 30 18:16:07.913357 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 707/1358] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:07 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:07.940481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:07.941363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:07.966779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.967850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.968501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:07.969413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:07.970100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:07.970773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.026590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:16:08.171030 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-82dd6868-5c37-4bc5-a2c4-f46db049f29c tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 204 len: 0 microversion: 2.1 time: 0.239197 Aug 30 18:16:08.172939 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 708/1359] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:07 2022] DELETE /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:16:08.194215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:08.197986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:08.207725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.208641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.209539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.210814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.211574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.213090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.370366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:08.381410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08992760-6bae-4a52-8824-72825e2dae31 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 1.298210 Aug 30 18:16:08.383751 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 652/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:07 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:08.402682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:08.405819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:08.419324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.421192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.422120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.423114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.423872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.424458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.462080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:16:08.565534 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Instance is already in deleting state, ignoring this request Aug 30 18:16:08.566663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d87327c-3ee9-46a2-96be-74bf63fd4631 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 204 len: 0 microversion: 2.1 time: 0.178023 Aug 30 18:16:08.579644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 653/1361] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:08 2022] DELETE /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:16:08.592264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:08.592974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:08.611765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.612284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.613404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.614243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.615319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.615776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.732544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:08.746705 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92af8e83-e2ed-4a66-a721-4985745eba7a tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.571374 Aug 30 18:16:08.747951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 709/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:08 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:08.942046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:08.942812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:08.956935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.957445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.957888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:08.958876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:08.960911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:08.967143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:09.425585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:09.437493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa8602fd-1530-4144-b4e0-fc519eefba51 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1514 microversion: 2.1 time: 0.855331 Aug 30 18:16:09.439463 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 654/1363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:08 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1514 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:09.450895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:09.454588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:09.463121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:09.463615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:09.464055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:09.464782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:09.465229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:09.470171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:09.601373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:09.620909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:09.625778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:09.632004 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7bc93f0-e664-4ebe-9169-7c13b6f45371 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.690768 Aug 30 18:16:09.633045 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 710/1364] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:08 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:16:09.770275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:09.771268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:09.784105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:09.784934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:09.787351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:09.788377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:09.791706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:09.792418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:10.423806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:10.451901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b722bc1-8ea8-4971-b753-094970a4f5d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 0.684714 Aug 30 18:16:10.453336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 711/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:09 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:10.482490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:10.483757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:10.496055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:10.497425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:10.498214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:10.500896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:10.502372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:10.503381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.052880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:11.056359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:11.069207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b77c91ec-2248-4fbf-8c45-38abb561b26f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 1.628498 Aug 30 18:16:11.069809 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 655/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:09 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:11.098433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:11.098433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:11.109499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:11.126906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:11.132754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7153798c-c128-46ec-ae5f-5b1ea9c36a20 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1514 microversion: 2.1 time: 0.659933 Aug 30 18:16:11.134185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 712/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:10 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1514 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:11.146911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:11.147501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:11.147889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e0183a-6cab-4b65-92da-0d443f88252f", "name": "network-vif-plugged", "status": "completed", "tag": "090b32d5-c15e-4b8c-a9d0-1c59528f6de2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:11.148016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.148782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:11.149383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:11.150015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.185743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:11.191077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:11.191502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.212977 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] Creating event network-vif-plugged:090b32d5-c15e-4b8c-a9d0-1c59528f6de2 for instance 38e0183a-6cab-4b65-92da-0d443f88252f on n-h1-854119-10 Aug 30 18:16:11.224744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bb749756-2b21-468c-a001-6d0a25c2660c req-fda4f05d-e746-4897-ad4f-8eac08b506de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088390 Aug 30 18:16:11.226074 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 713/1368] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:11.479953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:11.480895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:11.499202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:11.501014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:11.501650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.504280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:11.505458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:11.507933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:11.561319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:11.858538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:11.897309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:11.907023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:11.908453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d9bffa9-b743-411d-a842-a23342815deb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.821215 Aug 30 18:16:11.935610 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 656/1369] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:11 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:12.095212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:12.105741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:12.125605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:12.134494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:12.135611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:12.136730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:12.137550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:12.138362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:12.777255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:12.814044 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb2b88a1-b734-4bb1-b693-2f8e7ae62eff tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 1.339548 Aug 30 18:16:12.828933 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 714/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:11 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:12.845423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:12.846574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:12.881725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:12.882656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:12.883355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:12.884637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:12.885498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:12.886180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:13.091727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:13.117756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec31db96-ea05-4411-8fb3-6a2ba3ed5ec6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1472 microversion: 2.1 time: 0.286997 Aug 30 18:16:13.118818 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 715/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:12 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:13.133464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:13.135403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:13.142961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:13.143902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:13.145282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:13.146540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:13.147210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:13.147789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:13.641749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:13.688003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b24f595f-7eb0-443e-a076-10fefd5efb21 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1319 microversion: 2.1 time: 1.592635 Aug 30 18:16:13.698712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 657/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:12 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1319 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:13.718997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe353ac-e200-4f1e-8552-890b2bd14e58", "name": "network-vif-plugged", "status": "completed", "tag": "1849ef43-2ba8-4321-a8a3-8b5e69532b14"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:13.818324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:13.819487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:13.827366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:13.927640 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] Creating event network-vif-plugged:1849ef43-2ba8-4321-a8a3-8b5e69532b14 for instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 on n-h1-854119-10 Aug 30 18:16:13.945688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-597393cb-7d61-428b-a190-686c1e6bf228 req-8704a053-0064-4de8-8cd2-9639ae7cee1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243888 Aug 30 18:16:13.953128 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 658/1373] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:13.972841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48a92c7-9947-411d-9ca4-b58afb9d0a30", "name": "network-vif-deleted", "tag": "2280d27b-f603-48bf-b7ef-ccc431b3abdd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:14.010226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.011424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.014884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.074696 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] Creating event network-vif-deleted:2280d27b-f603-48bf-b7ef-ccc431b3abdd for instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 on n-h1-854119-10 Aug 30 18:16:14.100740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5c79f6ce-9389-4a52-8b2c-a35db255ee6e req-141dc105-cd62-4e92-ad02-a38d6c866461 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144788 Aug 30 18:16:14.104931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 659/1374] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:14.139687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:14.143550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:14.156465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.157257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.157934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.161873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.169387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.171617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.268811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:14.321202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:14.326925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:14.334689 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e21984e8-65b0-4e0c-8007-f53578e2f1a3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 1.212537 Aug 30 18:16:14.342065 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 716/1375] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:13 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:14.360682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:14.362715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:14.389524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.390954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.394514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.402013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.406668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.407585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.542964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.545331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.545889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.549649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lazy-loading 'fault' on Instance uuid f48a92c7-9947-411d-9ca4-b58afb9d0a30 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:14.670783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2acdcb76554cbf9c45566a19d03f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3b0bb317f54a1d98e6fdf479a08b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:14.686816 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3955a598-a5dd-41c5-bedd-2ce2b609df3f tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 200 len: 1307 microversion: 2.1 time: 0.340866 Aug 30 18:16:14.688071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 717/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:14 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:14.715321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:14.716190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:14.735755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.736505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.737329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:14.738304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:14.738985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:14.739559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:15.006111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:15.024875 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4724afef-15c2-457f-b12d-325131c3fb3e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1499 microversion: 2.1 time: 0.314671 Aug 30 18:16:15.030253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 718/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:14 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1499 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:15.047786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:15.048582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:15.056682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:15.057333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:15.058042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:15.059050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:15.059807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:15.060462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:15.518465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:15.533167 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36ef1890-114a-4c60-86d1-0039e55a8428 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1499 microversion: 2.1 time: 0.490717 Aug 30 18:16:15.540173 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 719/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:15 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1499 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:16:15.804602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1997990365", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:15.898599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:15.918065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:15.920193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-602afbd2-f394-4633-af92-01cc73ec28d3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1315 microversion: 2.1 time: 1.806927 Aug 30 18:16:15.920887 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 660/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:14 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1315 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:15.941193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:15.950308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:15.987784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:15.988754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:15.989555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:15.990943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:15.991754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:15.992561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:16.883212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:16.885653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:16.887649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:16.889061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:16.890661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:16.907839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:16.909162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:16.910311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:16.912005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:16.914014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:16.915985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:16.991829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:17.008025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:17.036244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:17.044168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:17.073138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:17.163914 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-484a2ce8-b1bc-4982-bad5-3e22d49e64a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.622258 Aug 30 18:16:17.165303 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 720/1380] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:17.182666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:17.183195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:17.213384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.213932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.214405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.217756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.217756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.218192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.254410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:16:17.360378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:17.373939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:17.383645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:17.387890 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9623e35-92c0-46e5-a746-58e185c6aaeb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 1.464440 Aug 30 18:16:17.401951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 661/1381] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:15 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:17.408212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:17.409529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: f48a92c7-9947-411d-9ca4-b58afb9d0a30] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:17.438645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.451869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.452682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.456306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0bdc772d-b428-49fb-be4d-b9f6d502c81a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 204 len: 0 microversion: 2.1 time: 0.281829 Aug 30 18:16:17.460244 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 721/1382] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:17 2022] DELETE /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:16:17.462061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.465248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:17.465671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.466566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.468453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:17.488817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.489910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.490400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.491183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:17.491653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:17.492170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:17.505069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] HTTP exception thrown: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Request method failure captured: Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 HTTP/1.1 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMxBLYrmnoPNms7IB28Me8xzkPq7mxyuS1Ptxl2pDhGelnc-HgLDdhCg30rKrqjO1a0A1KAhMMoE9uYnkDppb9yvNiDnknL8JezocctgKKgaXXcoGUNNPzzqHtoXOwccuDxmlS78MOdGyZ4rjrtoiIZT3Ck1UhsQ0f1SVPWyHG1M8g Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ab2acdcb76554cbf9c45566a19d03f35 Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f48a92c7-9947-411d-9ca4-b58afb9d0a30'} Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:17.508344 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. Aug 30 18:16:17.513576 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:17.518777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Returning 404 to user: Instance f48a92c7-9947-411d-9ca4-b58afb9d0a30 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:17.522631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6b55cff-0f1b-44e2-8ebe-24e8d78e7337 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30" status: 404 len: 111 microversion: 2.1 time: 0.117501 Aug 30 18:16:17.526903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 662/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:17 2022] GET /compute/v2.1/servers/f48a92c7-9947-411d-9ca4-b58afb9d0a30 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:17.533277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0226a459-3fb3-4ba3-b097-58c8e1e6f25b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:17.541400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0226a459-3fb3-4ba3-b097-58c8e1e6f25b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:17.916547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:17.937513 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0052b374-9ad3-4a83-8392-da7778d58d2d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1503 microversion: 2.1 time: 0.476136 Aug 30 18:16:17.939038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 722/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:17 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:17.963447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:17.972456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0226a459-3fb3-4ba3-b097-58c8e1e6f25b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:17.977732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:17.990873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0226a459-3fb3-4ba3-b097-58c8e1e6f25b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1215 microversion: 2.1 time: 0.457963 Aug 30 18:16:17.994645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 663/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:17 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:18.008896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:18.009246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:18.009723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.010514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.011165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.020031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.020546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.021418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.043684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.047968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.054033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.057536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.069221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.076349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.127388 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] HTTP exception thrown: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Request method failure captured: Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 HTTP/1.1 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlMxBLYrmnoPNms7IB28Me8xzkPq7mxyuS1Ptxl2pDhGelnc-HgLDdhCg30rKrqjO1a0A1KAhMMoE9uYnkDppb9yvNiDnknL8JezocctgKKgaXXcoGUNNPzzqHtoXOwccuDxmlS78MOdGyZ4rjrtoiIZT3Ck1UhsQ0f1SVPWyHG1M8g Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ab2acdcb76554cbf9c45566a19d03f35 Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1dd547e1-673a-4754-9a1c-3d4a9807b825'} Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:18.142437 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Returning 404 to user: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:18.149736 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57d60694-66b0-402c-b158-14be2a4be27d tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 404 len: 111 microversion: 2.1 time: 0.148529 Aug 30 18:16:18.156857 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 664/1386] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:17 2022] DELETE /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:18.177350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1231002389"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:18.178527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:18.201854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.205823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.206386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.211798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.213398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.214840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.549397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:18.566773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7fd9abef-5b26-4c98-ae97-623a385fdb1f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1505 microversion: 2.1 time: 0.624325 Aug 30 18:16:18.567618 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 723/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:17 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:18.583968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:18.585139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 1dd547e1-673a-4754-9a1c-3d4a9807b825] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:18.602431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.602880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.609329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.610372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.610915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.611266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.651435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] HTTP exception thrown: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Request method failure captured: Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 HTTP/1.1 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMxBLYrmnoPNms7IB28Me8xzkPq7mxyuS1Ptxl2pDhGelnc-HgLDdhCg30rKrqjO1a0A1KAhMMoE9uYnkDppb9yvNiDnknL8JezocctgKKgaXXcoGUNNPzzqHtoXOwccuDxmlS78MOdGyZ4rjrtoiIZT3Ck1UhsQ0f1SVPWyHG1M8g Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ab2acdcb76554cbf9c45566a19d03f35 Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1dd547e1-673a-4754-9a1c-3d4a9807b825'} Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:18.654652 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Returning 404 to user: Instance 1dd547e1-673a-4754-9a1c-3d4a9807b825 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:18.658772 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b9a872d1-c0e3-4ad2-bb4a-30c0810c7b34 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825" status: 404 len: 111 microversion: 2.1 time: 0.089722 Aug 30 18:16:18.661553 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 724/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:18 2022] GET /compute/v2.1/servers/1dd547e1-673a-4754-9a1c-3d4a9807b825 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:18.685398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:18.686032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:18.693229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.693858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.694163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:18.694996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:18.695458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:18.695921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:19.124317 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.network.security_group_api [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Adding security group e4f78a89-0d73-4ba6-a85a-a2b1f2bc75e2 to port 1849ef43-2ba8-4321-a8a3-8b5e69532b14 Aug 30 18:16:19.204216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:19.229708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:19.232266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:19.236612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4495e03-211c-434f-854f-cc832629f102 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.573760 Aug 30 18:16:19.255202 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 725/1389] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:18 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:19.286187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:19.287149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:19.312973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:19.313476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:19.313923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:19.314698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:19.315166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:19.315670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:19.372142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] HTTP exception thrown: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Request method failure captured: Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 HTTP/1.1 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMxBLYrmnoPNms7IB28Me8xzkPq7mxyuS1Ptxl2pDhGelnc-HgLDdhCg30rKrqjO1a0A1KAhMMoE9uYnkDppb9yvNiDnknL8JezocctgKKgaXXcoGUNNPzzqHtoXOwccuDxmlS78MOdGyZ4rjrtoiIZT3Ck1UhsQ0f1SVPWyHG1M8g Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ab2acdcb76554cbf9c45566a19d03f35 Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '07317ac0-9deb-4c18-820c-6582f4fe9a80'} Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:19.374002 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Returning 404 to user: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:19.378967 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c203481f-3811-478d-8881-22974b1c71c6 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 404 len: 111 microversion: 2.1 time: 0.118646 Aug 30 18:16:19.380481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 726/1390] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:19 2022] DELETE /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:19.388341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:19.388969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:19.411123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:19.414392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:19.415006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:19.418144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:19.418681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:19.419130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:20.097636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:20.123297 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d51b588-eccb-4597-bba0-7198da144d36 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1267 microversion: 2.1 time: 0.740111 Aug 30 18:16:20.125494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 727/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:19 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1267 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:20.143103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:20.147327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] [instance: 07317ac0-9deb-4c18-820c-6582f4fe9a80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:20.176107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:20.177029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:20.177712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:20.181063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:20.182182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:20.185351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:20.233091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] HTTP exception thrown: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Request method failure captured: Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 HTTP/1.1 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlMxBLYrmnoPNms7IB28Me8xzkPq7mxyuS1Ptxl2pDhGelnc-HgLDdhCg30rKrqjO1a0A1KAhMMoE9uYnkDppb9yvNiDnknL8JezocctgKKgaXXcoGUNNPzzqHtoXOwccuDxmlS78MOdGyZ4rjrtoiIZT3Ck1UhsQ0f1SVPWyHG1M8g Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d3b0bb317f54a1d98e6fdf479a08b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d3b0bb317f54a1d98e6fdf479a08b8a Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1212010358 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ab2acdcb76554cbf9c45566a19d03f35 Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerDiskConfigTestJSON-1212010358-project Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '07317ac0-9deb-4c18-820c-6582f4fe9a80'} Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:20.240382 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. Aug 30 18:16:20.248727 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:20.257295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] Returning 404 to user: Instance 07317ac0-9deb-4c18-820c-6582f4fe9a80 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:20.259648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ce4f83b-32c7-4a07-a766-5d47f909b711 tempest-ServerDiskConfigTestJSON-1212010358 tempest-ServerDiskConfigTestJSON-1212010358-project] 10.222.0.25 "GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80" status: 404 len: 111 microversion: 2.1 time: 0.132649 Aug 30 18:16:20.265249 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 728/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:20 2022] GET /compute/v2.1/servers/07317ac0-9deb-4c18-820c-6582f4fe9a80 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:20.289480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:20.293424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:20.382094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:20.383007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:20.383637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:20.384719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:20.385316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:20.387103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:21.086760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:21.104716 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07697363-cdc5-4842-bb51-144f96e8eac9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1463 microversion: 2.1 time: 0.827916 Aug 30 18:16:21.105983 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 729/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:20 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1463 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:21.111307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:21.112209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:21.119262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:21.120078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:21.121240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:21.122219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:21.122980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:21.123602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.331207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:22.342375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:22.348824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:22.349925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24bf566c-2147-4445-87bd-4f5be703b558 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/action" status: 202 len: 0 microversion: 2.1 time: 4.191299 Aug 30 18:16:22.351552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 665/1394] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:16:18 2022] POST /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/action => generated 0 bytes in 4194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:22.352795 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a3ba2220-9940-4e81-b93c-cf4248a20646 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 1.245421 Aug 30 18:16:22.357268 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 730/1395] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:21 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:22.357944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:22.358643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:22.369228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:22.373075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:22.384883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.385921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.389425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.390301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.390880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.391326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.395124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.409052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.415649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.416843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.421040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.421862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.500943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.507625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.508583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.509483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lazy-loading 'fault' on Instance uuid 38e0183a-6cab-4b65-92da-0d443f88252f {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:22.523390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:22.731142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:22.756821 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65dd4ab5-99ea-45f0-acc5-9a05294b1226 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 200 len: 1309 microversion: 2.1 time: 0.397357 Aug 30 18:16:22.758851 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 731/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:22 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:22.768287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e0183a-6cab-4b65-92da-0d443f88252f", "name": "network-vif-deleted", "tag": "090b32d5-c15e-4b8c-a9d0-1c59528f6de2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:22.787611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.789131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.790330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.827418 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] Creating event network-vif-deleted:090b32d5-c15e-4b8c-a9d0-1c59528f6de2 for instance 38e0183a-6cab-4b65-92da-0d443f88252f on n-h1-854119-10 Aug 30 18:16:22.834563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a62f107b-8a21-4cee-969d-1d9102b594ca req-caa034c2-e840-4f0a-8fba-5587bde7e14b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073616 Aug 30 18:16:22.838831 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 732/1397] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:22.851250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1269306472"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:22.854839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:22.870423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.874770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.875361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:22.876838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:22.878384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:22.881491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:23.030670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:23.046040 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aac8dcb7-2de2-4dc3-b109-915b6c76b840 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1273 microversion: 2.1 time: 0.692494 Aug 30 18:16:23.046695 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 666/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:22 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1273 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:23.403287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:23.407790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:23.428591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:23.429397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:23.429839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:23.430657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:23.431122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:23.431548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:23.605959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Adding security group c488c214-7168-442b-866e-7dc1197844f0 to port 1849ef43-2ba8-4321-a8a3-8b5e69532b14 Aug 30 18:16:24.015588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:24.030781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:24.036367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:24.041899 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-27cc2cf9-1c9a-4b8c-a0d1-c28d9b6f31b4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.650573 Aug 30 18:16:24.062658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 667/1399] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:23 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:24.078127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:24.079372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:24.091911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:24.093497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:24.094550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:24.097272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:24.103481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:24.108829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:24.150876 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f HTTP/1.1 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '38e0183a-6cab-4b65-92da-0d443f88252f'} Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:24.152809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:16:24.159004 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:24.159846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:24.164035 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c33a8169-9226-40f3-a97c-d6568d922ab0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 404 len: 111 microversion: 2.1 time: 0.091718 Aug 30 18:16:24.165189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 668/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:24 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:24.181518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:24.182493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:24.198128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:24.200527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:24.201169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:24.203836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:24.207114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:24.207741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:24.799523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:24.816776 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4f2ed81-c928-494b-862c-894959a661a7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 0.647752 Aug 30 18:16:24.819960 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 669/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:24 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:24.846926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c01e8658-471a-4d31-91f2-1a21535950b3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: .version_select at 0x7f4e568e6dc0>, body: {"keypair": {"name": "tempest-key-1550685588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/rF4Z0FWmTWeYwYPeJUA7zDQWINtOEby52Ydb0+OF9AQUgwQACxotttOJpnL9HsUmd7q0ZBS8MFrvRccTPpm6Qm2yWeK5xL0GLVFwxCQFMN75G7nI639rImj4Rbv5Bvw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:24.989367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c01e8658-471a-4d31-91f2-1a21535950b3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:25.026218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c01e8658-471a-4d31-91f2-1a21535950b3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:25.145000 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c01e8658-471a-4d31-91f2-1a21535950b3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.320671 Aug 30 18:16:25.147864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 670/1402] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:16:24 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:25.168517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe353ac-e200-4f1e-8552-890b2bd14e58", "tag": "1849ef43-2ba8-4321-a8a3-8b5e69532b14"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:25.206975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:25.209591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:25.210090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:25.241657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] Creating event network-changed:1849ef43-2ba8-4321-a8a3-8b5e69532b14 for instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 on n-h1-854119-10 Aug 30 18:16:25.249949 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-54fcc32b-8b24-4242-8070-facfbf24ae2a req-9fcc9255-84ee-4a9b-a6ed-c3f06b1027bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100743 Aug 30 18:16:25.251291 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 671/1403] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:25.257960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:25.259134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:25.271707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:25.272560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:25.274024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:25.275348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:25.275996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:25.276617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:25.782195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:25.794478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:25.796180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:25.797523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13c2e4e8-9f05-4562-907d-6848b4c5e751 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.545067 Aug 30 18:16:25.810795 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 672/1404] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:25 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:25.817484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-df77d699-960f-436b-a71c-fd32ba340afc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '.version_select at 0x7f4e56a3e1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:25.828284 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-df77d699-960f-436b-a71c-fd32ba340afc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:16:25.837767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-df77d699-960f-436b-a71c-fd32ba340afc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024919 Aug 30 18:16:25.848830 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 673/1405] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:16:25 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:25.987117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-50f4341d-a32d-4f70-b2ed-fd1692bb838e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/action" status: 202 len: 0 microversion: 2.1 time: 3.143774 Aug 30 18:16:25.989498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 733/1406] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:16:22 2022] POST /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/action => generated 0 bytes in 3150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:26.004946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:26.007544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:26.044497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:26.046315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:26.048443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:26.052951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:26.055442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:26.057605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:26.173327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-55921073", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6934b7e3-effd-490c-a322-f67172841720"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:26.297921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] validate_networks() for [('6934b7e3-effd-490c-a322-f67172841720', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:26.966820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:27.019179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:27.407304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:27.416971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27e2ee5e-3787-44c0-b7e5-10e0460946b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 1.425421 Aug 30 18:16:27.417567 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 734/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:25 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:27.432328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:27.435047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:27.453770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:27.455380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:27.456031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:27.457644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:27.459046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:27.459680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:28.744253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-efacbc94-551e-4ea4-841c-6c0899660a14 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.316330 Aug 30 18:16:28.746585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 735/1408] 10.222.0.25 () {58 vars in 1293 bytes} [Tue Aug 30 18:16:27 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58/os-security-groups => generated 1158 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:28.763979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe353ac-e200-4f1e-8552-890b2bd14e58", "tag": "1849ef43-2ba8-4321-a8a3-8b5e69532b14"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:28.799948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:28.802992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:28.803750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:28.857849 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] Creating event network-changed:1849ef43-2ba8-4321-a8a3-8b5e69532b14 for instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 on n-h1-854119-10 Aug 30 18:16:28.891656 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-37f73cf5-c1a8-4ec9-9738-0bbed69e0adb req-a3b53e0b-6cdb-4dd3-8acd-edbe8e0a92c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135723 Aug 30 18:16:28.892810 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 736/1409] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:28.922623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-350371629", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-key-1550685588", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:28.946423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:28.947457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:28.948162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:28.949930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:28.950765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:28.989460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:28.995227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:28.996166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:28.998078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:29.001058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:29.004004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:29.038286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:29.061861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:29.071979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for user 1cc40f3a740645d1af38042ad00935b1 and project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:29.087201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:29.090491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:29.167525 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b32de8ae-bb0d-4d4e-a7c4-578f1a9b6537 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317427 Aug 30 18:16:29.173394 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 674/1410] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:29.188812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:29.189854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:29.208628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:29.223367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:29.227493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:29.228888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:29.233016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:29.235112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:29.888987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:29.910138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:29.921366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:29.926137 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e29d7ea0-85e2-42f3-a290-e79c85e4c1b1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.748893 Aug 30 18:16:29.926929 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 675/1411] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:29 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:29.943446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:29.944646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:29.965911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:29.971382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:29.971951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:29.972994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:29.974279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:29.982006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:30.767508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:30.776579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a873966c-9ee8-4f78-b134-d5b0316b0daa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 0.844160 Aug 30 18:16:30.782623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 676/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:29 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:30.799226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93d10bf3-f5a0-49b6-aa2d-131a04761ea4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56baa040>, body: {"security_group": {"name": " tempest-securitygroup -1895876307 ", "description": "tempest-description-935625608"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:31.718501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:31.719063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:31.719415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:31.719835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:31.720429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:31.753878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:31.754305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:31.754781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:31.755588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:31.761356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:31.762087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:31.849772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:31.867974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:31.889042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:31.892876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:32.026461 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a2a4acaa-1ca6-4507-a264-8dc29afb1426 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.116375 Aug 30 18:16:32.032107 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 737/1413] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:32.058051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:32.074543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:32.100149 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93d10bf3-f5a0-49b6-aa2d-131a04761ea4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.315965 Aug 30 18:16:32.100746 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 677/1414] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:30 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:32.125395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.127261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.127693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.129754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.130718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.132790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.288122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1142b38-f620-44f1-b92d-51c230b1a069", "tag": "aa4af4d4-8675-43a9-90c1-3505e8af7ae9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:32.300512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.301319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.302439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.315868 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] Creating event network-changed:aa4af4d4-8675-43a9-90c1-3505e8af7ae9 for instance e1142b38-f620-44f1-b92d-51c230b1a069 on n-h2-854119-10 Aug 30 18:16:32.322090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-de473b3e-5499-4556-a4c3-93dfeee58d14 req-a769a49b-5dec-4b5c-a250-994ae69cbcc5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219872 Aug 30 18:16:32.323373 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 678/1415] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:32.329658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:32.330777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:32.342113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.344285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.345110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.346125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.346939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.347607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.516634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:32.563960 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-060b40b7-7664-4098-b08c-a0a5fce2d94c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1276 microversion: 2.1 time: 0.529081 Aug 30 18:16:32.568637 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 738/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:32 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1276 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:32.577685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:32.601269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:32.602736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:32.603649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:32.624946 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] Creating event network-vif-unplugged:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h2-854119-10 Aug 30 18:16:32.633902 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fb37e2a0-31eb-4aaf-86f4-de7a923dc3cb req-59202894-5be1-4f9a-9c75-4bea0bc23cc3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062543 Aug 30 18:16:32.635002 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 739/1417] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:32.741322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1717167337", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "52c8298b-12f8-4e95-8e3d-1e6d6e6336e2"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:32.817448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] validate_networks() for [('52c8298b-12f8-4e95-8e3d-1e6d6e6336e2', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:34.495220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:34.546147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:34.555792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:34.558881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ccd8b1b5-b460-4b8f-a065-8d9c0784fa90 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 2.233727 Aug 30 18:16:34.570183 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 679/1418] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:32 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:34.586825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:34.599054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:34.619959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:34.631512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:34.632840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:34.638749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:34.640271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:34.644420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:34.672688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:34.673481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:34.674419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:34.675205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:34.675967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:34.730903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:34.731748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:34.732547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:34.760190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:34.761050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:34.761731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:34.896097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:34.918084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for user cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 and project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:34.957657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:34.972305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:35.107658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a0bfa5c5-1821-4f3c-90c5-505a10734670 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471293 Aug 30 18:16:35.130809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 740/1419] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:35.137903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:35.143091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:35.151118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:35.152567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:35.154395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:35.162822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:35.165220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:35.165966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:35.527138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:35.540659 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d6c43ed-cceb-4d9d-b766-95cc58c316d6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1288 microversion: 2.1 time: 0.408212 Aug 30 18:16:35.549649 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 741/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:35 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1288 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:35.562672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c65f2db9-3766-448f-8ee0-79f8f6e754ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56e66b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:35.883474 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c65f2db9-3766-448f-8ee0-79f8f6e754ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814" status: 200 len: 223 microversion: 2.1 time: 0.332140 Aug 30 18:16:35.884697 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 742/1421] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:16:35 2022] GET /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 => generated 223 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:35.890031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:35.890682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:35.910740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:35.911256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:35.911705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:35.912458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:35.912921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:35.913353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:36.217096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:36.247787 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69a77351-0e38-4d46-b74a-33c1101c2036 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 1.674523 Aug 30 18:16:36.249129 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 680/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:34 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:36.289006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:36.331073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:36.333783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:36.338028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:36.374517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] Creating event network-changed:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h2-854119-10 Aug 30 18:16:36.384272 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f802fe9f-bd4d-4308-9e32-b851cceb0228 req-1fea1a67-54e5-434e-a83b-c203c3435a6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118646 Aug 30 18:16:36.385206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 681/1423] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:36.403412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:36.407031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:36.436148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:36.443548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:36.444756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:36.453532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:36.454536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:36.458131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:36.728700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:36.737822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:36.746180 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8208619c-aa2b-44b6-8429-9d8198e44cae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1215 microversion: 2.1 time: 0.358394 Aug 30 18:16:36.747930 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 682/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:36 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1215 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:36.776243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:36.777342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:36.788210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:36.789761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:36.791009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:36.792146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:36.792922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:36.793832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:37.412319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:37.430865 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7775cb63-316b-4fd8-960d-cc64cd10e32d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 1.543416 Aug 30 18:16:37.434242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 743/1425] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:35 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:37.440579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:37.464190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acb4adfa-bec0-4d35-ab96-dec008e1cfe1 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56c9c430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:37.465670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:37.473849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:37.482124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28d29794-794a-441b-bde1-96b5871de298 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.719170 Aug 30 18:16:37.483401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 683/1426] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:36 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:37.491286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:37.493229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:37.506437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:37.507820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:37.508767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:37.510480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:37.511632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:37.512679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:37.912932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:37.922115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8719c1ed-7dbf-4bd5-a9b8-40a4d6d76454 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1286 microversion: 2.1 time: 0.436897 Aug 30 18:16:37.942611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 684/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:37 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1286 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:37.959663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:37.961045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:37.978848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:37.984591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:37.986046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:37.987951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:37.999127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.001340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.365545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acb4adfa-bec0-4d35-ab96-dec008e1cfe1 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814" status: 202 len: 0 microversion: 2.1 time: 0.927921 Aug 30 18:16:38.368323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 744/1428] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:16:37 2022] DELETE /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:38.384640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:38.386224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:38.411054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:38.411709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.412518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.419167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:38.420159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.420928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.672218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:38.700085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89d9d5ac-54c3-487e-aec4-1447c84fddbb tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1269 microversion: 2.1 time: 0.329415 Aug 30 18:16:38.702583 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 745/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:38 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1269 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:38.714230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1142b38-f620-44f1-b92d-51c230b1a069", "name": "network-vif-plugged", "status": "completed", "tag": "aa4af4d4-8675-43a9-90c1-3505e8af7ae9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:38.736197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:38.736571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.737390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.761498 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] Creating event network-vif-plugged:aa4af4d4-8675-43a9-90c1-3505e8af7ae9 for instance e1142b38-f620-44f1-b92d-51c230b1a069 on n-h2-854119-10 Aug 30 18:16:38.771831 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-202a192c-f2b6-47f5-9c0d-ce139b7f2787 req-19b830e5-01ee-4141-b075-ca5643839161 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066061 Aug 30 18:16:38.772671 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 746/1430] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:38.776543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:38.780867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e574004c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:38.791692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d050e54f-5e62-4779-b709-f22c054fda6e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 0.847593 Aug 30 18:16:38.792292 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 685/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:37 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:38.810831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:38.811825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:38.820190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:38.823250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.824070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.825171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:38.825832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:38.826515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:38.978934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:16:38.979543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:16:38.980073 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.980073 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 HTTP/1.1 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '87bbd666-07e7-4165-a3d8-c6a7a05c3814'} Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:16:38.982530 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-533518e2-9652-4f7d-8eb9-b49a1c9f80e5'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58e7af5c-cf4e-4c53-8e2d-b02871e8630b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814" status: 404 len: 194 microversion: 2.1 time: 0.212917 Aug 30 18:16:38.998103 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 747/1432] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:16:38 2022] GET /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:39.007716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:39.007716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:39.021793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.022216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.022755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.023564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.024246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.024677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.025913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:39.084332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:39.402638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:39.416036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:39.418725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:39.420718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-853ee6c5-3e34-4064-a606-6c10e767af17 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.431802 Aug 30 18:16:39.422011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 748/1433] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:38 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:39.428145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:39.428793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:39.437285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.437775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.438206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.438992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.439443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.439889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.591384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:39.626210 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36e6735d-578d-492a-9bcc-7e3daa2353de tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1286 microversion: 2.1 time: 0.202184 Aug 30 18:16:39.634736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 749/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:39 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:39.655031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0856af10-ff9c-4df7-8a36-97547d2c1962 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56dbba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1044595374", "description": "tempest-description-22417018"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:39.807595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:39.829937 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f51abe25-8b1c-481f-9627-f7c4d420bea3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 1.036350 Aug 30 18:16:39.832532 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 686/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:38 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:39.838584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77a6f7d-848a-4117-a0d6-c364e5635ee7", "tag": "4174bc8d-77d1-4335-a74c-0105106ee659"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:39.867796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.868622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.869234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.897070 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] Creating event network-changed:4174bc8d-77d1-4335-a74c-0105106ee659 for instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 on n-h2-854119-10 Aug 30 18:16:39.906920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e734b82b-a30d-4a2e-97e1-8e4156ee70d4 req-0c418e3a-7323-40d2-8ee9-cc7068d7a390 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072795 Aug 30 18:16:39.913622 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 687/1436] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:39.925927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:39.926761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:39.936939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.941874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.952821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:39.954150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:39.954848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:39.955650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:40.108937 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0856af10-ff9c-4df7-8a36-97547d2c1962 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.471880 Aug 30 18:16:40.117195 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 750/1437] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:39 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:40.117195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:40.117195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:40.143108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:40.143418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:40.143819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:40.145656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:40.146186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:40.146692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:40.243613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:40.253044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fda584d8-f24d-4e0a-8a6d-3feabae31a4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1269 microversion: 2.1 time: 0.337854 Aug 30 18:16:40.258155 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 688/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:39 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1269 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:40.271243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e84baff-5847-4e2c-8350-8e3696babb8b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56baab80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-743515679", "description": "tempest-description-90538347"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:40.566919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:40.581673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebe16951-5ff2-489f-9c4d-335c9d68665f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1315 microversion: 2.1 time: 0.468764 Aug 30 18:16:40.596898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 751/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:40 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:40.615406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:40.618468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:40.629273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:40.630330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:40.632613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:40.638115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:40.639735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:40.643976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.006225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:41.017549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:41.019109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:41.020338 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e987b6bd-3c70-4ff5-a3df-436f3c578b0d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.420430 Aug 30 18:16:41.021459 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 752/1440] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:40 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:41.026881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:41.027474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:41.034887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.035762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.036424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.037583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.038248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.038903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.113836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e84baff-5847-4e2c-8350-8e3696babb8b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.853892 Aug 30 18:16:41.115797 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 689/1441] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:40 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:41.122820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:41.124531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:41.141864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.142722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.152000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.154309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.155855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.157453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.430905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:41.444770 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe6d7259-fbee-4156-93db-ce35df91b54e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.422084 Aug 30 18:16:41.449547 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 753/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:41 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:41.458955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab2e8f4e-12ac-4aaa-89ce-77565d1fd8fa tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56f23790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1570520330", "description": "tempest-description-484007347"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:41.701587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:41.720894 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96be26e1-2e0c-4856-a77c-cbdd776239c4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 0.603508 Aug 30 18:16:41.721822 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 690/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:41 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:41.746623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:41.747510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:41.761350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:41.795268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.799734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.801990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:41.806521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:41.809518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:41.811893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:42.505557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:42.540893 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-615a2462-5adb-4e3f-bfd4-d02807f86744 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.801916 Aug 30 18:16:42.542432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 691/1444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:41 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:42.567949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:42.569646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:42.603207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:42.604665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:42.605679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:42.607649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:42.614298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:42.619681 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab2e8f4e-12ac-4aaa-89ce-77565d1fd8fa tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.166911 Aug 30 18:16:42.632323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 754/1445] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:42.643927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:42.658686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:42.672864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:42.705354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:42.756828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:42.757386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:42.757835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:42.761659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:42.762151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:42.762691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:43.104004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:43.120532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:43.125736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:43.129259 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae7eba37-d655-4161-9cca-6ff6f6b3f9e5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.494783 Aug 30 18:16:43.146878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 755/1446] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:42 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:43.153703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:43.154751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:43.162450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:43.163279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:43.163977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:43.166985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:43.167707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:43.168300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:43.541534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:43.549578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db137238-a19d-4874-838c-9f2696009294 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.401232 Aug 30 18:16:43.566903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 756/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:43 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:43.578759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a6c94d5-b4aa-4a93-9bc7-8b392561cc67 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56f7d8b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:44.061088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:44.074828 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1250c7e8-c413-49f2-9cc8-c9fbefa93af1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1503 microversion: 2.1 time: 1.529182 Aug 30 18:16:44.076033 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 692/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:42 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1503 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:44.102864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:44.104869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:44.123672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:44.124879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:44.125925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:44.127637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:44.129043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:44.130470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:44.177206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a6c94d5-b4aa-4a93-9bc7-8b392561cc67 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.602228 Aug 30 18:16:44.179327 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 757/1449] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:16:43 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:44.188087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:44.193072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:44.231304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:44.233494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:44.234273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:44.239929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:44.240979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:44.241840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:44.815555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:44.948207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:45.090112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:45.123477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:45.134978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6fa51e7-245d-4b05-95fb-96476861c34c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.953092 Aug 30 18:16:45.142896 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 758/1450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:44 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:45.162941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:45.164440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:45.193244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:45.195509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:45.197267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:45.200892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:45.202494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:45.203916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:45.293189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:16:45.560843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae78a000-6464-48a4-9d5f-7becb47d5b39 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 204 len: 0 microversion: 2.1 time: 0.415206 Aug 30 18:16:45.563063 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 759/1451] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:16:45 2022] DELETE /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:16:45.571810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:45.574514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:45.583950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:45.585830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:45.586731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:45.587959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:45.588893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:45.589777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:45.712906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:45.728555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2df61c0-3a77-465f-9cd7-50d8b9dfdbe5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 1.643114 Aug 30 18:16:45.732819 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 693/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:44 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:45.751200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ac7b6cf-850b-44ba-a3d8-0e4a7aecd4fb tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e569bd5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:46.053146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:46.071205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:46.072755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:46.074056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-242fb023-6001-4d8a-975f-5fa474c7a539 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.509144 Aug 30 18:16:46.099762 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 760/1453] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:45 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:46.111082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af351fca-85d3-49c5-950a-1d4e5ae3649c", "tag": "8d562005-8f48-4077-b314-dd6558155bc5"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:46.124401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:46.125348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:46.126037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:46.140435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] Creating event network-changed:8d562005-8f48-4077-b314-dd6558155bc5 for instance af351fca-85d3-49c5-950a-1d4e5ae3649c on n-h1-854119-10 Aug 30 18:16:46.154207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6ee208cd-bcfb-4ef0-81ca-69a20d94ab5b req-a272ab8a-3cbf-4130-a254-47610a09bded service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052787 Aug 30 18:16:46.156541 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 761/1454] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:46.167010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:46.167556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:46.182436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:46.183021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:46.183479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:46.187584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:46.188574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:46.189488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:46.842979 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ac7b6cf-850b-44ba-a3d8-0e4a7aecd4fb tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c" status: 202 len: 0 microversion: 2.1 time: 1.105851 Aug 30 18:16:46.846150 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 694/1455] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:16:45 2022] DELETE /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:46.892290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:46.898867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:46.952428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:46.953774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:46.957309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:46.959047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:46.967562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:46.969014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:46.992882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:47.001182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a63ad8d8-10fb-4897-b6ac-f4c8a87e3848 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.842997 Aug 30 18:16:47.006313 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 762/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:46 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:47.014041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:47.017028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:47.030460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:47.033258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:47.047164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:47.048391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:47.049042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:47.049644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:47.628155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:47.641644 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c2cdecb-384f-47dd-beb6-ca663d5e067f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.633688 Aug 30 18:16:47.642671 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 763/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:47 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:47.653125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:47.660103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:47.673349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:47.676983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:47.677596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:47.680536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:47.681170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:47.681984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:47.688550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:47.701910 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f5823f9-4c33-4262-bea7-0c7dfdb83f44 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1509 microversion: 2.1 time: 0.854148 Aug 30 18:16:47.702832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 695/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:46 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1509 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:47.719331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e568273a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:47.976250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:16:47.977856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 97f2bf48-55a0-4e59-8744-2ef383a8872c not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:16:47.979805 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.979805 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c HTTP/1.1 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '97f2bf48-55a0-4e59-8744-2ef383a8872c'} Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:16:47.983092 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] Aug 30 18:16:47.987996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:47.991638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:16:47.991638 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-0596f657-3e63-4ef3-8a4d-701cdf122afb'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:47.992712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-40c2b012-a119-468b-95b7-a0891884033d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c" status: 404 len: 194 microversion: 2.1 time: 0.287755 Aug 30 18:16:47.993306 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 696/1459] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:16:47 2022] GET /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c => generated 194 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:48.002780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:48.005702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:48.006166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:48.012733 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8b3d675-c0bd-4e9b-b75d-25bf5a2ae251 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 0.367602 Aug 30 18:16:48.026263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:48.026878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:48.027102 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 764/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:47 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:48.027362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:48.032833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a6f7d-848a-4117-a0d6-c364e5635ee7", "name": "network-vif-plugged", "status": "completed", "tag": "4174bc8d-77d1-4335-a74c-0105106ee659"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:48.037969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:48.039255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:48.040592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:48.051035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:48.051520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:48.051953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:48.089731 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] Creating event network-vif-plugged:4174bc8d-77d1-4335-a74c-0105106ee659 for instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 on n-h2-854119-10 Aug 30 18:16:48.106194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f15475d0-8ac2-4c55-8362-f96e2d137c41 req-1b0ddf9a-f041-40c7-b7d0-50bf1e87c3af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072924 Aug 30 18:16:48.108746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 765/1461] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:48.163298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3cfdd85e-76ac-46f0-a792-43ab89d0269f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56cb90d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:48.642236 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3cfdd85e-76ac-46f0-a792-43ab89d0269f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba" status: 202 len: 0 microversion: 2.1 time: 0.528154 Aug 30 18:16:48.643517 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 766/1462] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:16:48 2022] DELETE /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:48.649791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:48.655813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:48.668206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:48.668709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:48.669155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:48.669891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:48.670374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:48.682331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.112429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:49.124027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e865740a-58e3-4907-b7fc-d972ed5d28bb tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.478549 Aug 30 18:16:49.125763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 767/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:48 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:49.132602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffba40d-f706-40ae-835c-42c0842275f9", "tag": "5a2b8087-3114-464f-812a-a67d1b44dd8b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:49.143969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.144897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.145582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.160543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] Creating event network-changed:5a2b8087-3114-464f-812a-a67d1b44dd8b for instance 3ffba40d-f706-40ae-835c-42c0842275f9 on n-h2-854119-10 Aug 30 18:16:49.169089 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1cc72417-43df-4c3d-8a69-6b3588d08453 req-e1581deb-1002-405b-a1a8-42d71b7d0323 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041255 Aug 30 18:16:49.171976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:49.172849 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 768/1464] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:49.185000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56cb9af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:49.195266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:49.200226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:49.201541 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b0caced5-8b9e-4fc6-b068-810402d95145 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 1.207244 Aug 30 18:16:49.206964 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 697/1465] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:47 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:49.224746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:49.226662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:49.259905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.260632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.261468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.262592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.263288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.266626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.274554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:16:49.275898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:16:49.276801 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.276801 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba HTTP/1.1 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba'} Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:16:49.281556 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] Aug 30 18:16:49.289371 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:49.298420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:16:49.298420 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-b2224722-c613-4976-8094-433d03d1a860'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:49.298420 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-989f6643-7549-4f26-92cb-b6b33eefb296 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba" status: 404 len: 194 microversion: 2.1 time: 0.119842 Aug 30 18:16:49.299324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 769/1466] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:16:49 2022] GET /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:49.305828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:49.307653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:49.321380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.326688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.328046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.329985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.332773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.334740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.642016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:49.657695 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-116b071d-ae48-4e64-aff6-44aba253eccd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1467 microversion: 2.1 time: 0.356414 Aug 30 18:16:49.660895 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 770/1467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:49 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:49.666058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:49.671660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:49.682185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.682652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.689950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:49.691022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:49.691948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:49.700999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:50.388520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:50.398971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d5bffbe-7f0a-42ba-9455-86f2c8f0b3e0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1306 microversion: 2.1 time: 0.736702 Aug 30 18:16:50.402456 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 771/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:49 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1306 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:50.413089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24b4483d-5c96-4deb-beae-fdfd81fdebd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e579b2670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:50.579993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:50.594447 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a4cb8f8-64df-4f6f-908f-212937f51b2b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 1.383203 Aug 30 18:16:50.595081 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 698/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:49 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:50.611811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:50.612438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:50.621820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:50.622957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:50.623593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:50.624529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:50.625284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:50.625913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.158089 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24b4483d-5c96-4deb-beae-fdfd81fdebd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90" status: 202 len: 0 microversion: 2.1 time: 0.754307 Aug 30 18:16:51.159318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 772/1470] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:16:50 2022] DELETE /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:51.169369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:51.170406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:51.178259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.180713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.181560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.182679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.183476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.184118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.223575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:51.259239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10d48abc-073c-4528-bca6-ddf53d6ee5f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.657805 Aug 30 18:16:51.263114 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 699/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:50 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:51.269292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:51.271337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:51.280522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.281608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.282449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.284683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.285394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.286073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.353346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.354265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.354986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.355697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lazy-loading 'fault' on Instance uuid e1142b38-f620-44f1-b92d-51c230b1a069 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:51.521395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:51.544846 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc1c5aa5-4839-4e4d-b4d3-5bf4899c81c1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 200 len: 1305 microversion: 2.1 time: 0.279727 Aug 30 18:16:51.550724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 700/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:51 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:51.566997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56a3e040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:51.811282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:16:51.813551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:16:51.814769 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.814769 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 HTTP/1.1 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ce4f6ed1-3727-4a8a-beeb-ce0827f51a90'} Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:16:51.819329 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] Aug 30 18:16:51.828170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:16:51.839066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:16:51.839066 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-73ffb634-9536-4a89-a7bf-80ae0724ff7b'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:51.844039 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe795896-6476-415f-b246-76840dae9eba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90" status: 404 len: 194 microversion: 2.1 time: 0.285244 Aug 30 18:16:51.850454 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 701/1473] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:16:51 2022] GET /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 => generated 194 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:51.869357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1142b38-f620-44f1-b92d-51c230b1a069", "name": "network-vif-deleted", "tag": "aa4af4d4-8675-43a9-90c1-3505e8af7ae9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:51.884684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.885293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.885835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.910510 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] Creating event network-vif-deleted:aa4af4d4-8675-43a9-90c1-3505e8af7ae9 for instance e1142b38-f620-44f1-b92d-51c230b1a069 on n-h2-854119-10 Aug 30 18:16:51.930062 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a08864a8-6e50-44e0-9e2c-7f6cf48efd73 req-3b09125a-bbba-461d-ae92-d662ca6921c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075183 Aug 30 18:16:51.934204 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 702/1474] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:51.951931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:51.956396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:51.974636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.975565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.977591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:51.981804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:51.982561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:51.986003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:52.103494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:52.142776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:52.149405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:52.152976 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cebe64f1-1f59-4343-b3a9-421946940ede tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1811 microversion: 2.25 time: 0.991949 Aug 30 18:16:52.194432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 773/1475] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:51 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1811 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:52.212735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:52.213764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:52.245981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:52.251568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:52.259474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:52.260274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:52.260757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:52.261193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:52.686125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:52.702178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3812d168-61fb-4f0d-8c88-cef22c601d03 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1485 microversion: 2.1 time: 0.762897 Aug 30 18:16:52.703467 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 703/1476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:51 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1485 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:52.712069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a1b900d-c35f-42e5-bbf5-44a57fbcbc17 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e568f69d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:52.749487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:52.766955 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8920d942-6ca0-46bb-95f5-3238c36b49ef tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.565836 Aug 30 18:16:52.808981 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 774/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:52 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:52.835642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af351fca-85d3-49c5-950a-1d4e5ae3649c", "name": "network-vif-plugged", "status": "completed", "tag": "8d562005-8f48-4077-b314-dd6558155bc5"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:52.858853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:52.859731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:52.860874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:52.911231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] Creating event network-vif-plugged:8d562005-8f48-4077-b314-dd6558155bc5 for instance af351fca-85d3-49c5-950a-1d4e5ae3649c on n-h1-854119-10 Aug 30 18:16:52.920710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bafe763c-217a-4e4b-bb65-f454115a76ab req-58b344c7-7e43-4168-b3c8-43ec83c63949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108500 Aug 30 18:16:52.921962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 775/1478] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:52.929907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:52.931296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:52.952844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:52.953634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:52.954230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:52.955145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:52.955762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:52.956374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:53.492835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:53.506239 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37fb02d4-5527-4260-ba08-2ed596fc8bbd tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1328 microversion: 2.1 time: 0.582422 Aug 30 18:16:53.507017 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 776/1479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:52 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:53.536608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:53.537234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:53.567851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:53.572315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:53.573135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:53.573958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:53.574456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:53.586819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:53.620188 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 HTTP/1.1 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'e1142b38-f620-44f1-b92d-51c230b1a069'} Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:16:53.626922 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:16:53.632131 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:16:53.636968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:16:53.643448 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-426a8dcb-8711-4f9e-96c4-8a2928d315be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 404 len: 111 microversion: 2.1 time: 0.116392 Aug 30 18:16:53.644808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 777/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:53 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:16:53.654990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:53.658574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:53.672745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:53.678697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:53.679866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:53.683419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:53.684179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:53.684786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:53.942691 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4b74890-59c1-4576-b92a-8d807756fb5b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.295646 Aug 30 18:16:53.957246 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 778/1481] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:16:53 2022] POST /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:16:53.996274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:53.997478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:54.026768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:54.027267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:54.027704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:54.028431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:54.028878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:54.029298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:54.032912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:54.278200 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a1b900d-c35f-42e5-bbf5-44a57fbcbc17 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.573111 Aug 30 18:16:54.279838 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 704/1482] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:16:52 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:54.389974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:54.409382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:54.411220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:54.424288 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01bb7ab3-10d6-4e37-bad3-efbcdf9a581d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1801 microversion: 2.25 time: 0.458618 Aug 30 18:16:54.432360 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 779/1483] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:53 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1801 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:54.443815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:54.444433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:54.464366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:54.464868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:54.465303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:54.466107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:54.469838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:54.476264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:54.606587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-999194441", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "56a59914-9233-4a1c-aa5e-0984b231d1f4"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:54.666752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] validate_networks() for [('56a59914-9233-4a1c-aa5e-0984b231d1f4', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:54.888749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:54.915065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9237f1b1-6ba6-4882-b906-2dfbd0784703 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.480578 Aug 30 18:16:54.916108 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 780/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:54 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:54.935017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-116577258", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:55.080797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:55.333376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:55.333951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:55.334269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:55.334718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:55.335130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:55.349358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:55.349757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:55.350448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:55.351471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:55.353094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:55.353811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:55.378147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Getting quotas for project e901953a1397458bb09b5aa60350e61d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:55.385641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Getting quotas for user 27e6ade69d0f47be9e3f970652e6dc21 and project e901953a1397458bb09b5aa60350e61d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:55.416819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:55.419910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:55.526889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca9b5964-0e9f-45b7-ab68-2e1fd712d196 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244922 Aug 30 18:16:55.535631 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 705/1485] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:55.535631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:55.535631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:55.546322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:55.547058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:55.547810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:55.548814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:55.549676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:55.550325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:55.593638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:16:55.940807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:55.975132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3dde52d2-63ba-4668-896c-08c7b72b9558 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 200 len: 1470 microversion: 2.1 time: 0.443094 Aug 30 18:16:55.975828 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 706/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:55 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:55.991736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76340a8f-1f57-42e3-be45-7528eeff349e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56c3b820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479454166", "description": "tempest-description-2043201127"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:56.275709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:56.276531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:56.276975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:56.277873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:56.278279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:56.300248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.306211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.308249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.314659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.318358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.319083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.353301 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76340a8f-1f57-42e3-be45-7528eeff349e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.375938 Aug 30 18:16:56.363517 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 707/1487] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:56.390721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15437477-dc17-4bee-b646-afb0ebacf980 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '.version_select at 0x7f4e56c05670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:56.399824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15437477-dc17-4bee-b646-afb0ebacf980 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.401153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:56.402750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15437477-dc17-4bee-b646-afb0ebacf980 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.403475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15437477-dc17-4bee-b646-afb0ebacf980 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.418333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:56.426028 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15437477-dc17-4bee-b646-afb0ebacf980 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.060287 Aug 30 18:16:56.441774 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 708/1488] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Aug 30 18:16:56 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:56.456624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:56.457257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:56.467354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:56.472663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:56.475132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.475636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.476181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.477119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.477673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.483487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.564303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87d386f4-89a4-4436-a525-ad3a88fea7fc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639915 Aug 30 18:16:56.566966 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 781/1489] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:16:56.574083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:56.586833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:56.599022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.599598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.600045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.600825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.601288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.601952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.678017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:56.689108 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-530ee9a9-09fa-4f1f-8ed2-d1ff3977bab1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1219 microversion: 2.1 time: 0.120415 Aug 30 18:16:56.690063 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 782/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:56 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:56.791748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:56.802706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-672587966", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6b012c1c-97a5-417f-b33c-b3d5bda03d09"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:56.809384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d293db72-9560-444f-93e3-f8535893b267 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1509 microversion: 2.1 time: 0.365644 Aug 30 18:16:56.811430 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 709/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:56 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:56.820376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:56.821200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:56.848255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.848771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.849226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.849962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:56.850459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:56.850891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:56.897431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] validate_networks() for [('6b012c1c-97a5-417f-b33c-b3d5bda03d09', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:16:57.284761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:57.320947 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2aa000aa-bd0f-4750-b951-7ae0443b065b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.493725 Aug 30 18:16:57.323303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 710/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:56 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:57.338515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-25950944"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:57.342194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:57.353744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:57.356246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:57.357273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:57.358842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:57.359931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:57.360905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:57.589280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:16:57.589789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:16:57.590397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:16:57.590918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:16:57.591411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:16:57.614935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:57.617304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:57.618028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:57.620353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:57.620865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:57.623956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:57.648334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Getting quotas for project c742cd7a84444398abdc3542be92b485. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:16:57.654488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Getting quotas for user c181727b8c23427492887eebfd101ec5 and project c742cd7a84444398abdc3542be92b485. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:16:57.671569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:16:57.675004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:16:57.773621 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73d307d6-ce6f-4961-bbff-2227a3d87782 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.080708 Aug 30 18:16:57.777161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 783/1493] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:16:57.788450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebf47c22-d7f9-41af-ae63-8f6fc6b9a9e8 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e577d3550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94911890", "description": "tempest-description-1946308267"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:58.023702 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7df9eb48-f77f-41bc-8e60-eb1e27283b96 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.697995 Aug 30 18:16:58.031179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 711/1494] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:16:57 2022] POST /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:16:58.038087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:58.039379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:58.048548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.049391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.050056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.051841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.052620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.053224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.245336 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebf47c22-d7f9-41af-ae63-8f6fc6b9a9e8 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.466596 Aug 30 18:16:58.250704 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 784/1495] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:16:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:58.267835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:58.268917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:58.305528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.306309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.314779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.315735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.316253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.316712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.540647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:58.572520 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-166841cf-3d48-4c03-bded-7d986625bf1d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1266 microversion: 2.1 time: 0.320249 Aug 30 18:16:58.578416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 785/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:58 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:58.628786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:16:58.652921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:58.656635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:58.685139 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de60c208-d498-4070-b176-da2f811dceb5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 2422 microversion: 2.25 time: 0.652159 Aug 30 18:16:58.685528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.686175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.693238 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 712/1497] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:58 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 2422 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:58.694109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.695887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.709875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:58.712627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.713304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:58.714615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.749442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.749920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.750388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.751176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:58.751638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:58.760818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:58.920973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:58.934745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46039a8c-ea87-4fb1-8924-95dbdd40d9b2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1273 microversion: 2.1 time: 0.240192 Aug 30 18:16:58.935678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 713/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:58 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:58.957628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:58.972267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:59.186478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:59.201716 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7abf8e28-ab2c-4423-bc0a-06a0dcd7b1d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1509 microversion: 2.1 time: 0.597731 Aug 30 18:16:59.215185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 786/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:58 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1509 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:59.234785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffba40d-f706-40ae-835c-42c0842275f9", "name": "network-vif-plugged", "status": "completed", "tag": "5a2b8087-3114-464f-812a-a67d1b44dd8b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:59.264673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:59.265212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:59.265832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:59.289325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] Creating event network-vif-plugged:5a2b8087-3114-464f-812a-a67d1b44dd8b for instance 3ffba40d-f706-40ae-835c-42c0842275f9 on n-h2-854119-10 Aug 30 18:16:59.305936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:59.310176 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d56a8baf-18a2-4ba2-93ac-8613e86d44f6 req-65bed97b-5dc4-44da-a04d-9ba552684b3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091075 Aug 30 18:16:59.312459 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 787/1500] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:16:59.324328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-94209e70-b7dd-4703-8e16-44a64d3eaee3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e574a9d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:59.338830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:59.357748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:16:59.374165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30c9d3a6-1f40-4f12-abc4-304a4f19af60 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1258 microversion: 2.21 time: 0.436681 Aug 30 18:16:59.376332 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 714/1501] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:16:58 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1258 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:16:59.396513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:16:59.396824 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-94209e70-b7dd-4703-8e16-44a64d3eaee3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.081733 Aug 30 18:16:59.397498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 788/1502] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:16:59 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:16:59.409146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-892636875", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "e9157186-1949-48da-b32c-e57cbda6866e"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:16:59.410643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:16:59.443552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:59.444438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:59.446214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:59.447652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:16:59.448457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:16:59.449160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:16:59.513269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] validate_networks() for [('e9157186-1949-48da-b32c-e57cbda6866e', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:00.227878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:00.245869 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1911f19a-2280-4056-9f08-825debce154b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1311 microversion: 2.1 time: 0.862500 Aug 30 18:17:00.247070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 715/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:16:59 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1311 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:00.253928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:00.255135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:00.263347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:00.264282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:00.266275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:00.267523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:00.268251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:00.268939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:01.341724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:01.376376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff1e52de-3b2d-4ae0-9a9e-86118c02e4ea tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 2422 microversion: 2.25 time: 1.127820 Aug 30 18:17:01.383965 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 716/1504] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:00 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 2422 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:01.395974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:01.397786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:01.416972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:01.417482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:01.417933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:01.418736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:01.419214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:01.419651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:01.529827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:01.774857 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cea5bcb6-865f-456b-a0fd-b6934cc37da9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 204 len: 0 microversion: 2.1 time: 0.388548 Aug 30 18:17:01.789603 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 717/1505] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:01 2022] DELETE /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:01.831645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:01.832514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:01.856595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:01.857103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:01.857686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:01.867400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:01.868414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:01.869324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.068309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:02.068797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:02.069343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:02.069596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:02.070050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:02.092229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.092705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.093145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.094446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.094827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.095265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.169992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Getting quotas for project e4cf937841ce453fbbe4b18024234426. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:02.187860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Getting quotas for user b4e6813fec5f4f4fb4e7a31d2ace5d64 and project e4cf937841ce453fbbe4b18024234426. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:02.226139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:02.228246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:02.232077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:02.413520 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ff5503c-1dd6-485f-bc48-3406ef62fb42 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008590 Aug 30 18:17:02.418044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 789/1506] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:02.429412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:02.438725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:02.465430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.467734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.470901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.471988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.473721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.474797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.697326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:02.718795 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a17df32-2f1f-4b9c-9675-1d0580bb07fb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.921945 Aug 30 18:17:02.750810 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 718/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:01 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:02.788395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:02.793953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:02.820065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.824810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.829908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:02.831303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:02.832029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:02.836650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:03.070137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:03.089996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:03.092733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:03.095722 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13ebe87f-5ff0-4e85-88df-c2313c3db90a tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1316 microversion: 2.21 time: 0.343290 Aug 30 18:17:03.097027 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 719/1508] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:02 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:03.124674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b32b41c7-dcec-4023-b50a-8eefbc527d6b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56c058b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:03.250254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b32b41c7-dcec-4023-b50a-8eefbc527d6b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.151725 Aug 30 18:17:03.255020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 720/1509] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:03 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:03.273190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:03.274146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:03.295204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:03.297566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:03.299196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:03.303009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:03.305336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:03.308331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.087676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:04.105839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e41a1d6-2875-4952-ab2e-c738a1d1941b tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 1.685601 Aug 30 18:17:04.107695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 790/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:02 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:04.118963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:04.130601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:04.164379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.166623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.167499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.168496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.169197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.169819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.448653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lazy-loading 'services' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:04.674808 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf38ebfe-d43e-443f-9f40-6cce2cf19235 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments/3639db4c-23db-4e9f-a5ec-5fb209ca49db" status: 202 len: 0 microversion: 2.25 time: 0.565461 Aug 30 18:17:04.675969 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 791/1511] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Aug 30 18:17:04 2022] DELETE /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments/3639db4c-23db-4e9f-a5ec-5fb209ca49db => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:04.697615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:04.700562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:04.721935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.722870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.726988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.728043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.732269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.733026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.876506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:04.898720 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c75b0959-7fc7-4539-b4a1-cab56b18768b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1493 microversion: 2.1 time: 1.642297 Aug 30 18:17:04.906579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 721/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:03 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1493 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:04.920814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:04.924240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:04.949676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.950830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.951617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:04.952951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:04.961634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:04.962700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:05.224750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:05.235622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:05.246838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f996a1c2-943c-4930-b18d-1d28803d90a7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1267 microversion: 2.1 time: 0.333322 Aug 30 18:17:05.258372 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 722/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:04 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1267 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:05.258372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:05.258372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:05.280033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:05.280695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:05.283046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:05.284678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:05.285416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:05.286297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:05.368293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:05.599844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:05.631818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-621fdeda-501d-4bc4-85c6-93fe69b84597 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1515 microversion: 2.1 time: 0.953796 Aug 30 18:17:05.636016 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 792/1514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:04 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1515 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:05.659398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:05.662232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:05.682142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:05.684327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:05.687589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:05.688901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:05.691524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:05.693533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.113462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:06.141924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:06.150675 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e9abfeac-d5c8-41c4-9b48-902374dd216b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.901007 Aug 30 18:17:06.153903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 723/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:05 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:06.164675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:06.172874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:06.176752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc46d16d-6160-4b89-bfbc-4bd6159f6702 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56998820>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:06.178016 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e9598f7-cf58-4389-956a-d692e52808be tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1316 microversion: 2.21 time: 0.540330 Aug 30 18:17:06.179891 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 793/1516] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:05 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:06.192154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:06.199152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:06.220170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.220874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.221497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.222428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.223372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.224036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.342649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc46d16d-6160-4b89-bfbc-4bd6159f6702 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.184068 Aug 30 18:17:06.353955 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 724/1517] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:06 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:06.372681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd03713e-44fd-497a-9cac-877b40926247", "tag": "868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:06.383344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17df5087-646b-4be3-b19c-3329a0c9793e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.200820 Aug 30 18:17:06.384390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 794/1518] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:17:06 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:17:06.441884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.444846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.447113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.490616 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] Creating event network-changed:868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd for instance dd03713e-44fd-497a-9cac-877b40926247 on n-h2-854119-10 Aug 30 18:17:06.512733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6a75a87e-88b1-4654-b8c3-00db9be9931e req-622ee74c-eb8b-4223-919d-7b39c0f2ec89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156153 Aug 30 18:17:06.521959 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 725/1519] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:06.546124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:06.550478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:06.585900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.587129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.588085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.592499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.594384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.596187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.837682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:06.840254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:06.870009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.870877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.872293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:06.873300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:06.873962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:06.874645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.388952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:07.410224 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a60484bd-4f05-4dae-bd16-78166d6316cb tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 0.884092 Aug 30 18:17:07.422384 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 726/1520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:06 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:07.426980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a6f7d-848a-4117-a0d6-c364e5635ee7", "name": "network-vif-plugged", "status": "completed", "tag": "4174bc8d-77d1-4335-a74c-0105106ee659"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:07.480430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.480950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.481401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.532688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] Creating event network-vif-plugged:4174bc8d-77d1-4335-a74c-0105106ee659 for instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 on n-h2-854119-10 Aug 30 18:17:07.547166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c0e59b1e-b42c-42d6-9831-1e08f83eec46 req-257006fe-548f-4b37-b931-9cb7645504fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133268 Aug 30 18:17:07.548274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 727/1521] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:07.560489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:07.564275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:07.579282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.579786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.580231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.580959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.581415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.581843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.867021 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8622a43-35d1-487c-b690-469328038985 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1646 microversion: 2.1 time: 1.479757 Aug 30 18:17:07.868919 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 795/1522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:06 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1646 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:07.882405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:07.883748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:07.904996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.905867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.907670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.909151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.911197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.913724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.961659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:07.962836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:07.963547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:07.964486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lazy-loading 'fault' on Instance uuid af351fca-85d3-49c5-950a-1d4e5ae3649c {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:08.221436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:08.237903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17f9e551-a524-4006-a900-5cfa96ee7451 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 200 len: 1318 microversion: 2.1 time: 0.367038 Aug 30 18:17:08.267430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 796/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:07 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:08.285511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af351fca-85d3-49c5-950a-1d4e5ae3649c", "name": "network-vif-deleted", "tag": "8d562005-8f48-4077-b314-dd6558155bc5"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:08.321806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:08.341335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:08.342183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d07abb2-4aa4-4cd7-a4cd-4919d0117137 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1315 microversion: 2.1 time: 0.787415 Aug 30 18:17:08.343897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:08.345257 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 728/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:07 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:08.346055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:08.364605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:08.372220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:08.388932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:08.389440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:08.390333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:08.391125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:08.398718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] Creating event network-vif-deleted:8d562005-8f48-4077-b314-dd6558155bc5 for instance af351fca-85d3-49c5-950a-1d4e5ae3649c on n-h1-854119-10 Aug 30 18:17:08.406218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:08.408372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:08.413877 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-67f54860-d400-4caf-8131-6538ca7cefea req-1119168a-ec0a-4cb5-94fa-4310f10ad232 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144753 Aug 30 18:17:08.419391 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 797/1525] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:08.450489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:08.451819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:08.483357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:08.484640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:08.485682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:08.490320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:08.492618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:08.494633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.052835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:09.054974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:09.071418 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-401bbcb2-9aca-480a-b7ba-a399ed84574b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.723908 Aug 30 18:17:09.072377 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 729/1526] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:08 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:09.087954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55b9a825-5374-4541-bf25-1e2ef81913b4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56f4bdc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.088281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:09.091467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:09.093621 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9931ffd6-b8b3-40b9-83fc-d0427a13f818 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 0.672673 Aug 30 18:17:09.113299 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 798/1527] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:08 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:09.148586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.157238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:09.186795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.188058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.189712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.195918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.197977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.200250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.233860 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55b9a825-5374-4541-bf25-1e2ef81913b4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.160005 Aug 30 18:17:09.247183 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 730/1528] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:09.274660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.275375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:09.298947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.299528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.300338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.300752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.301229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.303869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.321415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4127bfa9-02c3-42f7-8648-1689d13755cb tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.203028 Aug 30 18:17:09.332900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 799/1529] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:17:09.340421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:09.372920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.374239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:09.402894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.403747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.404528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.410925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.411799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.412580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.443102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:09.741138 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-461eeae6-e407-433c-8d49-152b9505fc51 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1646 microversion: 2.1 time: 0.488588 Aug 30 18:17:09.742150 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 731/1530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1646 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:09.762072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.763055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:09.771441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.771842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.778464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.779775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.781766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.782612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.822307 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c HTTP/1.1 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'af351fca-85d3-49c5-950a-1d4e5ae3649c'} Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:09.824082 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:17:09.829033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:09.842651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:09.844143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-734e4cb1-a75f-4789-bdc5-b87ead7fa001 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 404 len: 111 microversion: 2.1 time: 0.100221 Aug 30 18:17:09.846716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 732/1531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:09.862155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:09.863996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:09.885025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.888816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.889694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:09.893748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:09.894587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:09.895537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.184729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:10.197513 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e21c79c-285e-465c-8b81-921bc44232a2 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 0.862659 Aug 30 18:17:10.207710 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 800/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:10.214156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:10.226686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.229872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.230717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.233953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.236299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.241469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.345995 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09b0ee2f-51ae-4a9a-b855-17d6b8466e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.134840 Aug 30 18:17:10.360111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 801/1533] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:17:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:10.371440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b35bd3dd-8289-4d5d-92c9-426be3ad8781 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '.version_select at 0x7f4e56b54310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:10.490251 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b35bd3dd-8289-4d5d-92c9-426be3ad8781 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1550685588" status: 202 len: 0 microversion: 2.1 time: 0.125753 Aug 30 18:17:10.494004 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 802/1534] 10.222.0.25 () {58 vars in 1209 bytes} [Tue Aug 30 18:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1550685588 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:10.524534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:10.525709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:10.538445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:10.558553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e3f77ba-6a6e-48f7-8f22-fa04782e60bd tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1315 microversion: 2.1 time: 0.704217 Aug 30 18:17:10.569433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.577644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 733/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:09 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:10.580254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.583227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.592243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:10.594261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:10.601668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.603470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.615814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.627979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.633935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.636892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:10.643743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:10.646652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:10.647308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:11.314701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:11.341293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-156c438e-f090-42c1-827d-5c5233c61fbc tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.836421 Aug 30 18:17:11.367196 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 803/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:10 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:11.386203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1babd92-8d61-463f-a798-f53d31216ad7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56ebd310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:11.494017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1babd92-8d61-463f-a798-f53d31216ad7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.120732 Aug 30 18:17:11.510561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 804/1537] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:11 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:11.522739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:11.528001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:11.546505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:11.548276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:11.549515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:11.556858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:11.558762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:11.560226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:11.661169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6333771-66ef-4d0d-9a0a-d57d03b71e92 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147726 Aug 30 18:17:11.663356 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 805/1538] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:17:11 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:17:11.675436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": true, "disk_over_commit": false}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:11.685668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:11.702050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:11.703540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:11.704589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:11.709419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:11.711849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:11.714286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:11.792672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lazy-loading 'flavor' on Instance uuid 3ffba40d-f706-40ae-835c-42c0842275f9 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:11.827992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122589) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:17:12.057834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:12.116238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:12.128760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:12.151621 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b68464e-e987-4544-b522-9e19e7af28d5 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 1.558432 Aug 30 18:17:12.155118 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 734/1539] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:10 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:12.165124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2491dfa-368d-43c5-9538-8d99cfc49eb7", "tag": "4a16b486-bffa-4838-90a3-420746608fab"}, {"name": "network-changed", "server_uuid": "198434e9-123c-4444-b942-948fb36ad15d", "tag": "71ab8a86-65fe-4185-9255-d068b966d2b9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:12.185260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:12.196725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:12.200309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:12.201568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:12.219768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:12.277664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Creating event network-changed:4a16b486-bffa-4838-90a3-420746608fab for instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 on n-h2-854119-10 Aug 30 18:17:12.284292 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] Creating event network-changed:71ab8a86-65fe-4185-9255-d068b966d2b9 for instance 198434e9-123c-4444-b942-948fb36ad15d on n-h1-854119-10 Aug 30 18:17:12.343879 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0d37bce7-c093-4566-990e-9f4561317cf9 req-da151a1a-6cc3-46fb-b414-6428abc14ba8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.183881 Aug 30 18:17:12.347423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 735/1540] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:12.399650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-903815397", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:12.675380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:14.027253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:14.028358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:14.028358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:14.028996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:14.033748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:14.049065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.049593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.050024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.050835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.051531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.052869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.079624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:14.095615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:14.113935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:14.117033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:14.218142 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1fec4ec8-aaae-4228-860d-271af9adb2e3 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.866503 Aug 30 18:17:14.219279 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 736/1541] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:14.230909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8c8f82-9615-4b35-ad45-569d3eff2b07", "tag": "c0a86335-e5f4-4949-847b-e3d88da8050b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:14.252078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.252761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.253167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.283544 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] Creating event network-changed:c0a86335-e5f4-4949-847b-e3d88da8050b for instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 on n-h1-854119-10 Aug 30 18:17:14.293231 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f27ba6db-820e-4ddc-ab20-b20b34d0409d req-f399f5ad-55e8-4d3c-b7cb-826278442ee0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071997 Aug 30 18:17:14.294243 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 737/1542] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:14.310790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:14.312979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:14.324907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.327052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.327719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.328672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.329320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.329925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.811121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:14.842531 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fd0a758-96d1-4573-ab0c-1f2cbaf11587 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 0.545545 Aug 30 18:17:14.857981 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 738/1543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:14 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:14.883638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:14.886128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:14.910465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.912721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.913796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:14.916738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:14.917441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:14.919174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.635157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:15.664695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18b558da-4304-4560-b8a9-31826d59dcd4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1315 microversion: 2.1 time: 0.801868 Aug 30 18:17:15.668853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 739/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:14 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:15.684367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:15.685335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:15.704949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.709420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.711223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:15.716454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:15.717279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:15.717917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.070615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:16.080934 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd4d77ab-a3e7-4605-b449-516ccdb9137e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.405825 Aug 30 18:17:16.086514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 740/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:15 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:16.100372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82b1f513-4617-4350-aea0-2b658ba65ede tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56bdee50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:16.183681 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82b1f513-4617-4350-aea0-2b658ba65ede tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.095458 Aug 30 18:17:16.184761 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 741/1546] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:16 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:16.192138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:16.196030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:16.204639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.205550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.206632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.207640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.208285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.208881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.277528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-11834e1e-f8fc-4a5e-9d9c-95dea1edcc35 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.091111 Aug 30 18:17:16.279545 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 742/1547] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:17:16 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:16.302431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd03713e-44fd-497a-9cac-877b40926247", "name": "network-vif-plugged", "status": "completed", "tag": "868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:16.332198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.333726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.335046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.365063 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] Creating event network-vif-plugged:868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd for instance dd03713e-44fd-497a-9cac-877b40926247 on n-h2-854119-10 Aug 30 18:17:16.376118 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-71225e0a-c3ff-4675-a2b9-f4fb117da624 req-569fe37c-4881-4ad9-9047-2eb1e61ef60a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093374 Aug 30 18:17:16.378391 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 743/1548] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:16.421660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:16.435017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:16.452607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.453104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.453796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.454600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:16.455077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:16.456083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:16.852304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:16.886827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:16.901199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:16.929990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e478c11e-19f2-4dd4-ace8-f6e0f29c3a14 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 0.545313 Aug 30 18:17:16.937567 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 744/1549] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:16 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:16.968680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:16.969544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:17.045874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.047622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.048550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.056066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.057384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.058297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.273741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:17.309245 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64d0da0b-7222-4d5b-867e-5a11c6eb0882 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1268 microversion: 2.1 time: 0.369643 Aug 30 18:17:17.315196 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 745/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:16 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1268 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:17.328718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.331878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:17.345942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.346859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.349365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.351834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.359212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.359949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.405946 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2d7f315-745d-43aa-88f3-de208269a8c1 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9/action" status: 202 len: 0 microversion: 2.1 time: 5.738756 Aug 30 18:17:17.410758 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 806/1551] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:17:11 2022] POST /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9/action => generated 0 bytes in 5745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:17.419204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.420943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:17.431480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.432205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.433067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.434112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.434894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.435588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.647607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:17.660175 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bca06b41-0025-4728-96b1-6b9700a827c6 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 0.342466 Aug 30 18:17:17.661342 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 746/1552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:17.682985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.684932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:17.704180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.712799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.713588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.718326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.719202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.719893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.802631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:17.815030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:17.820708 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1be7fdbd-94eb-4d69-9ade-13d2bb9a253e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1315 microversion: 2.1 time: 0.408559 Aug 30 18:17:17.832354 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 807/1553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:17.845799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88d170d2-bf78-460c-8466-7c52e0b6f92f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56b71af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.923424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-88d170d2-bf78-460c-8466-7c52e0b6f92f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1410 microversion: 2.1 time: 0.088816 Aug 30 18:17:17.924058 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 808/1554] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:17.949395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:17.950631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:17.974527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.975557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.979371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:17.980527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:17.981220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:17.984073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.047894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.059470 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dbb49673-d5a7-4fac-8030-d615f3664f29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1314 microversion: 2.1 time: 0.396694 Aug 30 18:17:18.061464 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 747/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:18.066826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:18.067826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:18.074754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.075534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.076162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.077084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.077880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.078531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.422648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.436711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.439564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.441241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8702370b-d0ea-4983-91ff-d71e63d69526 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 0.378470 Aug 30 18:17:18.442676 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 748/1556] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:18 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:18.454131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:18.455167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:18.463401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.464313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.465043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.466016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.466752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.467552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.811932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.837563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:18.846185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d5d49d9-f0c9-42e7-ac66-b56cad896998 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.397671 Aug 30 18:17:18.853205 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 749/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:18 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:18.864362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-446f7da0-54de-4787-9ce9-311eb7a0a8dc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.919111 Aug 30 18:17:18.867514 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 809/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:17 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:18.873240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8c8f82-9615-4b35-ad45-569d3eff2b07", "name": "network-vif-plugged", "status": "completed", "tag": "c0a86335-e5f4-4949-847b-e3d88da8050b"}, {"server_uuid": "b2491dfa-368d-43c5-9538-8d99cfc49eb7", "name": "network-vif-plugged", "status": "completed", "tag": "4a16b486-bffa-4838-90a3-420746608fab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:18.888374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:18.891259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:18.905592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.906331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.906962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.917180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.920484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.927367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.937487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:18.939061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:18.941032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:18.968619 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Creating event network-vif-plugged:c0a86335-e5f4-4949-847b-e3d88da8050b for instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 on n-h1-854119-10 Aug 30 18:17:18.984508 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] Creating event network-vif-plugged:4a16b486-bffa-4838-90a3-420746608fab for instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 on n-h2-854119-10 Aug 30 18:17:19.008193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5157908a-f664-40ed-94df-49a10d6bcb53 req-a4989c95-db0d-41e6-bc49-2cb6716e766e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.152925 Aug 30 18:17:19.009483 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 750/1559] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:19.019964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:19.023404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:19.040375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.041192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.043337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:19.044363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.049548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.050774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:19.488755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:19.502878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:19.506336 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d854b6a7-4d30-488e-bf8a-6a981bf79bc1 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1315 microversion: 2.1 time: 0.632513 Aug 30 18:17:19.526622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91fafb4c-bdb0-4e90-8e24-5e9b72c19f8f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1315 microversion: 2.1 time: 0.515000 Aug 30 18:17:19.534621 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 810/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:18 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:19.555412 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 751/1561] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:19 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:19.557206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b85d9c8b-35d5-4112-9f86-748cfcf4fc35 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56e959d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:19.595816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:19.597015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:19.634306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.635237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.635974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:19.637270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:19.638083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:19.660911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.208356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:20.221357 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-808bf0f2-57d8-48af-a19c-6eaf7c3313b9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1502 microversion: 2.1 time: 0.664299 Aug 30 18:17:20.239172 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 752/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:19 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1502 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:20.245618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:20.246834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:20.276058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.277102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.277730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.278780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.279255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:20.280622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.281321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.703458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:20.724466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:20.732008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:20.739321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a48e870a-57fa-4e23-a094-489955545762 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 0.494920 Aug 30 18:17:20.742481 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 753/1563] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:20 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:20.755648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:20.758567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:20.781585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.782809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.786001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:20.787199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:20.790607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:20.791480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.040594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:21.053169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17f7307c-1003-439a-af94-e3367fafa149 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.308626 Aug 30 18:17:21.055250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 754/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:20 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:21.064876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:21.066567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:21.080337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.082050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.083220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.087033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.088428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.089595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.550129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:21.567367 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a108a0b-a864-412f-878c-78af7ea261fc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.510406 Aug 30 18:17:21.568652 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 755/1565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:21 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:21.614030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:21.614831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:21.639079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.640606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.641832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:21.643915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:21.645610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:21.646925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.087782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.103024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2608b055-2a86-4329-8a3c-4e990ad22652 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1502 microversion: 2.1 time: 0.531178 Aug 30 18:17:22.103636 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 756/1566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:21 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1502 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:22.128593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:22.129123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:22.153387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.153892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.154332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.156095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.156558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.159240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.467435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.486745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84a18279-03bd-4846-ba0a-fabfcd88d229 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1503 microversion: 2.1 time: 0.364384 Aug 30 18:17:22.487961 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 757/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:22 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:22.497506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198434e9-123c-4444-b942-948fb36ad15d", "name": "network-vif-plugged", "status": "completed", "tag": "71ab8a86-65fe-4185-9255-d068b966d2b9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:22.530123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.530658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.531100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.559958 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] Creating event network-vif-plugged:71ab8a86-65fe-4185-9255-d068b966d2b9 for instance 198434e9-123c-4444-b942-948fb36ad15d on n-h1-854119-10 Aug 30 18:17:22.565893 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-11b335c6-ff4f-49b4-b303-44fc1f1da092 req-268df2e9-4f2b-40da-9454-e75b2afd0c1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076635 Aug 30 18:17:22.566473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 758/1568] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:22.574451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5ff321-27d6-415c-847d-c1e590ac57f8", "tag": "b5e5abb9-295d-4a42-a649-2978a4ed8c7d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:22.590884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.591390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.591845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.637578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] Creating event network-changed:b5e5abb9-295d-4a42-a649-2978a4ed8c7d for instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 on n-h2-854119-10 Aug 30 18:17:22.655546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e63399da-b4d1-4218-8828-8e9c9d66956b req-e860dfb5-872a-45ea-acd3-9b3266775dc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087098 Aug 30 18:17:22.656306 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 759/1569] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:22.666440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:22.666662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:22.697027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.697522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.697976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.699898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.699898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.699898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.963640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.974187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.975714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:22.977549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1160f4d8-4d02-4a44-ac09-95042a7fd632 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1358 microversion: 2.21 time: 0.319974 Aug 30 18:17:22.978530 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 760/1570] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:22 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:22.983528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:22.984419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:22.991161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.992040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.993013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:22.993970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:22.994472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:22.994913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.213274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:23.226499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60ee20b3-827c-4ca4-9dae-43c4066b95fc tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.244000 Aug 30 18:17:23.226499 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 761/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:22 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:23.230869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:23.231795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:23.238913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.239669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.240173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.241137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.242173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.242931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.278229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:23.439626 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-343f4459-a51c-424c-a156-e777a690aa0e tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 204 len: 0 microversion: 2.1 time: 0.213518 Aug 30 18:17:23.446725 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 762/1572] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:23 2022] DELETE /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:23.454615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479454166"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:23.455200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:23.467685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.470591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.472007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.473890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:23.474813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:23.475558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:23.755594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.network.security_group_api [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Adding security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad to port c0a86335-e5f4-4949-847b-e3d88da8050b Aug 30 18:17:24.066587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:24.107077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:24.575923 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5280da19-64d7-4d22-955b-532ddc23d802 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action" status: 202 len: 0 microversion: 2.1 time: 1.127379 Aug 30 18:17:24.577559 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 763/1573] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:17:23 2022] POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:24.585104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:24.586290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:24.611056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:24.617123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:24.618000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:24.619043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:24.619774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:24.620459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:24.696940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:24.911313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:24.935925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1426be58-2a55-4a0b-8035-743a46861c46 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.344195 Aug 30 18:17:24.938225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 764/1574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:24 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:24.951914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34f759a9-acd6-4606-bcda-44504779422c"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:24.975657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:24.997297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:24.998912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:25.004572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:25.014431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:25.017015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:25.018437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:26.618749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c3513579-fc5f-4e5f-91ff-6b85b8d776da tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.651112 Aug 30 18:17:26.625210 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 765/1575] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:17:24 2022] POST /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247/os-volume_attachments => generated 194 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:26.655093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:26.665629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:26.685632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:26.686533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:26.692252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:26.693539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:26.697382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:26.698597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:27.359838 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b85d9c8b-35d5-4112-9f86-748cfcf4fc35 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1419 microversion: 2.1 time: 7.822503 Aug 30 18:17:27.362878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 811/1576] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:19 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1419 bytes in 7827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:27.373701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:27.374311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:27.392580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.403145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:27.404068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:27.404735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:27.406113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:27.408273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:27.409377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:27.430653 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2be17be8-3631-41b1-b475-790e6e5065d8 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1508 microversion: 2.1 time: 0.777562 Aug 30 18:17:27.437261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 766/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:26 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1508 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:27.459558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:27.462820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:27.489234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:27.490018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:27.491514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:27.492705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:27.493623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:27.500767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:27.680242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.700102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.701910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.703315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-412d9bbe-2eee-41ec-9ab5-d20bdebe4533 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1552 microversion: 2.21 time: 0.339381 Aug 30 18:17:27.703964 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 812/1578] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:27 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1552 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:27.714633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56bb6310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:27.857844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:27.923689 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5fc08c9-1265-4824-ae5f-cd64ddeadb97 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.484496 Aug 30 18:17:27.924346 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 767/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:27 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:27.948832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8c8f82-9615-4b35-ad45-569d3eff2b07", "tag": "c0a86335-e5f4-4949-847b-e3d88da8050b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:28.016780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.019148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.020607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.036100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use.", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:28.036802 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.036802 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad HTTP/1.1 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: exception: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5e6ca4ae-b27b-4568-9cf1-f84fc7057dad'} Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:28.039119 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 400 to user: Security Group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad in use. Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-a0725e2d-16ed-4bd2-922d-5d165f9160d8'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:28.045547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-16eb625c-6a17-4c7a-9da5-fcd2cfa56a39 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad" status: 400 len: 185 microversion: 2.1 time: 0.335124 Aug 30 18:17:28.049053 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] Creating event network-changed:c0a86335-e5f4-4949-847b-e3d88da8050b for instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 on n-h1-854119-10 Aug 30 18:17:28.049171 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 813/1580] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:27 2022] DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad => generated 185 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:17:28.050769 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7915f372-9796-4a7d-b45d-941b3713a280 req-0f25dab3-3e56-453c-885b-a33ac0d6c32b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117057 Aug 30 18:17:28.051089 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 768/1581] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:28.055601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffba40d-f706-40ae-835c-42c0842275f9", "name": "network-vif-unplugged", "status": "completed", "tag": "5a2b8087-3114-464f-812a-a67d1b44dd8b"}, {"name": "network-changed", "server_uuid": "3ffba40d-f706-40ae-835c-42c0842275f9", "tag": "5a2b8087-3114-464f-812a-a67d1b44dd8b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:28.079616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.080378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:28.100319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.100820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.101497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.110257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.118699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.119333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.119793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.121899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.122399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.185915 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Creating event network-vif-unplugged:5a2b8087-3114-464f-812a-a67d1b44dd8b for instance 3ffba40d-f706-40ae-835c-42c0842275f9 on n-h2-854119-10 Aug 30 18:17:28.187370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] Creating event network-changed:5a2b8087-3114-464f-812a-a67d1b44dd8b for instance 3ffba40d-f706-40ae-835c-42c0842275f9 on n-h2-854119-10 Aug 30 18:17:28.210497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ce6cc094-9c78-4806-a1f2-07dfb4727b72 req-f4aee827-7ff0-4d23-aab2-8bd0c808664e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.162703 Aug 30 18:17:28.216457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 814/1582] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:28.240648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7686893a-eb5e-48f3-b493-96db1ff0c122 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56bb6310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.348181 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7686893a-eb5e-48f3-b493-96db1ff0c122 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 200 len: 1419 microversion: 2.1 time: 0.130269 Aug 30 18:17:28.358247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 815/1583] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:28 2022] GET /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 1419 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:28.363177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.364011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:28.392321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.392321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.394457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.403075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.404032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.406189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.557187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:28.710463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:28.722372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd79f421-fd31-4b02-9ff8-2853fd9ceb66 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.669973 Aug 30 18:17:28.724928 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 769/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:28 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:28.748760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:28.774500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:28.796318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.796883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.797524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.798506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:28.799145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:28.799750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:28.909686 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa8c513a-577d-452e-8ad1-38978b9a11e4 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 204 len: 0 microversion: 2.21 time: 0.555607 Aug 30 18:17:28.913846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 816/1585] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:17:28 2022] DELETE /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:17:28.935814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb19c6f1-be17-4729-962b-64c8bb6f088a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56b78dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.968015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c6dd7e0-debc-43a5-9c1b-b7e3361685ed tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action" status: 202 len: 0 microversion: 2.1 time: 0.235821 Aug 30 18:17:28.973684 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 770/1586] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:17:28 2022] POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:28.996132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:28.997527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:29.008411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.009247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.010917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.012022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.012689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.013351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.083448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.087391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.089663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.092090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lazy-loading 'fault' on Instance uuid b2491dfa-368d-43c5-9538-8d99cfc49eb7 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:29.204678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27e6ade69d0f47be9e3f970652e6dc21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901953a1397458bb09b5aa60350e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:29.221102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60b3d134-ce98-4ae3-922b-2e9f4cc8864c tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 200 len: 1305 microversion: 2.1 time: 0.237111 Aug 30 18:17:29.223153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 771/1587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:28 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 1305 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:29.233476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:29.234458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:29.257567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.258787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.258787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.260885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.261512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.262055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.880420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:29.890867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:29.892789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:29.894658 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ef73c889-5c94-4ced-b1e3-2855b3d7d080 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1558 microversion: 2.21 time: 0.669753 Aug 30 18:17:29.907159 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 772/1588] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:29 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1558 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:29.920901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:29.921904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:29.930036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.931035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.931733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.932725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:29.933643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:29.934307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:29.998165 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb19c6f1-be17-4729-962b-64c8bb6f088a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 204 len: 0 microversion: 2.1 time: 1.081639 Aug 30 18:17:30.000005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 817/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:28 2022] DELETE /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:30.031235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:30.032567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:30.065338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.066192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.066952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.068170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.068955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.069690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.310483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:30.325376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-733515b4-d6e6-4380-88eb-faeaee3e4746 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.416140 Aug 30 18:17:30.328635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 773/1590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:29 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:30.334334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5ff321-27d6-415c-847d-c1e590ac57f8", "name": "network-vif-plugged", "status": "completed", "tag": "b5e5abb9-295d-4a42-a649-2978a4ed8c7d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:30.345471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.345943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.346607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.363928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] Creating event network-vif-plugged:b5e5abb9-295d-4a42-a649-2978a4ed8c7d for instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 on n-h2-854119-10 Aug 30 18:17:30.372201 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5de71872-9d9d-4a7f-b9e6-8dbb6aab40fa req-5964bca9-c2e9-4fda-ac78-b41d28eab21d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041704 Aug 30 18:17:30.373174 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 774/1591] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:30.379642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:30.380538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:30.389466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:30.395471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.395954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.396580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.397495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.398317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.398569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.541701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:30.560457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb0bcfe2-84f6-4187-b6bc-94d6c9f88be3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1573 microversion: 2.1 time: 0.558707 Aug 30 18:17:30.561520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 818/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:30 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1573 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:30.566365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:30.571248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:30.593553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.595067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.596354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.599111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:30.603048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:30.603765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:30.693222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:30.880296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:30.978149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:30.993835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5f3f8cd-9d7c-4b28-8f70-f03012f02869 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.619212 Aug 30 18:17:30.996118 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 775/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:30 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:31.012187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2491dfa-368d-43c5-9538-8d99cfc49eb7", "name": "network-vif-deleted", "tag": "4a16b486-bffa-4838-90a3-420746608fab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.025334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4659791-8c9a-484f-8e68-842750ab7480 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 204 len: 0 microversion: 2.1 time: 0.458257 Aug 30 18:17:31.028713 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 819/1594] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:30 2022] DELETE /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:31.035695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:31.036809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.046583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.048880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.050203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.050920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.055428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.060140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.068790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.070722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.071899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.088759 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] Creating event network-vif-deleted:4a16b486-bffa-4838-90a3-420746608fab for instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 on n-h2-854119-10 Aug 30 18:17:31.101131 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ec0d8527-5745-4600-a454-8f54ce3aa0b7 req-09864590-276f-420d-839f-187ebd944858 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099230 Aug 30 18:17:31.103251 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 776/1595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:31.106901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 HTTP/1.1 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b2491dfa-368d-43c5-9538-8d99cfc49eb7'} Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.109747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.115454 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.117777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:31.118846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.124097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:31.127469 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-666dabe1-fe16-4d61-8c95-d754056c2870 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 404 len: 111 microversion: 2.1 time: 0.095553 Aug 30 18:17:31.131736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 820/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:31 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:31.137328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.138174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.139077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.139974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-17659333", "metadata": {"image_type": "test"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.143027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.143697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.147005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.156004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.175147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.176854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.177551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.180890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.181691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.183028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.226530 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7/action HTTP/1.1 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 110 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-17659333", "metadata": {"image_type": "test"}}} Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b2491dfa-368d-43c5-9538-8d99cfc49eb7', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-17659333', 'metadata': {'image_type': 'test'}}}} Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:17:31.229955 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:31.234498 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.238740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:31.240608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7860ad4b-5218-470b-94cd-d6e83946fca4 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "POST /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7/action" status: 404 len: 111 microversion: 2.1 time: 0.107711 Aug 30 18:17:31.246926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 821/1597] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Aug 30 18:17:31 2022] POST /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:31.260826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-498758979", "metadata": {"image_type": "test"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.264917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Failed to fetch instance by id tempest-invalid-657220618 {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:17:31.265446 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance tempest-invalid-657220618 could not be found. Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/tempest-invalid-657220618/action HTTP/1.1 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 111 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-498758979", "metadata": {"image_type": "test"}}} Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance tempest-invalid-657220618 could not be found. Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'tempest-invalid-657220618', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-498758979', 'metadata': {'image_type': 'test'}}}} Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-657220618 could not be found. Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:31.267207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-657220618 could not be found. Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-657220618 could not be found. Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance tempest-invalid-657220618 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6dd2404e-0e9a-46cf-a761-6bb108e2db46 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-657220618/action" status: 404 len: 100 microversion: 2.1 time: 0.019145 Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 822/1598] 10.222.0.25 () {60 vars in 1246 bytes} [Tue Aug 30 18:17:31 2022] POST /compute/v2.1/servers/tempest-invalid-657220618/action => generated 100 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:31.278028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1174083153", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6934b7e3-effd-490c-a322-f67172841720"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.463411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:31.467652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] validate_networks() for [('6934b7e3-effd-490c-a322-f67172841720', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:31.489528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:31.492160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:31.495013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-adfc8b75-172b-43c4-af9c-91267bc7b54f tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1558 microversion: 2.21 time: 0.389986 Aug 30 18:17:31.509910 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 777/1599] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:31 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1558 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:31.515850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1291124235"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.520539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:17:31.521494 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 57 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: {"createImage": {"name": "tempest-test-snap-1291124235"}} Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1291124235'}}} Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.530581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.535906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:31.537239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-243beed7-0a02-4b37-ad44-1ba937815204 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025759 Aug 30 18:17:31.540893 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 778/1600] 10.222.0.25 () {60 vars in 1275 bytes} [Tue Aug 30 18:17:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:31.559019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:31.562748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.571539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.572031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.572474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.573711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.574182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.574670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.908641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:31.920783 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0070a4c5-016d-478a-84ab-deb120b60220 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.373465 Aug 30 18:17:31.921410 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 779/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:31 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:31.933885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1519789381"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:31.947707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:17:31.948710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 57 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: {"createImage": {"name": "tempest-test-snap-1519789381"}} Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1519789381'}}} Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.950591 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 18:17:31.955728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:31.967643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:31.969204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56a0919f-f28e-4f03-b6e2-286bb83400e3 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.045697 Aug 30 18:17:31.970443 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 780/1602] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Aug 30 18:17:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:31.977181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:31.978157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:31.996651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.997521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:31.997980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:31.998738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:31.999218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.008402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.327603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.349227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-498485c8-eb7a-4ec8-bafc-35a0b53e010b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1573 microversion: 2.1 time: 0.370400 Aug 30 18:17:32.363958 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 781/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:31 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1573 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:32.375495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.376038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.396282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.397117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.397734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.399145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.399829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.400465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.431879 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 HTTP/1.1 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b2491dfa-368d-43c5-9538-8d99cfc49eb7'} Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:32.433855 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.438288 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.440598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:32.441737 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0fd9329-a253-4a79-be7d-aa3971d11b01 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 404 len: 111 microversion: 2.1 time: 0.076533 Aug 30 18:17:32.442564 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 782/1604] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:32 2022] DELETE /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:32.449238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.450215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.458034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.459049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.459733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.460613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.461476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.462410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.468540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:32.601588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:32.602176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:32.602776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:32.604374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:32.605694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:32.613848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:32.628459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.629552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.630096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.631031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.631485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.631991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.661751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.673253 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00ab42ce-e9bd-4bb4-8c72-9964a64e97e3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.229019 Aug 30 18:17:32.674672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 783/1605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:32 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:32.681993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.682911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:32.688313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] [instance: b2491dfa-368d-43c5-9538-8d99cfc49eb7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.697233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.697908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.698042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for user 1cc40f3a740645d1af38042ad00935b1 and project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:32.698575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.699808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.700515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.701920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.713125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:32.716039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:32.723804 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] HTTP exception thrown: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Request method failure captured: Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 HTTP/1.1 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQViuPxokJxH7vInTkUE0HBhEMCO9KqomJZXJyViXOIAtoVgLmTgJuDWaAggk5OnRM-O1rjhTl-IfwYlEm53IjuqyfsgQezUen9Bxs9Z4CK5dQfRVdUZRg6uEIDe0S2XbliftFJPq6mYISkU6DN1rU9MkT2G2WfuVK3WNNRScjlgEQ Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e901953a1397458bb09b5aa60350e61d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e901953a1397458bb09b5aa60350e61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e901953a1397458bb09b5aa60350e61d Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-137111220 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 27e6ade69d0f47be9e3f970652e6dc21 Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesNegativeTestJSON-137111220-project Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b2491dfa-368d-43c5-9538-8d99cfc49eb7'} Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:32.726413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. Aug 30 18:17:32.731767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:32.733800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] Returning 404 to user: Instance b2491dfa-368d-43c5-9538-8d99cfc49eb7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:32.735150 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a0ba9d6-0777-491c-bcce-0435ea994933 tempest-ImagesNegativeTestJSON-137111220 tempest-ImagesNegativeTestJSON-137111220-project] 10.222.0.25 "GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7" status: 404 len: 111 microversion: 2.1 time: 0.059176 Aug 30 18:17:32.736113 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 784/1606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:32 2022] GET /compute/v2.1/servers/b2491dfa-368d-43c5-9538-8d99cfc49eb7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:32.742634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.743947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.751623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.752733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.753556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.754532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.755159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.755762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.802489 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-42af390c-5651-4d91-8d4c-38f965ec1799 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528196 Aug 30 18:17:32.804825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 823/1607] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:32.826136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-242ecaa2-83bb-4241-8ada-a7edff4b2e7e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:32.829438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:32.829822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-242ecaa2-83bb-4241-8ada-a7edff4b2e7e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:32.834134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:32.834810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:32.836392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lazy-loading 'fault' on Instance uuid 198434e9-123c-4444-b942-948fb36ad15d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:17:32.949365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.979282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.994982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c181727b8c23427492887eebfd101ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742cd7a84444398abdc3542be92b485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:32.997717 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57b330b8-c080-4987-8f4c-64a39cade4f8 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 200 len: 1348 microversion: 2.21 time: 0.260254 Aug 30 18:17:33.001272 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 785/1608] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:32 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 1348 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:33.003680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-242ecaa2-83bb-4241-8ada-a7edff4b2e7e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:33.021089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:33.021980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:33.024776 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-242ecaa2-83bb-4241-8ada-a7edff4b2e7e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1208 microversion: 2.1 time: 0.201997 Aug 30 18:17:33.039648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.040689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.041402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.042425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.043105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.043765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.057607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 824/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:32 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1208 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:33.183065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198434e9-123c-4444-b942-948fb36ad15d", "name": "network-vif-deleted", "tag": "71ab8a86-65fe-4185-9255-d068b966d2b9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:33.218665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.219179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.219622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.245224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] Creating event network-vif-deleted:71ab8a86-65fe-4185-9255-d068b966d2b9 for instance 198434e9-123c-4444-b942-948fb36ad15d on n-h1-854119-10 Aug 30 18:17:33.271274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4e81a14a-d91f-4e70-8fb3-9090d119b26e req-0ac6b714-ce7d-44a5-bb98-93b0a702c93d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093225 Aug 30 18:17:33.285204 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 825/1610] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 18:17:33.373280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:33.374330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:33.389794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.397428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.400662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.401813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.412954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.413857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.591081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:33.652779 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c026058c-e7d6-475f-a974-e81b923bedde tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1308 microversion: 2.1 time: 0.641105 Aug 30 18:17:33.685312 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 786/1611] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:33 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:33.712350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:33.719162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:33.756759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.758285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.759409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:33.761811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:33.764075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:33.768139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.449095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:34.479342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-889c444a-08ca-4a46-b283-bfd32584c0c3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.782074 Aug 30 18:17:34.486792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 787/1612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:33 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:34.504438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:34.507646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:34.533936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.536363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.537434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.539851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.540944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.541931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.572822 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] HTTP exception thrown: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Request method failure captured: Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d HTTP/1.1 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQXbCi2YN2WikkE4czjn6BdHy-9y0EAKYPWrzvcQOPEVS-u9LvscaWlZhUWTRFDqEQ99O8JC6xNUMgcqtjit_omTeQW-Cf0dxA2FwMHbthtLMtQjZFFhQbcelfoENKWc0khlr0a2MPN5WZ8TUc_Z8DNLRzJD8opzK0gDZ3M9HFDOe4 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c742cd7a84444398abdc3542be92b485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c742cd7a84444398abdc3542be92b485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c181727b8c23427492887eebfd101ec5 Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '198434e9-123c-4444-b942-948fb36ad15d'} Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:34.576277 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:34.585809 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:34.588227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Returning 404 to user: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:34.589431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-058dfbbc-cd9e-4481-8243-9dc99699d324 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 404 len: 111 microversion: 2.21 time: 0.100681 Aug 30 18:17:34.590944 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 788/1613] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:34 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:17:34.596523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:34.598088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:34.615638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.616094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.618616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.620446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.630686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.631443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.681960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:34.692768 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d024834e-fe68-48bf-bd81-76b83635fdf0 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1571 microversion: 2.1 time: 1.324491 Aug 30 18:17:34.697781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 826/1614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:33 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1571 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:34.714465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a6f7d-848a-4117-a0d6-c364e5635ee7", "name": "network-vif-unplugged", "status": "completed", "tag": "4174bc8d-77d1-4335-a74c-0105106ee659"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:34.736838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.737782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.738620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.774909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] Creating event network-vif-unplugged:4174bc8d-77d1-4335-a74c-0105106ee659 for instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 on n-h2-854119-10 Aug 30 18:17:34.786523 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-25d6b95e-8fca-4458-9574-8fa6390c3052 req-37e5ae3e-95d9-45f1-bda2-390bb3613501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085241 Aug 30 18:17:34.788873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 827/1615] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:34.817597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '.version_select at 0x7f4e56b789d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:34.820523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:34.846892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:34.865930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.870984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.871776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.871973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3b913ca-bed7-415a-9326-10fd0842a0f8 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1260 microversion: 2.1 time: 0.276091 Aug 30 18:17:34.872824 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 789/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:34 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:34.897047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.898936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.899688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.908237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:34.914883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:34.937539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.939350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.939920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:34.941438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:34.942150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:34.942852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:35.131097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a40bfe59-21e0-43fe-bdcc-dfadade91e3b tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.340080 Aug 30 18:17:35.131950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 828/1617] 10.222.0.25 () {60 vars in 1337 bytes} [Tue Aug 30 18:17:34 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d/os-instance-actions => generated 611 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:17:35.141167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94911890"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:35.142063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:35.157869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:35.158788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:35.159582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:35.161099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:35.162291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:35.163133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:35.845436 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Adding security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef to port c0a86335-e5f4-4949-847b-e3d88da8050b Aug 30 18:17:35.983304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:35.997721 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92824881-062a-49a2-af9e-b95679490b32 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1489 microversion: 2.1 time: 1.108369 Aug 30 18:17:36.000820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 790/1618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:34 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1489 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:36.012948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:36.016921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:36.032575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.033115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.033536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.034381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.034854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.040684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.076774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] HTTP exception thrown: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Request method failure captured: Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d HTTP/1.1 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQXbCi2YN2WikkE4czjn6BdHy-9y0EAKYPWrzvcQOPEVS-u9LvscaWlZhUWTRFDqEQ99O8JC6xNUMgcqtjit_omTeQW-Cf0dxA2FwMHbthtLMtQjZFFhQbcelfoENKWc0khlr0a2MPN5WZ8TUc_Z8DNLRzJD8opzK0gDZ3M9HFDOe4 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c742cd7a84444398abdc3542be92b485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c742cd7a84444398abdc3542be92b485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c181727b8c23427492887eebfd101ec5 Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '198434e9-123c-4444-b942-948fb36ad15d'} Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:36.081022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Returning 404 to user: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0def37ac-4c2c-41bb-8254-dc24adf87400 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "DELETE /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 404 len: 111 microversion: 2.21 time: 0.079991 Aug 30 18:17:36.086879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 791/1619] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:17:36 2022] DELETE /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:17:36.096859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:36.100379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:36.119106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.119615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.120130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.120881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.136510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.136510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.558148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:36.573148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9779fe4-dc7c-433c-8919-1fce106c639b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.484859 Aug 30 18:17:36.593119 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 792/1620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:36 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:36.613390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:36.614252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:36.626993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.627507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.628403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.629704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.630178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.630772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.802170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:36.815719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3cebf647-d9dc-423c-bb60-390af22dc9d5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1266 microversion: 2.1 time: 0.220301 Aug 30 18:17:36.816719 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 793/1621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:36 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:36.825734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:36.826896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] [instance: 198434e9-123c-4444-b942-948fb36ad15d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:36.840485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.841390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.841390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.842144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:36.847322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:36.848814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:36.880124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] HTTP exception thrown: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Request method failure captured: Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d HTTP/1.1 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlQXbCi2YN2WikkE4czjn6BdHy-9y0EAKYPWrzvcQOPEVS-u9LvscaWlZhUWTRFDqEQ99O8JC6xNUMgcqtjit_omTeQW-Cf0dxA2FwMHbthtLMtQjZFFhQbcelfoENKWc0khlr0a2MPN5WZ8TUc_Z8DNLRzJD8opzK0gDZ3M9HFDOe4 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c742cd7a84444398abdc3542be92b485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c742cd7a84444398abdc3542be92b485"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c742cd7a84444398abdc3542be92b485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: c742cd7a84444398abdc3542be92b485 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1209141280 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c181727b8c23427492887eebfd101ec5 Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-InstanceActionsV221TestJSON-1209141280-project Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '198434e9-123c-4444-b942-948fb36ad15d'} Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.881745 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] Returning 404 to user: Instance 198434e9-123c-4444-b942-948fb36ad15d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e724684b-5783-467e-b69a-8b903f22ac68 tempest-InstanceActionsV221TestJSON-1209141280 tempest-InstanceActionsV221TestJSON-1209141280-project] 10.222.0.25 "GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d" status: 404 len: 111 microversion: 2.21 time: 0.065652 Aug 30 18:17:36.888297 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 794/1622] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:36 2022] GET /compute/v2.1/servers/198434e9-123c-4444-b942-948fb36ad15d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:17:36.889732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-903815397", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:36.980686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:37.332195 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57ab4a84-f3bf-4e0c-b748-613e388964f5 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action" status: 202 len: 0 microversion: 2.1 time: 2.198389 Aug 30 18:17:37.333914 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 829/1623] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:17:35 2022] POST /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07/action => generated 0 bytes in 2201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:37.344219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77a6f7d-848a-4117-a0d6-c364e5635ee7", "name": "network-vif-deleted", "tag": "4174bc8d-77d1-4335-a74c-0105106ee659"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:37.394312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:37.395596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:37.403473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:37.459832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] Creating event network-vif-deleted:4174bc8d-77d1-4335-a74c-0105106ee659 for instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 on n-h2-854119-10 Aug 30 18:17:37.521367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2570e9ac-45fa-4d93-8f2f-3cb2569d8da5 req-2c38be60-f85e-4dc4-8995-b58a69fdd888 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180261 Aug 30 18:17:37.522195 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 830/1624] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:37.531776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56d415e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:37.956593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:37.957561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:37.958068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:37.958582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:37.959093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:37.976494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:37.976494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:37.979199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:37.981521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:37.981994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:37.982494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.049828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:38.065641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:38.110164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:38.115765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:38.276800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53560a73-0c36-4f68-9b4e-803c965b2865 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390870 Aug 30 18:17:38.277939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 795/1625] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:38.298664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:38.299833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:38.324031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.325328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.326231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.331872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.334755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.336496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.566337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use.", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:38.567558 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.567558 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef HTTP/1.1 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: exception: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '159d69b7-a906-48a6-8ba6-ed1cf9b474ef'} Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:38.571499 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 400 to user: Security Group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef in use. Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-0a504328-5924-4824-813d-7e8247287d2e'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:38.576449 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc8395fa-5bb1-42d9-a5ba-8d2f0dc83a3f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef" status: 400 len: 185 microversion: 2.1 time: 1.049183 Aug 30 18:17:38.580504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 831/1626] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:37 2022] DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef => generated 185 bytes in 1056 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:17:38.597118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:38.598498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:38.618757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.619713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.621777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.623110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:38.625715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:38.628985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:38.927256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:38.954480 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4fa3d33-2268-4701-9a88-231be0491cb6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1503 microversion: 2.1 time: 0.662708 Aug 30 18:17:38.956609 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 796/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:38 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1503 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:38.975244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-013ca8d1-1310-4456-aa68-33ec7e9bba5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:38.976237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-013ca8d1-1310-4456-aa68-33ec7e9bba5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:39.083510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-013ca8d1-1310-4456-aa68-33ec7e9bba5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:39.098043 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-013ca8d1-1310-4456-aa68-33ec7e9bba5f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1208 microversion: 2.1 time: 0.136099 Aug 30 18:17:39.098696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 797/1628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:38 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:39.104709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:39.105218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:39.136485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.137289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.138324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.139775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.140872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.141573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.261318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:39.442173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:39.454102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23ed688b-596d-4453-a107-bdc9e8eea2b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 0.873253 Aug 30 18:17:39.454999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 832/1629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:38 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:39.561715 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2be1382-432f-4656-9c02-e1d50bcbb4d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 204 len: 0 microversion: 2.1 time: 0.456330 Aug 30 18:17:39.566288 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 798/1630] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:39 2022] DELETE /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:39.578182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:39.579987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:39.608868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.609316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.614685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.615748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.616394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.617380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.890171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8c8f82-9615-4b35-ad45-569d3eff2b07", "tag": "c0a86335-e5f4-4949-847b-e3d88da8050b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:39.952444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:39.956286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:39.957901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:39.982690 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] Creating event network-changed:c0a86335-e5f4-4949-847b-e3d88da8050b for instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 on n-h1-854119-10 Aug 30 18:17:39.995103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:40.004933 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b04ac57d-43a6-430e-b2fa-5ba3dbf62229 req-a5a32609-b15c-4034-b172-89cff17cb24b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149035 Aug 30 18:17:40.007408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd6562a0-56af-41c3-8fb3-d6275b70373e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1644 microversion: 2.1 time: 0.434471 Aug 30 18:17:40.008140 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 833/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:39 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1644 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:40.009006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 799/1632] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:40.023070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.023812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:40.040717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.041584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.042567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.043833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.044520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.045152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.124583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.125734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:40.137525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.138797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.141487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.142540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.144324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.146298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.248489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:40.260260 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40ac6208-7bc0-4b0b-be0b-da4fa91ce8c7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1260 microversion: 2.1 time: 0.140010 Aug 30 18:17:40.261994 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 834/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1260 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:40.499543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.500425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:40.505657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:40.514947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.515500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.516998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.519167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.519846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.522609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.540046 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d88d915-f1ff-46ca-a165-60ea38351108 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1493 microversion: 2.1 time: 0.519841 Aug 30 18:17:40.541250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 800/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1493 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:40.584204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64835d3d-8829-4dfe-932f-c3a9cd5de5f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '.version_select at 0x7f4e567208b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.591249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64835d3d-8829-4dfe-932f-c3a9cd5de5f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.592429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64835d3d-8829-4dfe-932f-c3a9cd5de5f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.593453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64835d3d-8829-4dfe-932f-c3a9cd5de5f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.612770 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64835d3d-8829-4dfe-932f-c3a9cd5de5f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.035130 Aug 30 18:17:40.629234 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 801/1635] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:40.638601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:40.639713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:40.650737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.652097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.653167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:40.659567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:40.660891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:40.661922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.137209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a372caf-d8c3-478f-a8e9-5e1c2d31a4c5 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1646 microversion: 2.1 time: 0.505655 Aug 30 18:17:41.137911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 802/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1646 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:41.146923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:41.152003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:41.166489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.168691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.184076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.184883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.185367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.185807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.216817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:41.613738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:41.635084 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-303230f6-1fa1-48ff-81d6-fd99de69ac11 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 1.141672 Aug 30 18:17:41.647809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 835/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:40 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:41.667842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:41.669928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:41.700289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.701707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.702929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.704630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:41.715051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:41.716530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:41.973701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:41.996492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:41.999940 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83d2e0e6-6092-4253-baab-3d51f6363870 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1266 microversion: 2.1 time: 0.349674 Aug 30 18:17:42.008085 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 836/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:41 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:42.024144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-823057786", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "52c8298b-12f8-4e95-8e3d-1e6d6e6336e2"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:42.025947 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f869c7d-0216-485b-8c58-42dbf1fe9f0d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1644 microversion: 2.1 time: 0.887039 Aug 30 18:17:42.029195 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 803/1639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:41 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1644 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:42.171883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] validate_networks() for [('52c8298b-12f8-4e95-8e3d-1e6d6e6336e2', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:42.659614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:42.670095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:42.670815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:42.687456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:42.687946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:42.688376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:42.689088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:42.689764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:42.690261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:43.019169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:43.793038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:43.812974 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4d674a4-26e4-4877-abda-e186c18f1a93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 1.138532 Aug 30 18:17:43.816147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 804/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:42 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:43.842513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1", "tag": "2759ed98-d63a-42f4-b804-bf659c5fbac7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:43.864562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:43.866305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:43.867085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:43.898793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] Creating event network-changed:2759ed98-d63a-42f4-b804-bf659c5fbac7 for instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 on n-h1-854119-10 Aug 30 18:17:43.914284 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-390b91fa-6a18-4cc5-94cf-77fb584217b7 req-c7a213bf-34b9-48c9-9393-df2ea50c8755 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094591 Aug 30 18:17:43.915693 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 805/1641] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:43.925533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:43.929812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:43.947708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:43.948479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:43.949573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:43.952014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:43.954265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:43.954959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:44.424033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:44.434844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8884d1a5-d164-4bd8-b6c0-509ecfa031f8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.517598 Aug 30 18:17:44.461070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 806/1642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:43 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:44.483253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:44.484275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:44.494565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:44.495884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:44.497144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:44.498383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:44.499481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:44.500476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.347710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:45.371676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d9f9895-633d-4d0e-ac46-83e649c86a4e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 200 len: 1644 microversion: 2.1 time: 0.908420 Aug 30 18:17:45.372791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 807/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:44 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 1644 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:45.395761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:45.396274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:45.438599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.439627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.440490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.458166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.459250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.467068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.516004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:45.516969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:45.517719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:45.518139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:45.518881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:45.553059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.555537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.556309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.566916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.567419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.567861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.598724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:45.628672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:45.635930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for user cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 and project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:45.656975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:45.666378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:45.771622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-132402f9-68f6-42d7-8805-8db4be33cd77 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 204 len: 0 microversion: 2.1 time: 0.396353 Aug 30 18:17:45.775794 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 808/1644] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:45 2022] DELETE /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:45.784171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:45.795061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:45.797310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b7b1c8c-7cbc-4329-a958-88d0e28cb204 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.787204 Aug 30 18:17:45.810270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 837/1645] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:45.825072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.826202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.828908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:45.829691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.831096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.831834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.832789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.834266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:45.861613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.862264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.862737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:45.863656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:45.864305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:45.865103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.264786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:46.275216 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7fcb0b3-8a03-43c0-b217-44b378a166fb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 0.494682 Aug 30 18:17:46.276710 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 809/1646] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:45 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:46.283263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:46.284207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:46.353716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.356087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.370554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:46.375570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.379755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.381737 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbfe57ea-ac6b-44c7-9bbd-cdcd2a7ad078 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.569104 Aug 30 18:17:46.382405 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 838/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:45 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:46.391589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.392437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.407171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86897a57-7e7c-4cf7-90ba-9d946143eb6b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:46.407843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-86897a57-7e7c-4cf7-90ba-9d946143eb6b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:46.702752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86897a57-7e7c-4cf7-90ba-9d946143eb6b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:46.711510 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86897a57-7e7c-4cf7-90ba-9d946143eb6b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1210 microversion: 2.1 time: 0.327985 Aug 30 18:17:46.714697 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 839/1648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:46 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1210 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:46.727398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8c8f82-9615-4b35-ad45-569d3eff2b07", "name": "network-vif-deleted", "tag": "c0a86335-e5f4-4949-847b-e3d88da8050b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:46.751401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.752391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.753261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.784821 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] Creating event network-vif-deleted:c0a86335-e5f4-4949-847b-e3d88da8050b for instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 on n-h1-854119-10 Aug 30 18:17:46.800337 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f07a126c-6ac2-46ba-972c-8e078d82d661 req-7c2d7ef6-3d3c-498f-af3d-72d50f1fb1f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084230 Aug 30 18:17:46.801425 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 840/1649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:46.808430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:46.809415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:46.822777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.827185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.828710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.831433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:46.832274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:46.836528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:46.869419 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 HTTP/1.1 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1f8c8f82-9615-4b35-ad45-569d3eff2b07'} Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:46.872332 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:46.877485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:46.882546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:46.883811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c06c173f-9506-4a39-ab1c-b3edebea0e5f tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 404 len: 111 microversion: 2.1 time: 0.080987 Aug 30 18:17:46.884574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 841/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:46 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:46.896070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-576e4764-f7b3-4fbd-ace5-7d224662d1c1 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56afd0d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:47.651876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:47.670975 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-886dfff0-fe72-4d1a-ab7b-0b55d25f6ecd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1554 microversion: 2.1 time: 1.392681 Aug 30 18:17:47.674370 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 810/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:46 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1554 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:47.689022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:47.690432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:47.719923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:47.720448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:47.739520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:47.740524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:47.746274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:47.747328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.007286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:48.185148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:48.200319 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8fbf8c42-148a-48ee-a237-63124a398166 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 0.524031 Aug 30 18:17:48.217319 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-576e4764-f7b3-4fbd-ace5-7d224662d1c1 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad" status: 202 len: 0 microversion: 2.1 time: 1.328042 Aug 30 18:17:48.219936 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 842/1652] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:46 2022] DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:48.229575 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 811/1653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:47 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:48.246510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:48.253417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:48.269178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:48.274659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:48.294508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:48.297037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:48.298056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.298372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:48.300352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:48.300916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:48.301687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.302262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:48.303518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.304906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:48.306721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:48.310521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:48.446075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:48.460638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dee644a2-13c2-4952-b3e8-fa5a8fbe4a5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1262 microversion: 2.1 time: 0.212310 Aug 30 18:17:48.461689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 812/1654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:48 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1262 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:48.782787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-908937a8-9f9d-46df-b1e8-834b0f226220 tempest-ListImageFiltersNegativeTestJSON-1393876060 tempest-ListImageFiltersNegativeTestJSON-1393876060-project] Calling method '.version_select at 0x7f4e566f6670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:48.847297 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-908937a8-9f9d-46df-b1e8-834b0f226220 tempest-ListImageFiltersNegativeTestJSON-1393876060 tempest-ListImageFiltersNegativeTestJSON-1393876060-project] HTTP exception thrown: Image not found. Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-908937a8-9f9d-46df-b1e8-834b0f226220 tempest-ListImageFiltersNegativeTestJSON-1393876060 tempest-ListImageFiltersNegativeTestJSON-1393876060-project] Request method failure captured: Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/images/5ddf64d1-5080-43a2-b1d4-5497a86ebb34 HTTP/1.1 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlRMNLOfhij5cWxJHCMa5c7mb_aLkgBNGobGVIcNjlAJV_jaYNb8i6DY2nVmT9Aedat8ZC6EkdCyN8X4yQwjOnj-gOdvvvROjwciWy_jK4404NS6i7n88r0CCtTbkTVf-SvlcMAAMzvKUUb-Qi2beQiTJ-6bnL792DRU-99Oe7VMySY Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 7261fadc31554b57b6e94e898d101f0e Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1393876060 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7261fadc31554b57b6e94e898d101f0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7261fadc31554b57b6e94e898d101f0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7261fadc31554b57b6e94e898d101f0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7261fadc31554b57b6e94e898d101f0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1393876060 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 7261fadc31554b57b6e94e898d101f0e Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1393876060 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListImageFiltersNegativeTestJSON-1393876060-project Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 439d5d5cb10a49d3895914f4e27f0192 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1393876060-project Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5ddf64d1-5080-43a2-b1d4-5497a86ebb34'} Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5ddf64d1-5080-43a2-b1d4-5497a86ebb34 Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:17:48.850485 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ddf64d1-5080-43a2-b1d4-5497a86ebb34 could not be found. Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-908937a8-9f9d-46df-b1e8-834b0f226220 tempest-ListImageFiltersNegativeTestJSON-1393876060 tempest-ListImageFiltersNegativeTestJSON-1393876060-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-908937a8-9f9d-46df-b1e8-834b0f226220 tempest-ListImageFiltersNegativeTestJSON-1393876060 tempest-ListImageFiltersNegativeTestJSON-1393876060-project] 10.222.0.25 "GET /compute/v2.1/images/5ddf64d1-5080-43a2-b1d4-5497a86ebb34" status: 404 len: 62 microversion: 2.1 time: 0.390245 Aug 30 18:17:48.855660 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 813/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:17:48 2022] GET /compute/v2.1/images/5ddf64d1-5080-43a2-b1d4-5497a86ebb34 => generated 62 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:17:48.895310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9b862a1-901f-4537-be93-8d4a08565944 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56c2f3a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:49.088092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:49.580642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:49.599351 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9b862a1-901f-4537-be93-8d4a08565944 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef" status: 202 len: 0 microversion: 2.1 time: 0.741352 Aug 30 18:17:49.599907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 814/1656] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:48 2022] DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:49.610988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:49.611889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:49.617028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:49.619243 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d19c769-e546-4863-9a96-6d28c018ed1c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 1.397197 Aug 30 18:17:49.639897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.640409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.640860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.641607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.642068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.647887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.652720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 843/1657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:48 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:49.683840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:49.689312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:49.726782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.727529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.745987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.747460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.755169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.756039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.758214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:49.770683 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84065509-36f4-4f88-99c7-5b0330c4d530 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.163440 Aug 30 18:17:49.771624 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 815/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:49 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:49.786663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd03713e-44fd-497a-9cac-877b40926247", "name": "network-vif-deleted", "tag": "868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:49.806050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.806569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.807009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.837115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] Creating event network-vif-deleted:868ac6c1-cbd1-4c9d-9309-c75d6f3c79bd for instance dd03713e-44fd-497a-9cac-877b40926247 on n-h2-854119-10 Aug 30 18:17:49.850632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-54fe6e40-e0fc-4da5-9a32-1fcd2a71d4fe req-887ac171-390c-4fcf-a1ac-9c7fbbbbc65e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073535 Aug 30 18:17:49.851832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 816/1659] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:49.863161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c21033-4f8e-41fc-960b-065945bb00fd", "tag": "3d2ae2df-ebaa-4c87-bb4a-6594d383dd30"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:49.892193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.892674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.893337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.909010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] Creating event network-changed:3d2ae2df-ebaa-4c87-bb4a-6594d383dd30 for instance 43c21033-4f8e-41fc-960b-065945bb00fd on n-h2-854119-10 Aug 30 18:17:49.917817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ed36c554-ce30-4ca8-b109-1a0af8c61980 req-d8ff8d8c-9a59-4ec2-9db1-e2d6303b6d11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064146 Aug 30 18:17:49.918815 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 817/1660] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:49.934509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:49.935633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:49.953414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.956003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.964077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:49.965372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:49.966120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:49.967238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:50.149305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:50.159397 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5589d067-835f-412c-8010-03c9cd77b1e1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1268 microversion: 2.1 time: 0.237420 Aug 30 18:17:50.163587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 818/1661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:49 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1268 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:50.182666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a2b31b7-6a90-4fb4-80e4-5c9a165d9177 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'create', calling method: .version_select at 0x7f4e56bde430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1998649066", "description": "tempest-description-837100352"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:50.672474 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a2b31b7-6a90-4fb4-80e4-5c9a165d9177 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.507132 Aug 30 18:17:50.673104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 819/1662] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:17:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:50.677885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1", "name": "network-vif-plugged", "status": "completed", "tag": "2759ed98-d63a-42f4-b804-bf659c5fbac7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:50.728197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:50.729856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:50.730592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:50.761345 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] Creating event network-vif-plugged:2759ed98-d63a-42f4-b804-bf659c5fbac7 for instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 on n-h1-854119-10 Aug 30 18:17:50.776646 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5037da00-e5ef-48fa-9a33-5f73838f2d85 req-d718ab20-a8af-4ad7-a4af-a5770aa650f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102216 Aug 30 18:17:50.782506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 820/1663] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:50.794237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:50.797955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:50.819856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:50.822950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:50.824323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:50.826227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:50.829335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:50.830125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:51.137120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:51.148368 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b8b910b-3421-48bb-8373-99eadbd4aa93 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 1.494146 Aug 30 18:17:51.153172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 844/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:49 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:51.176430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0ebe526-9615-422d-9668-e65d0c8a418d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Action: 'update', calling method: .version_select at 0x7f4e56afd160>, body: {"security_group": {"name": "tempest-sg-hth-1335968728", "description": "tempest-description-hth-873448922"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:51.337105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:51.352807 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-068fdb1b-8038-4d07-956c-e7ac53dac744 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.567904 Aug 30 18:17:51.369047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 821/1665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:50 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:51.375064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:51.376358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:51.385851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:51.386883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:51.387578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:51.389792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:51.390882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:51.391654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:51.478614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:51.490968 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6384ab6c-9e77-4d57-939e-8aadd8076ec1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.120170 Aug 30 18:17:51.493164 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 822/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:51 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:51.498926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:51.500014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:51.508727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:51.509508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:51.510384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:51.511366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:51.511947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:51.512527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:51.605879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:51.624401 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00e627d9-5e12-4e87-9e08-9e2476f7ed44 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1268 microversion: 2.1 time: 0.128989 Aug 30 18:17:51.626501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 823/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:51 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:52.192048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:52.193532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:52.229652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.247035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.247862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:52.248837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.249485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.252139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:52.260376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:52.444936 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0ebe526-9615-422d-9668-e65d0c8a418d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215" status: 200 len: 217 microversion: 2.1 time: 1.277593 Aug 30 18:17:52.447003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 845/1668] 10.222.0.25 () {60 vars in 1290 bytes} [Tue Aug 30 18:17:51 2022] PUT /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215 => generated 217 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:52.472385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:52.479365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:52.514707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.515843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.517627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:52.518990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.520168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.521565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:52.671346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:52.684202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3ea8816-245f-4037-ade6-634461c02387 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1308 microversion: 2.1 time: 0.506674 Aug 30 18:17:52.692162 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 824/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:52 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:17:52.706625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-762c7030-c1e4-4398-8f18-43acfd57d394 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566e13a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:52.890186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-762c7030-c1e4-4398-8f18-43acfd57d394 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215" status: 200 len: 217 microversion: 2.1 time: 0.196127 Aug 30 18:17:52.899502 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 825/1670] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:17:52 2022] GET /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215 => generated 217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:52.901628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:52.902313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:52.919060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.922087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.922952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:52.925340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:52.927711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:52.928568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:53.081796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:53.096091 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4d47c1d-6436-41ad-8cb2-3dd5c4d44669 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.202953 Aug 30 18:17:53.099343 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 826/1671] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:52 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:53.120244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:53.122820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:53.142035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:53.145665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:53.147708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:53.149130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:53.151840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:53.154756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:53.226982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:53.259475 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-286e5ea4-a0d9-48bd-b0a8-63a6e10441b5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.810616 Aug 30 18:17:53.261363 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 846/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:52 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:53.282696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dce5465e-799e-4db9-9bfa-5b24f29eb060 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e577d3f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:53.542933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:53.563379 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-858c1fd2-f413-479a-a381-867c6cb0f82b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.462186 Aug 30 18:17:53.565093 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 827/1673] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:53 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:53.868368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b33392e1-3e57-4e7b-a70f-07932e1364bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e568310d0>, body: {"keypair": {"name": "tempest-keypair-1831508695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyaFdFcoLO4J5d+P4fDIRgBYYVaXEGUKOncct8+qgKw8naTrEZga/eFCfFRuqfar2fBALaUvaCqM0zxIIexVmfT8UaKkunpYKV3dbqo10pTeu5gXT7H3ofrwGReTN+xGw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:53.891618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b33392e1-3e57-4e7b-a70f-07932e1364bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:53.898690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b33392e1-3e57-4e7b-a70f-07932e1364bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:53.933483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b33392e1-3e57-4e7b-a70f-07932e1364bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.364304 Aug 30 18:17:53.936308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 828/1674] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:53.950261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:53.951410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:53.967002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:53.967688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:53.969006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:53.971581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:53.972239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:53.973665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.131232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dce5465e-799e-4db9-9bfa-5b24f29eb060 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215" status: 202 len: 0 microversion: 2.1 time: 0.864119 Aug 30 18:17:54.132385 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 847/1675] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:53 2022] DELETE /compute/v2.1/os-security-groups/57b094fa-6d29-476d-b589-1bfdfcf22215 => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:54.140018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f7e78b7-df5e-4bb8-9d36-334fd664e1d6 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e56bb6550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.161536 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f7e78b7-df5e-4bb8-9d36-334fd664e1d6 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1831508695" status: 200 len: 498 microversion: 2.1 time: 0.027562 Aug 30 18:17:54.171337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 848/1676] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1831508695 => generated 498 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:54.182173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.183148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.203061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.204428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.205289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.207662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.209243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.210004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.238659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:54.249204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2bb1ffb5-8325-4807-b5d6-2cc96768249c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1488 microversion: 2.1 time: 0.310178 Aug 30 18:17:54.274573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 829/1677] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:53 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1488 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:54.286157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.287220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.295488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.296255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.296906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.297975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.298685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.299311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.321286 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 HTTP/1.1 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1f8c8f82-9615-4b35-ad45-569d3eff2b07'} Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:54.323902 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.329814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:54.331387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6df78aa1-1007-4274-8d00-da0963b25ab3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 404 len: 111 microversion: 2.1 time: 0.049229 Aug 30 18:17:54.334882 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 830/1678] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:54 2022] DELETE /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:54.337485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12044abf-ee02-4cc1-a813-dc20550b3f5b tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e566f6f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.365108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12044abf-ee02-4cc1-a813-dc20550b3f5b tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831508695" status: 202 len: 0 microversion: 2.1 time: 0.031246 Aug 30 18:17:54.366559 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 831/1679] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831508695 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:54.372667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:54.382311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.383099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.383719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.412836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:54.422286 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ddfc0b5-9c1c-4bf9-aef7-3545ab547ac7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.249392 Aug 30 18:17:54.422904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 849/1680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:54.434160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.440561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.456197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.463865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.464474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.465317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.465793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.466223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.474831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Going to try to stop instance {{(pid=122590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:17:54.617695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03c19c3a-0961-46ee-802b-62d8d84922fa tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1/action" status: 202 len: 0 microversion: 2.1 time: 0.247824 Aug 30 18:17:54.620578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 832/1681] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:17:54 2022] POST /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:54.633025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.638300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 1f8c8f82-9615-4b35-ad45-569d3eff2b07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.655051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.655608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.656067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.656852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.657320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.657756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.679237 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 HTTP/1.1 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1f8c8f82-9615-4b35-ad45-569d3eff2b07'} Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:54.682451 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Instance 1f8c8f82-9615-4b35-ad45-569d3eff2b07 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:54.691245 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c82c36e5-4948-4bdb-9764-abdcf6f267d7 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07" status: 404 len: 111 microversion: 2.1 time: 0.065784 Aug 30 18:17:54.696396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 833/1682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/servers/1f8c8f82-9615-4b35-ad45-569d3eff2b07 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:54.704828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06f39e89-30a7-4345-bea2-42925199e1bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e569e8670>, body: {"keypair": {"name": "tempest-keypair-1419853240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFzc2t6TS3cJMjuoqhti0ITWPr6Kmx3RSrZbppVhu1ZEB9dY9Um8UqyjqSRcxzRLDBtCvW6R9P0CFuQo22517UQuscGk30rng9G+Rva5bK//zOf815CtY7thSdyhVykpQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:54.727733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-06f39e89-30a7-4345-bea2-42925199e1bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:54.735805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-06f39e89-30a7-4345-bea2-42925199e1bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:54.781042 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06f39e89-30a7-4345-bea2-42925199e1bf tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087724 Aug 30 18:17:54.786872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:54.790198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 834/1683] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:54.791339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:54.798761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.799467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.804863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfd3ba89-9814-4cd1-a307-04b3a5e9197c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.371634 Aug 30 18:17:54.807224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.807769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.808210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.808941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.809397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.809820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.817762 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 850/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:54.836863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:54.837898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:54.844879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.847509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.848073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:54.849046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:54.849711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:54.850325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:55.159759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:55.188009 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8ba18b0-8fab-4578-943b-b0c331643c53 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.395630 Aug 30 18:17:55.209763 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 835/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:55.219669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566d64c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.220308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:55.239106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-caef8559-4e44-45e5-a2a8-0a261af1ba70 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.419519 Aug 30 18:17:55.240194 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 851/1686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:54 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:55.246827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ce46c88-6a5a-45ad-810e-7847af65d6ae tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e56a9f700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.284471 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ce46c88-6a5a-45ad-810e-7847af65d6ae tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419853240" status: 202 len: 0 microversion: 2.1 time: 0.042150 Aug 30 18:17:55.285574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 852/1687] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419853240 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:55.297179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05a3185a-f43b-4ddd-b950-ac0de3c72250 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e56adb0d0>, body: {"keypair": {"name": "tempest-keypair-1339574480", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:55.299457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:55.300724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:55.301738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.301738 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef HTTP/1.1 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '159d69b7-a906-48a6-8ba6-ed1cf9b474ef'} Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:55.314377 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] Aug 30 18:17:55.320343 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.327994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 159d69b7-a906-48a6-8ba6-ed1cf9b474ef does not exist Aug 30 18:17:55.327994 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-1ba9b6ab-7d05-4925-bd83-0af06df1a788'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:55.327994 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-356bfd59-4ed9-40f1-ad98-9fc0fbe5f2ef tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef" status: 404 len: 194 microversion: 2.1 time: 0.127599 Aug 30 18:17:55.327994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 836/1688] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-security-groups/159d69b7-a906-48a6-8ba6-ed1cf9b474ef => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:55.341187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566f3790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.343237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-05a3185a-f43b-4ddd-b950-ac0de3c72250 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:55.356170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-05a3185a-f43b-4ddd-b950-ac0de3c72250 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:55.392853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05a3185a-f43b-4ddd-b950-ac0de3c72250 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.099654 Aug 30 18:17:55.402580 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 853/1689] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:55 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:17:55.410268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-005be101-1727-43d5-863e-3bc68f8aaed4 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e56aef670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.417246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:55.418209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:55.419113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.419113 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad HTTP/1.1 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5e6ca4ae-b27b-4568-9cf1-f84fc7057dad'} Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:55.422786 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 5e6ca4ae-b27b-4568-9cf1-f84fc7057dad does not exist Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-10557373-bad0-4fa3-b6a3-daa3047bd5a2'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d980bdaa-6a01-4749-b085-0893fea6815b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad" status: 404 len: 194 microversion: 2.1 time: 0.095463 Aug 30 18:17:55.428462 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 837/1690] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-security-groups/5e6ca4ae-b27b-4568-9cf1-f84fc7057dad => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:55.447613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566d6d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.458433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-005be101-1727-43d5-863e-3bc68f8aaed4 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339574480" status: 202 len: 0 microversion: 2.1 time: 0.054456 Aug 30 18:17:55.459346 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 854/1691] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339574480 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:55.468875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.469877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:55.472085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:55.482196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:55.483363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:55.485384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:55.487116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:55.488036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:55.488672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:55.523768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:55.524379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:55.525196 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.525196 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 HTTP/1.1 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ce4f6ed1-3727-4a8a-beeb-ce0827f51a90'} Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:55.528327 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] Aug 30 18:17:55.533428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.537679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 does not exist Aug 30 18:17:55.537679 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-bf71e37b-59ff-4f1a-b622-c4295b1ead46'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:55.538973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c375d937-2dfc-40aa-9ebc-3585dc818af2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90" status: 404 len: 194 microversion: 2.1 time: 0.104712 Aug 30 18:17:55.540145 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 838/1692] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-security-groups/ce4f6ed1-3727-4a8a-beeb-ce0827f51a90 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:55.548802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e205299d-24e0-4590-8fc1-56049633da57", "tag": "ec8c3812-2bf8-407d-8304-923f91c32b3b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:55.574850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:55.575537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:55.576184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:55.605989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] Creating event network-changed:ec8c3812-2bf8-407d-8304-923f91c32b3b for instance e205299d-24e0-4590-8fc1-56049633da57 on n-h2-854119-10 Aug 30 18:17:55.615907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:55.624979 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4f8ec9a6-7520-41fd-9b9c-5f53c8034740 req-278da850-397c-482b-b02c-6cbbeab1fd54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082248 Aug 30 18:17:55.626975 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 839/1693] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:55.643843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72a2c85d-70d0-43b6-9424-2df5644c6cb2 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e566f6dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-842797202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB42aRGMieUs0N+v9e8hB7I530U79jRr0Ka7LPdpTLtQ3btbryznfeQPEcdvJ58msBGuqTy+qVHYUtIHQl6Qytpmi0oAWO01mac/oFtatjSjQH7lsg8D/L9kPaWympcdLg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:55.700921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-72a2c85d-70d0-43b6-9424-2df5644c6cb2 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:55.721015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-72a2c85d-70d0-43b6-9424-2df5644c6cb2 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:55.791025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72a2c85d-70d0-43b6-9424-2df5644c6cb2 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.159909 Aug 30 18:17:55.791875 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 840/1694] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:55.809984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566a31f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:55.912774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:55.913797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba not found {{(pid=122590) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:55.914452 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.914452 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba HTTP/1.1 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba'} Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:55.917036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] Aug 30 18:17:55.921984 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:55.925870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba does not exist Aug 30 18:17:55.925870 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-d9ac3cfe-7788-427e-97cb-0dcc8994721b'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:55.927064 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-da65c88d-13dd-481d-b7b7-06df83ece88e tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba" status: 404 len: 194 microversion: 2.1 time: 0.133718 Aug 30 18:17:55.927815 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 841/1695] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:55 2022] DELETE /compute/v2.1/os-security-groups/9b6b9f58-0f8a-43f4-8e0a-7bfac86a6bba => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:55.933754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-329336888", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2a276390-21e3-480e-8639-5bd55ca03773"}], "block_device_mapping_v2": [{"uuid": "bae3a044-44a8-4bad-be9f-b43a00210b8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:56.012814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] validate_networks() for [('2a276390-21e3-480e-8639-5bd55ca03773', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:56.097339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:56.106276 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebfcd365-6c09-423f-97cd-47abce1c98be tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.644976 Aug 30 18:17:56.106920 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 855/1696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:55 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:56.143248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39c676a3-01f5-4f03-8357-f29e3b4ad2ec tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e56aefaf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1488387351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGsiLwK9lRhtiQZITCeso5+fyLCQcJZDJDy9nDwxRiphza7EfoknghPIbOg1idUWjccaazzaBzo+lcUiJQA/wiiqwDoHc+nuBljTgSMHdDhj2JJWJ6vwoGdk2BqOdzxsA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:56.178587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-39c676a3-01f5-4f03-8357-f29e3b4ad2ec tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:56.196379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-39c676a3-01f5-4f03-8357-f29e3b4ad2ec tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:56.257723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39c676a3-01f5-4f03-8357-f29e3b4ad2ec tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.117708 Aug 30 18:17:56.259789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 856/1697] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:56.268689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:56.269565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:56.286735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:56.287719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:56.288896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:56.290053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:56.290725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:56.291479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:56.561491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:56.572992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ad0e290-45ba-4227-8799-6f4ebd1e5670 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.308518 Aug 30 18:17:56.573691 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 857/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:56 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:56.591300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56a9fdc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:56.671244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:56.671857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 97f2bf48-55a0-4e59-8744-2ef383a8872c not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:56.672393 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.672393 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c HTTP/1.1 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '97f2bf48-55a0-4e59-8744-2ef383a8872c'} Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:56.674260 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] Aug 30 18:17:56.679863 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:56.685788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 97f2bf48-55a0-4e59-8744-2ef383a8872c does not exist Aug 30 18:17:56.685788 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-226e2f44-edb1-4979-98bd-f9382a010858'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:56.685788 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7f32574-75f5-43da-88c4-c4443efc52f2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c" status: 404 len: 194 microversion: 2.1 time: 0.106798 Aug 30 18:17:56.685788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 858/1699] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:56 2022] DELETE /compute/v2.1/os-security-groups/97f2bf48-55a0-4e59-8744-2ef383a8872c => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:56.691609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:56.695743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:56.712831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:56.715939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:56.716694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:56.717670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:56.721692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:56.722762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:56.963571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:56.983279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd23b351-8b74-4ecb-b4b9-4ed06915ab5e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.292332 Aug 30 18:17:56.983968 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 859/1700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:56 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:57.017449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:57.018076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:57.027622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.028236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.028884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.031973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.032770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.033429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.289807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:57.291865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:57.292970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:57.293913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:57.294857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:57.319105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.320435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.321747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.323740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.324724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.325627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.343228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:57.359704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4023c727-21f0-4a02-a425-4920aa03a9e6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.372914 Aug 30 18:17:57.368850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:57.375194 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 860/1701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:56 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:57.383209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Getting quotas for user 6774c9dbc6b44018a09893dabeee643a and project 29f43bac114c41ed96e7c7d50864818b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:57.390406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-833b0ed9-ecb9-4ff6-a033-3d5e4e307080 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Action: 'create', calling method: .version_select at 0x7f4e56afd310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-284986293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFZQe6/93MKtepkPmPr5PNCx1IUm1iUEdsQCMij24nexMtlsRsuNBueBkZ1PCugcPoWdrmL7itgf88wpyQNsK7APSYV3P8srTg5vzoU6yv2zIY3p9167AyH1bmaCym2Hg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:57.411286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-833b0ed9-ecb9-4ff6-a033-3d5e4e307080 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:57.421386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-833b0ed9-ecb9-4ff6-a033-3d5e4e307080 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Getting quotas for user 2a25e05c96774edc9a89458fe5c77340 and project 521a71890a4845c6bab21a37bc119b21. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:57.453606 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-833b0ed9-ecb9-4ff6-a033-3d5e4e307080 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.077158 Aug 30 18:17:57.454278 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 861/1702] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:17:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:57.460520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56aef670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:57.487191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:17:57.488015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Neutron security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:17:57.488484 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.488484 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 HTTP/1.1 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '87bbd666-07e7-4165-a3d8-c6a7a05c3814'} Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:17:57.490392 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Security group 87bbd666-07e7-4165-a3d8-c6a7a05c3814 does not exist Aug 30 18:17:57.495704 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-f9cef7d9-c61a-48a0-ae4b-b30128611e25'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:57.504005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b12013f9-a3d0-47c3-9877-a52741f624d4 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814" status: 404 len: 194 microversion: 2.1 time: 0.041035 Aug 30 18:17:57.504005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 862/1703] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:17:57 2022] DELETE /compute/v2.1/os-security-groups/87bbd666-07e7-4165-a3d8-c6a7a05c3814 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:57.504200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:57.506047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:57.506750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bae3a044-44a8-4bad-be9f-b43a00210b8a',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:57.509005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:57.521367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.521367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.521898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.523127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.524064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.524901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.621935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:57.638759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c96fc21-8313-4bfc-9223-6f2bd8c3dc86 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 200 len: 1345 microversion: 2.1 time: 0.138510 Aug 30 18:17:57.640462 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 863/1704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:57 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 1345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:57.766705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9307a3d2-9070-425c-8103-4beb030dbf07 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.837462 Aug 30 18:17:57.768045 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 842/1705] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:17:57.781412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c96b9cfb-efad-4bc0-b42f-c3a141f0e8e0 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e566eb5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:57.790624 n-d-854119-10 devstack@n-api.service[122590]: WARNING oslo_db.sqlalchemy.utils [None req-c96b9cfb-efad-4bc0-b42f-c3a141f0e8e0 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 18:17:57.823889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c96b9cfb-efad-4bc0-b42f-c3a141f0e8e0 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.049848 Aug 30 18:17:57.830308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 843/1706] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:17:57 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:57.853742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:57.855441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:57.884882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.891620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.892534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.893714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:57.899597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:57.901445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:57.998455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-998211043", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "9ecd8175-6dbb-46cc-9a87-95abba4f6cf6"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:58.044460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:17:58.132467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] validate_networks() for [('9ecd8175-6dbb-46cc-9a87-95abba4f6cf6', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:17:58.230403 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe27a786-26bd-4a13-828f-26891ca8a0b3 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 204 len: 0 microversion: 2.1 time: 0.397836 Aug 30 18:17:58.231323 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 844/1707] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:17:57 2022] DELETE /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:17:58.237094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:58.238320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:58.241531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:17:58.264854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:58.265654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:58.266124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:58.267483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:58.267950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:58.268377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:58.519456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:58.531834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-89aab408-f5ed-4c53-8198-da3b2e206271 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.298934 Aug 30 18:17:58.532754 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 845/1708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:58 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:58.545043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c21033-4f8e-41fc-960b-065945bb00fd", "name": "network-vif-plugged", "status": "completed", "tag": "3d2ae2df-ebaa-4c87-bb4a-6594d383dd30"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:17:58.580828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:58.582313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:58.583399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:58.614692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] Creating event network-vif-plugged:3d2ae2df-ebaa-4c87-bb4a-6594d383dd30 for instance 43c21033-4f8e-41fc-960b-065945bb00fd on n-h2-854119-10 Aug 30 18:17:58.620738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bdf1d368-6270-44f9-91f0-a968c5e62299 req-206a8cd9-7cb1-45d8-90ec-1b7a03184ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086356 Aug 30 18:17:58.621518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 846/1709] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:17:58.628719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:58.630092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:58.716171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:58.735531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:58.740714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:58.743103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f16ad29b-5df7-4386-8755-a7b5d7684359 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1103 microversion: 2.25 time: 0.119413 Aug 30 18:17:58.745247 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 847/1710] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:17:58 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1103 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:17:58.755764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-009ede7f-9138-4b0f-a31d-e5cd645fc0f5 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e566a4b80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:58.812239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-009ede7f-9138-4b0f-a31d-e5cd645fc0f5 tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-284986293" status: 202 len: 0 microversion: 2.1 time: 0.064241 Aug 30 18:17:58.813673 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 848/1711] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-284986293 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:58.840460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:58.841225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:58.864994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:58.878133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:58.878632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:58.879411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:58.879883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:58.880316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.113728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:59.130184 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-300ec8dc-9be1-4a1b-8b7a-e3e39638952c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.313443 Aug 30 18:17:59.131283 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 849/1712] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:58 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:59.140691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:59.142704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:59.155001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.156351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.157489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.159481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.161128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.161917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.262521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:17:59.263630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:17:59.264607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:17:59.265623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:17:59.266987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:17:59.288205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.289204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.291063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.292466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.293199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.293841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.334520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:17:59.341208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for user fea7bfb1bebd47a7bf227b89a77fbc72 and project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:17:59.363636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:17:59.370131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:17:59.454559 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1eb3a1a-a277-4d7a-a2ab-4663d8e0f1aa tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812415 Aug 30 18:17:59.455968 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 864/1713] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:17:59.478942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:59.483925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:59.496306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.496957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.497473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.498589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.499165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.499708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.558209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:17:59.580199 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57ca611f-7992-462b-8f49-0585a2a66db2 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1647 microversion: 2.1 time: 0.446774 Aug 30 18:17:59.582643 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 850/1714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:59 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1647 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:17:59.599437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:59.600388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:59.615865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.618110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.619193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.620507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.621312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.622041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.653437 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 HTTP/1.1 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'dd03713e-44fd-497a-9cac-877b40926247'} Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:17:59.657505 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00c13d93-f7b9-4c06-b4a1-24056674f327 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 404 len: 111 microversion: 2.1 time: 0.075847 Aug 30 18:17:59.662844 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 851/1715] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:59 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:17:59.675698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c6d4ed8-5183-4ab6-9a48-91fd780e115b tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e566f3c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:59.728474 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c6d4ed8-5183-4ab6-9a48-91fd780e115b tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1488387351" status: 202 len: 0 microversion: 2.1 time: 0.057839 Aug 30 18:17:59.729864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 852/1716] 10.222.0.25 () {58 vars in 1278 bytes} [Tue Aug 30 18:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1488387351 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:17:59.759312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:17:59.760365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:17:59.821377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.824688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.825884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:17:59.828797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:17:59.830292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:17:59.836422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.071094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:00.094909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd68a905-4f14-44be-b0d2-5b3fce0a427c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.628548 Aug 30 18:18:00.095803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 865/1717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:59 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:00.111811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-200523430", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "9ecd8175-6dbb-46cc-9a87-95abba4f6cf6"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:00.240243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:00.250488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] validate_networks() for [('9ecd8175-6dbb-46cc-9a87-95abba4f6cf6', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:18:00.260240 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9fa4415-4620-483d-acf4-d7b5cb16be40 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1308 microversion: 2.1 time: 0.521708 Aug 30 18:18:00.261334 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 853/1718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:17:59 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:00.267399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6475bd00-1c03-445f-a9e8-49cd122539bc tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] Calling method '.version_select at 0x7f4e566a39d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:00.317961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6475bd00-1c03-445f-a9e8-49cd122539bc tempest-KeyPairsV2TestJSON-1886599380 tempest-KeyPairsV2TestJSON-1886599380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-842797202" status: 202 len: 0 microversion: 2.1 time: 0.047004 Aug 30 18:18:00.322246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 854/1719] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-842797202 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:18:00.345963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:00.348953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:00.366668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.368235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.373862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.377160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.377862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.381948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.548237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:00.565727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:00.573705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:00.575873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edef1b36-0946-4f83-966d-2db334f1a4f0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1232 microversion: 2.25 time: 0.252208 Aug 30 18:18:00.579945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 855/1720] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:00 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1232 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:00.593321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:00.606131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:00.623500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.627272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.628252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.631846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.634152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.634960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.667271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:00.669939 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247/os-volume_attachments HTTP/1.1 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': 'dd03713e-44fd-497a-9cac-877b40926247'} Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:18:00.678292 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8579cc4e-19ce-4b2e-b3a3-706dba456834 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103965 Aug 30 18:18:00.692489 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 856/1721] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:18:00 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247/os-volume_attachments => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:18:00.701365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:00.702033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:00.721223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.723397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.724686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:00.727346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:00.728913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:00.729967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:01.198882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:01.219591 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-764da753-3cd0-486b-a347-ef8ae3983a16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.529320 Aug 30 18:18:01.229964 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 857/1722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:00 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:01.239731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:01.240595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:01.257972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:01.259267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:01.260305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:01.261700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:01.262866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:01.265747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:01.454676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e6813fec5f4f4fb4e7a31d2ace5d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cf937841ce453fbbe4b18024234426', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:01.474367 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2125a270-a92f-4175-ab7a-615cc9102f1b tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 200 len: 1467 microversion: 2.1 time: 0.243075 Aug 30 18:18:01.479627 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 858/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:01 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 1467 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:01.493343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1040374222", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:01.593267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:18:01.863604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:18:01.864980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:18:01.866572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:18:01.867338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:18:01.867937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:18:01.886725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:01.887306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:01.888251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:01.889095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:01.889562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:01.889987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:01.932522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:01.945133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for user fea7bfb1bebd47a7bf227b89a77fbc72 and project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:01.967231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:18:01.971694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:18:02.054673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7cba1e8-55c9-4a61-b7f5-1679f920ee67 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956993 Aug 30 18:18:02.059047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 866/1724] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:18:02.093133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:02.093847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:02.104230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:02.107847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:02.109567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:02.111430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:02.112380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:02.115309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:02.797395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:02.814268 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a0b6669-e88a-4070-a651-1bdabd75407e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.752072 Aug 30 18:18:02.816156 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 867/1725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:02 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:02.833023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:02.834084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:02.846492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:02.846925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:02.847367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:02.848095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:02.854674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:02.855658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.309134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:03.321538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9be0d55f-67ff-474f-98b3-d891d20e3440 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1488 microversion: 2.1 time: 0.501397 Aug 30 18:18:03.324879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 868/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:02 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:03.331227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe353ac-e200-4f1e-8552-890b2bd14e58", "name": "network-vif-deleted", "tag": "1849ef43-2ba8-4321-a8a3-8b5e69532b14"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:03.356843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.357721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.358325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.366088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:18:03.366834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:18:03.367088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:18:03.367831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:18:03.368339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:18:03.394264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] Creating event network-vif-deleted:1849ef43-2ba8-4321-a8a3-8b5e69532b14 for instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 on n-h1-854119-10 Aug 30 18:18:03.408187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-56a0ec2d-46eb-4e50-96b3-2abf7f421e52 req-3c8d1dc5-5816-46a6-9199-4e4fb6063ed7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081681 Aug 30 18:18:03.414994 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 869/1727] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:03.422715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.423230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.423678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.424495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.430860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:03.431936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:03.432564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.433149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.449697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.451824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.453371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.456238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.459968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.460750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.531653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:03.557155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:03.613249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:18:03.621444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:18:03.777708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-492a27de-d5f8-4c92-a42c-7a08ff9cd8b1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.294115 Aug 30 18:18:03.788308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 859/1728] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:18:03.806929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:03.807593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:03.827890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.828419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.828886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:03.829893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:03.830105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:03.837417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:04.462633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:04.482816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:04.490573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:04.492551 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3eb1d150-413d-4030-a86c-0603587c68f3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1292 microversion: 2.25 time: 1.076023 Aug 30 18:18:04.494961 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 870/1729] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:03 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1292 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:04.535627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2036721447", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "451", "networks": [{"uuid": "9ecd8175-6dbb-46cc-9a87-95abba4f6cf6"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:04.640321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] validate_networks() for [('9ecd8175-6dbb-46cc-9a87-95abba4f6cf6', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:18:04.887050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:04.897373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23753ae5-81d0-437d-8856-674dd338cea1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 1.107471 Aug 30 18:18:04.904656 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 860/1730] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:03 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:04.912554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:04.917190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] [instance: 8fe353ac-e200-4f1e-8552-890b2bd14e58] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:04.934230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:04.935343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:04.936083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:04.937147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:04.939012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:04.941187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:04.979561 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] HTTP exception thrown: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Request method failure captured: Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 HTTP/1.1 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPLehZ24Lic5-R6uUlaZliZQn6FSn6bNGahz3Bhn7iLCweSAGzb-UKu3Ri2xFyIXcAmh1yRbXpxlaq4Dwf7mlWe7BoAdO2xGnZW2cNr1fjWgeZP3zbx5wZzyAH-qJDEPceNLgC8BQDUas2brnbJAo25B9ZYAMrmOdvIQgFqxJexLzI Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e4cf937841ce453fbbe4b18024234426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e4cf937841ce453fbbe4b18024234426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e4cf937841ce453fbbe4b18024234426 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-889707795 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: b4e6813fec5f4f4fb4e7a31d2ace5d64 Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupsTestJSON-889707795-project Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '8fe353ac-e200-4f1e-8552-890b2bd14e58'} Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:04.981730 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. Aug 30 18:18:04.986295 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:04.999232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Returning 404 to user: Instance 8fe353ac-e200-4f1e-8552-890b2bd14e58 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:18:05.000524 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e807db2e-1847-4271-b07a-913f25c177ba tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58" status: 404 len: 111 microversion: 2.1 time: 0.094408 Aug 30 18:18:05.001791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 861/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:04 2022] GET /compute/v2.1/servers/8fe353ac-e200-4f1e-8552-890b2bd14e58 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:18:05.007604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:05.009137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:05.022072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.029264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.030123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:05.031164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.031869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.032541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:05.540680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:05.553981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2e9ec0d-b81b-448e-bd1f-3a56a110c24b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1489 microversion: 2.1 time: 0.550480 Aug 30 18:18:05.565133 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 862/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:05 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1489 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:05.611680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:05.619451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:05.634242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.637255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.638187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:05.639424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.640014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.640460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:05.840141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:05.850927 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4765cf69-0174-4073-87e3-38ad82ba75ad tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1267 microversion: 2.1 time: 0.282453 Aug 30 18:18:05.852314 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 863/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:05 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:05.866863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:05.867832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:05.881369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.882509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.883826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:05.885203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:05.885997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:05.886857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.054257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:18:06.056180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:18:06.057278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:18:06.058034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:18:06.059256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:18:06.084075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.084581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.085138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.090136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.091837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.092312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.150917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:06.167989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Getting quotas for user fea7bfb1bebd47a7bf227b89a77fbc72 and project 89cfeb97afa342df912b046bea6023b8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:06.216039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:18:06.223014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:18:06.371559 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8fe1246-d660-4e23-b69f-b81a2285a086 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870100 Aug 30 18:18:06.374875 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 871/1734] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:18:06.388369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e205299d-24e0-4590-8fc1-56049633da57", "name": "network-vif-plugged", "status": "completed", "tag": "ec8c3812-2bf8-407d-8304-923f91c32b3b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:06.407646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.408440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.409151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.441067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] Creating event network-vif-plugged:ec8c3812-2bf8-407d-8304-923f91c32b3b for instance e205299d-24e0-4590-8fc1-56049633da57 on n-h2-854119-10 Aug 30 18:18:06.447749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cdecbbf7-534b-420e-a2a8-c5373f09fe68 req-37e9f2ae-c8e5-4fb9-8a60-f579b4b379aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071507 Aug 30 18:18:06.448370 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 872/1735] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:06.511052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:06.521183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0dc66b87-3133-489f-899b-52dc42c5fe82 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.667371 Aug 30 18:18:06.538385 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 864/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:05 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:06.562171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecb7ae40-7505-4de4-bf92-300987ad0da8 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e566eb5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:06.711689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:06.713475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.714470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.714913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.718993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.721602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.721988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.781290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbc2fe9d-a3e6-4d76-821a-e7566be1aa74 tempest-AZV2TestJSON-34965024 tempest-AZV2TestJSON-34965024-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.330465 Aug 30 18:18:06.782197 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 873/1737] 10.222.0.25 () {58 vars in 1164 bytes} [Tue Aug 30 18:18:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:18:06.788790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:06.790225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:06.798667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.799452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.800602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:06.802070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:06.802842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:06.803589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.138576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecb7ae40-7505-4de4-bf92-300987ad0da8 tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c488c214-7168-442b-866e-7dc1197844f0" status: 202 len: 0 microversion: 2.1 time: 0.608886 Aug 30 18:18:07.139390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 865/1738] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:18:06 2022] DELETE /compute/v2.1/os-security-groups/c488c214-7168-442b-866e-7dc1197844f0 => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:18:07.147828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:07.148411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:07.167142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.167962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.168740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.169717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.173970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.174746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.434918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:07.436454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:07.449961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5fc5588-96ad-4607-9ec4-a1cf7a8f93a7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1488 microversion: 2.1 time: 0.308734 Aug 30 18:18:07.450574 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 866/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:07 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1488 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:07.454402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:07.458041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:07.462705 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60f6f35d-7ed9-43e8-ad83-8ff2bc8f69c0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1292 microversion: 2.25 time: 0.678687 Aug 30 18:18:07.468739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089", "tag": "716b674d-8d47-4636-b179-8e863e4198be"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:07.475689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 874/1740] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:06 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1292 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:07.494031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:07.495340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:07.499926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.504930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:07.511246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.512433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.517159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.517979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.518620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.519646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.520612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.521783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.534221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] Creating event network-changed:716b674d-8d47-4636-b179-8e863e4198be for instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 on n-h1-854119-10 Aug 30 18:18:07.551017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-449fb404-48e4-4621-b109-7b5afe7e80aa req-71a38d02-1b58-4ef1-aec5-ef1252c340e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082308 Aug 30 18:18:07.565145 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 867/1741] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:07.569559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:18:07.585905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:07.589745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:07.609632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.610648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.611571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.612669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.613573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.615755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.750338 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84b25d6c-eb11-4d5d-9ecb-bd18b08ebe7e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 204 len: 0 microversion: 2.1 time: 0.272356 Aug 30 18:18:07.752056 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 875/1742] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:18:07 2022] DELETE /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:18:07.764594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:07.766740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:07.778067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.778988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.779639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:07.780601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:07.781280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:07.782030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.021574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:08.024298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:08.041066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ac84b67-20db-47e5-a8e2-487f6782c08f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1217 microversion: 2.1 time: 0.280226 Aug 30 18:18:08.041769 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 876/1743] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:07 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:08.052869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84fac24c-14dc-4e2c-be5f-f407a8d3623d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] Calling method '.version_select at 0x7f4e56bb6af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:08.057897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:08.079477 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7047228c-0766-4c67-8ad3-c2ffebc9b5be tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1310 microversion: 2.1 time: 0.510818 Aug 30 18:18:08.081028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 868/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:07 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1310 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:08.092431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:08.093608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:08.106060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.107120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.108254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.109643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.110563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.111421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.197148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:18:08.489966 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f463b1c4-e9b5-44c1-ac1a-dda6768003a5 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 204 len: 0 microversion: 2.1 time: 0.406172 Aug 30 18:18:08.491232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 869/1745] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:18:08 2022] DELETE /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:18:08.500199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:08.502601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:08.526719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.527659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.527824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.528533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.528999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.529420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.876508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:08.892156 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87af6352-a8c3-4537-9072-7365901ec80a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.398697 Aug 30 18:18:08.893287 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 870/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:08 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:08.906580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:08.908717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:08.932005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.932808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.933662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.934695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.935346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.935910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:08.939982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84fac24c-14dc-4e2c-be5f-f407a8d3623d tempest-SecurityGroupsTestJSON-889707795 tempest-SecurityGroupsTestJSON-889707795-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e4f78a89-0d73-4ba6-a85a-a2b1f2bc75e2" status: 202 len: 0 microversion: 2.1 time: 0.895861 Aug 30 18:18:08.944351 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 877/1747] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:18:08 2022] DELETE /compute/v2.1/os-security-groups/e4f78a89-0d73-4ba6-a85a-a2b1f2bc75e2 => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:18:08.949652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a70c470-7d78-4f95-b30f-8639054d5e6d", "tag": "5f9ad00e-1596-4afb-b44f-b698c81bff7e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:08.970604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:08.971587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:08.972197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.003023 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] Creating event network-changed:5f9ad00e-1596-4afb-b44f-b698c81bff7e for instance 1a70c470-7d78-4f95-b30f-8639054d5e6d on n-h2-854119-10 Aug 30 18:18:09.014066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-271861c7-8527-433f-8972-9e41e07b617b req-c5fbdafe-9ab6-4991-b8cf-d981f608dd8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068085 Aug 30 18:18:09.015066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 878/1748] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:09.026271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:09.028451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:09.044803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.045309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.045960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.054077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:09.055222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.055713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.056196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.070206 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c7d6f41-0c62-4ce3-a5ac-f7f407eabd34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1273 microversion: 2.1 time: 0.174223 Aug 30 18:18:09.083162 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 871/1749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:08 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:09.083162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:09.084132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:09.158913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.160290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.161354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.164967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.166790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.169066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.448322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:09.459430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb0e46ba-b381-435d-b615-ff891044c577 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1494 microversion: 2.1 time: 0.386580 Aug 30 18:18:09.475646 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 872/1750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:09 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1494 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:09.481933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:09.483015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:09.492445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.493234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.493902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.494880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.495814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.496461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.583179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:09.601454 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5b67daa-f39b-4cff-b270-fda4f29ac0ab tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1273 microversion: 2.1 time: 0.123768 Aug 30 18:18:09.602092 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 873/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:09 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:09.607128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:09.607733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:09.617345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.618550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.619680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.621618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:09.622885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:09.624691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:09.945860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:09.948696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:09.960669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa88d515-af2d-4eaf-8160-d7200b0a7480 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1492 microversion: 2.1 time: 0.357110 Aug 30 18:18:09.981102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:09.983027 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 874/1752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:09 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1492 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:09.993608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:09.997123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:09.999345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:10.000803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:10.014292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcb7c6d4-3b79-44da-b58d-d8b16ab54704 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1292 microversion: 2.25 time: 0.985781 Aug 30 18:18:10.017701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.021715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.024012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.024957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.025893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.027603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.035432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 879/1753] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:09 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1292 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:10.041355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:10.042450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:10.049552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.050494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.051173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.052491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.053291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.055010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.443812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:10.471238 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbc4bede-5c49-400f-bc3b-b79d68fa47c2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.486255 Aug 30 18:18:10.472794 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 875/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:09 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:10.497374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:10.498567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:10.523167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.524247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.524986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.526260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.528126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.529410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.805087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74a9479b-2497-4ade-ac42-6a304980cb70 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1645 microversion: 2.1 time: 0.767526 Aug 30 18:18:10.818404 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 880/1755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:10 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1645 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:10.837113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:10.838829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:10.848745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.849735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.850648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:10.851859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:10.852610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:10.853275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.512685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:11.525023 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-557849eb-b509-4759-ab40-d6af9961eb85 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 1.050581 Aug 30 18:18:11.528164 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 876/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:10 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:11.542021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:11.543733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:11.560868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.561765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.562098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.562910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.563564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.564216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.735758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:11.742995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:11.770319 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9c759f71-c4d3-49bb-8242-4b8aea4ab284 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1279 microversion: 2.1 time: 0.242516 Aug 30 18:18:11.771588 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2ab3242-036f-4d9d-8024-cddf95f111b6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1494 microversion: 2.1 time: 0.946173 Aug 30 18:18:11.772841 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 881/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:10 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1494 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:11.790412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:11.792562 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 877/1758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:11 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:11.794850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:11.810021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:11.812765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:11.824282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.824778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.825215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.825575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.825943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.826424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.826556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.826854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.827242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:11.828518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:11.829351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:11.830114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.407386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:12.417246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:12.425718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:12.427691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4bed479e-9d15-448b-9a38-2bd29d8d4607 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.633371 Aug 30 18:18:12.443437 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 878/1759] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:11 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:12.443437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:12.443437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:12.458047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.458662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.459368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.460369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.461205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.461812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.518538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d68781d-b650-47d9-a229-6a628eb89e0f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1645 microversion: 2.1 time: 0.742871 Aug 30 18:18:12.520008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 882/1760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:11 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1645 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:12.528120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c21033-4f8e-41fc-960b-065945bb00fd", "name": "network-vif-deleted", "tag": "3d2ae2df-ebaa-4c87-bb4a-6594d383dd30"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:12.541115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.541894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.542594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.558312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] Creating event network-vif-deleted:3d2ae2df-ebaa-4c87-bb4a-6594d383dd30 for instance 43c21033-4f8e-41fc-960b-065945bb00fd on n-h2-854119-10 Aug 30 18:18:12.565516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-25b12753-d9a8-4045-ae6c-573378c7c402 req-75c2a219-d699-4d47-949b-736c82bb20b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Aug 30 18:18:12.566964 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 883/1761] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:12.573630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:12.577980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.578514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.578963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.579725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.580176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.580811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.616565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edb7fc0d-cf00-40ea-8ada-91d34d438843 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.048191 Aug 30 18:18:12.617459 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 884/1762] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:18:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:12.623134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:12.624130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:12.632864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.633756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.634506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:12.635967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:12.636737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:12.637506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.144366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:13.156210 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abb6925c-f047-4af8-ac03-f7e29c10e66e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.718704 Aug 30 18:18:13.156822 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 879/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:12 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:13.174781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:13.175880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:13.184311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.185298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.186028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.187737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.188852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.189293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.260841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:13.273435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66d59f2f-02df-4760-b71d-78985f729b30 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.654649 Aug 30 18:18:13.289645 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 885/1764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:12 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:13.296428 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a46d1b74-fc6b-492e-9243-2cb89bcf5be2 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57/action" status: 202 len: 0 microversion: 2.1 time: 0.125332 Aug 30 18:18:13.297155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:13.298058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:13.300469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 880/1765] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:18:13 2022] POST /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:18:13.313817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.315349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.316868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:13.317208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.317620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:13.318898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.320449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.321630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.332813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.338812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.339669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.343276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.344061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.344734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.420870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:13.424891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.425613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.426250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.427112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lazy-loading 'fault' on Instance uuid 43c21033-4f8e-41fc-960b-065945bb00fd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:18:13.470312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:13.490297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:13.505254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:13.516973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8bb98da1-9b4c-4c76-a8eb-1b8a79017794 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 200 len: 1298 microversion: 2.1 time: 0.214631 Aug 30 18:18:13.518287 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 881/1766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:13 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 1298 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:13.524526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4", "tag": "977a737b-f17a-4418-a601-8c9175757e80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:13.529239 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6d3042d-9175-48fb-90fb-e92f8daf09b0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1279 microversion: 2.1 time: 0.237396 Aug 30 18:18:13.537745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.539215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.539908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.554979 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 886/1767] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:13 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:13.558526 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] Creating event network-changed:977a737b-f17a-4418-a601-8c9175757e80 for instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 on n-h1-854119-10 Aug 30 18:18:13.566478 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cfcfbc2a-a5fe-4d83-b2c9-4490b4871918 req-701aefd5-6db4-4541-b180-02d0afb7da14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046556 Aug 30 18:18:13.566995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:13.568447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:13.570761 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 882/1768] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:13.580523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.581739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.582381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.583511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.584563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.585376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.597081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:13.597797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:13.623206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=26 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:13.630125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.630929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.631275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:13.632202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:13.632701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:13.633129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.023643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:14.045063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:14.047430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:14.049369 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16f476c6-1315-4436-81fb-e5f7b6411870 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.477236 Aug 30 18:18:14.050202 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 883/1769] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:13 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:14.179248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:14.181982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:14.203007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.208250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.209200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.229155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.232930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.233560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.239280 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d64d83f-ab8a-4bd0-b816-166bfc01f193 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1650 microversion: 2.1 time: 0.682648 Aug 30 18:18:14.240474 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 887/1770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:13 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1650 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:14.300771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:14.301895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:14.324551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.333471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.333931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.343579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.344169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.344623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.815133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:14.825201 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a4bf630-aafb-430f-94df-48aabf459694 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.650720 Aug 30 18:18:14.827328 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 884/1771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:14 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:14.832483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:14.833469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:14.848471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.849603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.850472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.852188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.852961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.853903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.872087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd HTTP/1.1 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '43c21033-4f8e-41fc-960b-065945bb00fd'} Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:14.874234 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:18:14.879202 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:18:14.882897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:18:14.884393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e98a02ec-56f3-46d1-b697-5fa28c4224d1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 404 len: 111 microversion: 2.1 time: 0.055764 Aug 30 18:18:14.885653 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 885/1772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:14 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:18:14.891100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:14.892294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:14.902052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.903029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.903708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:14.904690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:14.905372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:14.906024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.205615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:15.229281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c1bb694-805e-4ae6-9a55-202d3a170151 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.931500 Aug 30 18:18:15.230967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 888/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:14 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:15.243090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:15.244158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:15.257524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.258724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.260110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.261299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.262048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.262774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.310903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:18:15.451356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:15.470329 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f9f96dc-970a-4ca3-9589-9469e9b22951 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.581670 Aug 30 18:18:15.471710 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 886/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:14 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:15.484678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:15.485757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:15.497690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c34fc979-3fc3-4112-a5b3-e84042b6b396 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 204 len: 0 microversion: 2.1 time: 0.264604 Aug 30 18:18:15.498928 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 889/1775] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:18:15 2022] DELETE /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:18:15.505513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.506719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.507527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.510562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:15.511479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:15.515317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.516889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.517830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.521792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.523149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.523641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:15.524479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:15.525033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:15.525766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.199084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=38 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:16.258419 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0c8bbf4a-b1f4-4281-85a6-de208380d8f3 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1630 microversion: 2.1 time: 0.755523 Aug 30 18:18:16.259798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 890/1776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:15 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1630 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:16.269496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:16.271071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:16.284377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.285780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.286849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.288724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.289848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.290915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.366743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:16.377119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:16.379659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:16.382430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4480f590-9223-483b-9b5a-455a8f82533b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.908005 Aug 30 18:18:16.384000 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 887/1777] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:15 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:16.403065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:16.405262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:16.430116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.431407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.432401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.435441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.436118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.436814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.772704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:16.781802 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99918db0-d3d6-4d91-bbc8-c85a176e9260 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1495 microversion: 2.1 time: 0.520079 Aug 30 18:18:16.788003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 891/1778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:16 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1495 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:16.804974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a70c470-7d78-4f95-b30f-8639054d5e6d", "name": "network-vif-plugged", "status": "completed", "tag": "5f9ad00e-1596-4afb-b44f-b698c81bff7e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:16.816008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.816817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.817413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.831762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] Creating event network-vif-plugged:5f9ad00e-1596-4afb-b44f-b698c81bff7e for instance 1a70c470-7d78-4f95-b30f-8639054d5e6d on n-h2-854119-10 Aug 30 18:18:16.838303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-472a03fd-0ae2-4c7b-8248-e661f23b89e9 req-3432e66d-42f2-441e-afda-7bcc2e260761 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048084 Aug 30 18:18:16.839561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 892/1779] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:16.845945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66aea12a-c124-473d-a154-1b6a5a61cfe8", "tag": "d49b28ad-3c0e-445e-8981-54c665653d24"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:16.857532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.858377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.858986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.865433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:16.873037 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] Creating event network-changed:d49b28ad-3c0e-445e-8981-54c665653d24 for instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 on n-h2-854119-10 Aug 30 18:18:16.885290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2894721b-2a4c-49c0-a2b2-f9c7d88ec83f req-aa4c54a3-fab3-483f-952f-143103cf0aef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044014 Aug 30 18:18:16.886241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 893/1780] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:16.892832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:16.893888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:16.901659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.902546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.903166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.904085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.904885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.905621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.919998 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7da8cac4-7688-4f03-97fc-4c390e0f7e58 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1498 microversion: 2.1 time: 0.518608 Aug 30 18:18:16.934792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 888/1781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:16 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1498 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:16.940260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": true, "disk_over_commit": false}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:16.944228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:16.960991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.962171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.962844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:16.965389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:16.967410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:16.968651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:17.051444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lazy-loading 'flavor' on Instance uuid e205299d-24e0-4590-8fc1-56049633da57 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:18:17.093244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:18:17.212338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:17.652205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:17.661268 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bc75a8e-0157-4cf7-9757-5befadca878e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.773392 Aug 30 18:18:17.676285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 894/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:16 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:17.683543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:17.684519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:17.691740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:17.692333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:17.693061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:17.694839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:17.695352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:17.695790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:18.398333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:18.407039 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a990f69e-b3e6-433d-b8ef-e0b50ebe159d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.729465 Aug 30 18:18:18.426446 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 895/1783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:17 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:18.432308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252ca05b-b434-4391-b93d-af5c4cd29425", "tag": "883f528f-d73b-455b-a484-3f46be46fff1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:18.468771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:18.469657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:18.470398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:18.473756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:18.503734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] Creating event network-changed:883f528f-d73b-455b-a484-3f46be46fff1 for instance 252ca05b-b434-4391-b93d-af5c4cd29425 on n-h2-854119-10 Aug 30 18:18:18.530714 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-23b81e18-38b5-4a50-9ff9-d025efaa9ebd req-c8776322-8f38-45ff-a606-44b15a36d4bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101507 Aug 30 18:18:18.535765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 896/1784] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:18.552034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:18.553114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:18.599820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:18.606665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:18.608777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:18.610755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:18.613563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:18.615390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:19.981934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:19.995413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:19.999294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:20.003853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7599e48a-3a43-4a8a-bbc5-8ff993d62104 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 1.464098 Aug 30 18:18:20.005515 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 897/1785] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:18 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:20.016277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:20.019516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:20.045065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:20.045750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:20.048571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:20.057137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:20.058085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:20.064248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:20.996020 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99a33a6e-ab4a-4393-a115-ed4704d640f6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57/action" status: 202 len: 0 microversion: 2.1 time: 4.059646 Aug 30 18:18:20.997790 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 889/1786] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:18:16 2022] POST /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57/action => generated 0 bytes in 4062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:18:21.005423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:21.008455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:21.033482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:21.038021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:21.040566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:21.042828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:21.046483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:21.049395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:21.374668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:21.386635 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2539a80e-a74f-4d27-b3ea-69e2c900553b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 200 len: 1495 microversion: 2.1 time: 1.377657 Aug 30 18:18:21.403903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 898/1787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:20 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 1495 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:21.416463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:21.420817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:21.438733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:21.445782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:21.447103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:21.451585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:21.452882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:21.455484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.027044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:22.047621 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f0c788b-592c-48ea-8e8a-d3bb0234f8cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.634929 Aug 30 18:18:22.048990 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 899/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:21 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:22.067519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:22.070797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:22.087798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.088067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:22.088562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.089190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.090436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.091500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.092464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.108349 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9f7f51b-8898-4cf1-8bd5-bfa21d942293 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 200 len: 1475 microversion: 2.1 time: 1.108809 Aug 30 18:18:22.108940 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 890/1789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:20 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 1475 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:22.114250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:22.114897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:22.132710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.133204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.133643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.134399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.134862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.135276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.587499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:22.680743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:22.690897 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c558ff5e-bf79-4a0d-9c0f-54077e589615 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.639862 Aug 30 18:18:22.699371 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 900/1790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:22 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:22.712958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:22.714592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:22.730643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.731130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.733925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:22.734803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:22.735282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:22.735712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.026945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:23.049078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65e46976-64d0-4eb4-8061-3674e7c2c7f6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 0.938900 Aug 30 18:18:23.068968 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 891/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:22 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:23.089831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5ff321-27d6-415c-847d-c1e590ac57f8", "name": "network-vif-deleted", "tag": "b5e5abb9-295d-4a42-a649-2978a4ed8c7d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:23.104954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.105957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.107945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.132192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] Creating event network-vif-deleted:b5e5abb9-295d-4a42-a649-2978a4ed8c7d for instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 on n-h2-854119-10 Aug 30 18:18:23.142690 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c7b9323c-f867-49dd-af22-c4b99eb68c4e req-6018a8e0-08e6-4138-bd3c-2e215a5b6f98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071820 Aug 30 18:18:23.144097 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 892/1792] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:23.152986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-118444825"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:23.156282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:23.181256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.182772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.183940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.185519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.186254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.186969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.618257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:23.662073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:23.667963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:23.676606 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-494e08ea-6f14-4ccb-901f-3ad564033962 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.975628 Aug 30 18:18:23.679863 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 901/1793] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:22 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:23.688152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:23.689754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:23.708190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.712289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.713501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.715598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.716729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.719686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.775020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 HTTP/1.1 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7e5ff321-27d6-415c-847d-c1e590ac57f8'} Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:23.777800 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:18:23.783661 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:23.786104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:18:23.790624 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a0c9513-665a-47a9-9d95-eb7578458c27 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 404 len: 111 microversion: 2.1 time: 0.107020 Aug 30 18:18:23.793332 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 902/1794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:23 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:18:23.811797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:23.815743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:23.842517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.843267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.843891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.844944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.848619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.851341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.867838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-494c7c1b-b330-48b5-84ac-49a35e09cf3c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1/action" status: 202 len: 0 microversion: 2.1 time: 0.719268 Aug 30 18:18:23.877473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 893/1795] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:18:23 2022] POST /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:18:23.890718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:23.904144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:23.933328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.941432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.947922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:23.955717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:23.958590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:23.966718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:24.448154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:24.462647 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c5eeb6f-33cb-4f34-960f-9befd4f8e7ec tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.664553 Aug 30 18:18:24.479388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 903/1796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:23 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:24.500643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-838ba4c2-f884-4973-a302-00f032ddcf15 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56ab0b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:24.680749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-838ba4c2-f884-4973-a302-00f032ddcf15 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.186695 Aug 30 18:18:24.683662 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 904/1797] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:24 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:24.693907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:24.698880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-684501063", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:24.709570 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a42be932-1d46-4084-b273-7da4fe1a9dbc tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.828990 Aug 30 18:18:24.723017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 894/1798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:23 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:24.728081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:24.728695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:24.752093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:24.752554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:24.752992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:24.753724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:24.754177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:24.754691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:24.868478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:18:25.470387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:25.519839 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-985b6645-712e-4d5b-92a9-495d6520187b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 0.779729 Aug 30 18:18:25.523801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 895/1799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:24 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:25.549417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:25.564816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:25.589503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:25.590278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:25.610533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:25.611920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:25.612632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:25.613251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.097657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:26.108555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:26.110430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:26.112169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9d5c5ff-8ca3-4f08-b44b-22fc29806c51 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.586426 Aug 30 18:18:26.113295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 896/1800] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:25 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:26.119755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4", "name": "network-vif-plugged", "status": "completed", "tag": "977a737b-f17a-4418-a601-8c9175757e80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:26.130337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:26.131136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:26.131818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.155207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] Creating event network-vif-plugged:977a737b-f17a-4418-a601-8c9175757e80 for instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 on n-h1-854119-10 Aug 30 18:18:26.161031 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0bc3e0c2-5fa7-40be-ab1d-a5da1f62e67f req-0d9485f0-3952-4d56-87b0-f2d14024d711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046242 Aug 30 18:18:26.162067 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 897/1801] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:26.168942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:26.170185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:26.177897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:26.178954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:26.180084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.181012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:26.181647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:26.182235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.843532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:18:26.844155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:18:26.844732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:18:26.845257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:18:26.845767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:18:26.865932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:26.867992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:26.868574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.869513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:26.871076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:26.871743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:26.904082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:26.909765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:26.927157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:18:26.931060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:18:26.971708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:26.995382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd2dcf45-7af2-4963-a1de-d38b0958ff93 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.308581 Aug 30 18:18:26.996995 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 905/1802] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:18:27.004275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e205299d-24e0-4590-8fc1-56049633da57", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8c3812-2bf8-407d-8304-923f91c32b3b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:27.015762 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61320e3f-4411-41ae-b4d5-da452926aec6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.851482 Aug 30 18:18:27.016655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 898/1803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:26 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:27.021785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.022844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.024115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.086694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] Creating event network-vif-unplugged:ec8c3812-2bf8-407d-8304-923f91c32b3b for instance e205299d-24e0-4590-8fc1-56049633da57 on n-h2-854119-10 Aug 30 18:18:27.098935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9cc18ecd-ddf3-4ada-8917-2d8104864d32 req-1e5cc92b-0ac9-4ace-aec6-637f9e892dc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100023 Aug 30 18:18:27.099743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa5b0aa3-f45f-467d-9d4d-66d050b882eb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56609af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:27.113075 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 906/1804] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:27.119055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:27.120085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:27.138169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.138914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.155051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.155821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.156576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.158497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.232895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa5b0aa3-f45f-467d-9d4d-66d050b882eb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.170750 Aug 30 18:18:27.233515 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 899/1805] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:27 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:27.281011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:27.284089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:27.348131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.349100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.352297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.357606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.360406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.362525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.486676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:27.509889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcc98507-bfc8-4677-93b9-d6ec715ab601 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.391463 Aug 30 18:18:27.510886 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 907/1806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:27 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:27.516034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c99f669e-5448-4199-b1fd-f56b4b601673 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:27.516659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c99f669e-5448-4199-b1fd-f56b4b601673 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:27.612780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c99f669e-5448-4199-b1fd-f56b4b601673 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:27.623072 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c99f669e-5448-4199-b1fd-f56b4b601673 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1208 microversion: 2.1 time: 0.110512 Aug 30 18:18:27.629891 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 908/1807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:27 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1208 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:27.635254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:27.635829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:27.654529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.655174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.656484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:27.658777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:27.659787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:27.660492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.121662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:28.143309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:28.147816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:28.153251 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62b05f8a-ca62-409a-8507-0b19e9428ec5 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.518818 Aug 30 18:18:28.154815 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 909/1808] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:27 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:28.175038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:28.176128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:28.189534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.190544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.193318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.195286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.196331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.197022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.359669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:28.386325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e2cdbc4e-1b84-494d-9134-f9ad1c63c818 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 1.147332 Aug 30 18:18:28.395999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 900/1809] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:27 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:28.426041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e5c5ed7-ada8-4fb9-afef-7d250c813b3a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566d6550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:28.535832 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e5c5ed7-ada8-4fb9-afef-7d250c813b3a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.133812 Aug 30 18:18:28.536799 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 901/1810] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:28 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:28.578062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aea12a-c124-473d-a154-1b6a5a61cfe8", "name": "network-vif-plugged", "status": "completed", "tag": "d49b28ad-3c0e-445e-8981-54c665653d24"}, {"server_uuid": "2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089", "name": "network-vif-plugged", "status": "completed", "tag": "716b674d-8d47-4636-b179-8e863e4198be"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:28.595392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:28.608154 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed2a47a5-da5e-4025-937b-cd458edf9edb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.447535 Aug 30 18:18:28.613500 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 910/1811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:28 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:28.619314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:28.620443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:28.627600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.634139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.634894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.635051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.635978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.636154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.637406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.638013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.641480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.683310 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Creating event network-vif-plugged:d49b28ad-3c0e-445e-8981-54c665653d24 for instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 on n-h2-854119-10 Aug 30 18:18:28.685254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] Creating event network-vif-plugged:716b674d-8d47-4636-b179-8e863e4198be for instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 on n-h1-854119-10 Aug 30 18:18:28.717287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f3126975-93ad-40ac-acbc-f5047c1712da req-e290d917-3e79-44ac-8526-3aef11fc600b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.173457 Aug 30 18:18:28.720988 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 902/1812] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:28.761692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:28.768370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:28.791332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.793069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.794495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:28.797259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:28.813456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:28.818275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.158882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:29.169793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eaea0b51-b0da-49ae-b89a-d12ca1674384 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.554774 Aug 30 18:18:29.171431 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 911/1813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:28 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:29.186984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e205299d-24e0-4590-8fc1-56049633da57", "tag": "ec8c3812-2bf8-407d-8304-923f91c32b3b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:29.187954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:29.209798 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6e5b8bd1-cb03-4fb5-9479-f3a56f6501c6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1212 microversion: 2.1 time: 0.485107 Aug 30 18:18:29.212477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 903/1814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:28 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1212 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:29.215448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:29.221287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:29.225033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:29.226158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.251330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:29.252243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:29.278988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:29.279897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:29.280767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.281789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:29.286966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:29.287904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.303852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] Creating event network-changed:ec8c3812-2bf8-407d-8304-923f91c32b3b for instance e205299d-24e0-4590-8fc1-56049633da57 on n-h2-854119-10 Aug 30 18:18:29.327166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a84dcc4c-dbed-4f4f-a08d-a63e0490e63f req-c6b80019-cda1-47de-8929-678d75386b76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149297 Aug 30 18:18:29.332212 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 912/1815] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:29.430403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:29.437932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:29.471522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:29.476581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:29.480381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.483925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:29.486020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:29.500842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:29.873423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:29.911550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:29.913792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:29.915781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a916617-65b9-433c-997b-beca767bebf3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1280 microversion: 2.25 time: 0.696032 Aug 30 18:18:29.916811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 904/1816] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:29 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1280 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:29.924008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6467f394-964b-4635-85d4-1b0b62b46f95 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e569833a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:30.018712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6467f394-964b-4635-85d4-1b0b62b46f95 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.099731 Aug 30 18:18:30.019935 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 905/1817] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:29 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:30.029331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:30.030376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:30.047636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.048616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.049646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:30.052194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.054266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.055304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:30.655246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:30.671273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4eb1e505-498c-45dc-8f4c-0bc17e943c6b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.649546 Aug 30 18:18:30.675602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:30.679138 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 906/1818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:30 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:30.698119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:30.699122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:30.719061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.721752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.722610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:30.723670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.724335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.725061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:30.743149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89194ff8-0944-4c61-bee3-312d90208ccc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 1.311739 Aug 30 18:18:30.755528 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 913/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:29 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:30.768110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:30.771034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:30.795846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.810999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.811823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:30.816318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:30.822445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:30.831303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:31.119764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:31.131409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4fe8898-4c81-4fbc-a75e-d1c8c330cb49 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1260 microversion: 2.1 time: 0.384588 Aug 30 18:18:31.147367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 914/1820] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:30 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1260 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:31.161599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:31.161599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:31.172048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:31.182328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:31.182925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:31.183847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:31.184445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:31.184945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:31.550525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:31.582393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fadaa632-9fb4-462e-ab11-1c294998b1c2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 0.901267 Aug 30 18:18:31.583212 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 907/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:30 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:31.608396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b62eafc-1956-4544-bc63-6003c85ea815 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56609c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:31.772467 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b62eafc-1956-4544-bc63-6003c85ea815 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.187511 Aug 30 18:18:31.787088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 908/1822] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:31 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:31.796922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:31.801927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:31.825124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:31.826476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:31.827489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:31.829077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:31.830188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:31.831599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:32.115951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:32.128080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:32.129482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:32.139075 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-121ae20b-50df-4ec4-99f0-03b0b91b940e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1476 microversion: 2.25 time: 0.982174 Aug 30 18:18:32.139749 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 915/1823] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:31 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1476 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:32.154659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:32.155598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:32.176317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:32.177165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:32.178015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:32.180617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:32.181488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:32.182102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:32.558874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:32.576409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50e35ece-534d-429c-805b-ffafc7f641de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1315 microversion: 2.1 time: 0.782067 Aug 30 18:18:32.579055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 909/1824] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:31 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:32.867954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:32.880729 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b4c0f01-4648-4491-badc-3e3b583fe71b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 0.736558 Aug 30 18:18:32.890531 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 916/1825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:32 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:32.903593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:32.906442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:32.931659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:32.932471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:32.933825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:32.935002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:32.935852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:32.936604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:33.129198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:33.132690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:33.155660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:33.156166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:33.159258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:33.161396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:33.161934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:33.162456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:33.219280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:33.243812 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c30b568c-fca5-4d29-84f1-3966ce4ff595 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1266 microversion: 2.1 time: 0.347877 Aug 30 18:18:33.245487 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 917/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:32 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:33.283491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252ca05b-b434-4391-b93d-af5c4cd29425", "name": "network-vif-plugged", "status": "completed", "tag": "883f528f-d73b-455b-a484-3f46be46fff1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:33.310735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:33.312556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:33.313348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:33.324202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:33.361451 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] Creating event network-vif-plugged:883f528f-d73b-455b-a484-3f46be46fff1 for instance 252ca05b-b434-4391-b93d-af5c4cd29425 on n-h2-854119-10 Aug 30 18:18:33.376313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-90ab18a7-3d22-4be8-b59b-5a894e21ce69 req-4f2dfd48-1795-44ac-9b13-6c54d6effcd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124767 Aug 30 18:18:33.380860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 918/1827] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:33.398798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:33.403422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:33.440313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:33.441638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:33.443327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:33.444852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:33.448219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:33.450290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:34.404199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:34.420645 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96665c1c-cbdb-4869-907b-5028574dd429 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1321 microversion: 2.1 time: 1.033543 Aug 30 18:18:34.424067 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 919/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:33 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1321 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:34.449171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5a950de-10cf-41b8-9406-a8d3aa0cfd25 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56b71dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:34.486625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:34.510287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:18:34.606273 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5a950de-10cf-41b8-9406-a8d3aa0cfd25 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.180632 Aug 30 18:18:34.609682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 920/1829] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:34 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:34.627838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18fb0feb-1d8c-4bdb-9225-81f3acae5777 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1970 microversion: 2.25 time: 2.017608 Aug 30 18:18:34.644043 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 910/1830] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:32 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1970 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:34.653456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:34.659378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aea12a-c124-473d-a154-1b6a5a61cfe8", "name": "network-vif-deleted", "tag": "d49b28ad-3c0e-445e-8981-54c665653d24"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:34.660488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:34.693724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:34.699569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:34.700054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:34.704369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:34.706909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:34.707552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:34.709647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:34.712399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:34.714492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:34.768455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] Creating event network-vif-deleted:d49b28ad-3c0e-445e-8981-54c665653d24 for instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 on n-h2-854119-10 Aug 30 18:18:34.803160 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-af6fb234-94b0-462c-93bb-246342b31c62 req-c3c7eca0-7ee0-4f0a-b397-01c704734819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150832 Aug 30 18:18:34.810876 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 911/1831] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:34.840291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:34.844345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:34.889155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:34.890431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:34.891141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:34.892590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:34.895151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:34.895901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:35.714994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:35.748071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8e0ade8-8a07-4cce-b0ea-fc2074dea42e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1294 microversion: 2.1 time: 1.134280 Aug 30 18:18:35.758675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 921/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:34 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1294 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:35.774827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:35.776079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:35.796581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:35.797463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:35.798125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:35.799157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:35.800161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:35.801024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:35.998923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:36.018831 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1912fa22-73f1-41f0-8546-1c8bffd50185 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 1.205566 Aug 30 18:18:36.051175 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 912/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:34 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:36.084055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:36.092939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:36.113489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:36.116522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:36.117213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:36.119781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:36.122109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:36.124661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:36.307344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:36.323805 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8957f2d-a8a7-404a-805f-40a92b8e9317 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 0.563407 Aug 30 18:18:36.324610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 922/1834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:35 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:36.348695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:36.349712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:36.365239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:36.369175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:36.369736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:36.370903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:36.371394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:36.371887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:36.891788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:37.075070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:37.102782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f123ea7d-0406-40de-997d-b2ead9ce54dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1512 microversion: 2.1 time: 0.776820 Aug 30 18:18:37.104776 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 923/1835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:36 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1512 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:37.123462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1", "name": "network-vif-plugged", "status": "completed", "tag": "2759ed98-d63a-42f4-b804-bf659c5fbac7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:37.227001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:37.227830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:37.228545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:37.304180 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] Creating event network-vif-plugged:2759ed98-d63a-42f4-b804-bf659c5fbac7 for instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 on n-h1-854119-10 Aug 30 18:18:37.330905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b5285c90-1f26-4e1f-970f-1820fa197466 req-372f91ba-f824-44a9-9a00-2383d2f83e56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223493 Aug 30 18:18:37.332444 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 924/1836] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:37.372478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba9e91b9-258b-4f4a-a4a5-5cefbaa8ded7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56ebdb80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:37.490149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba9e91b9-258b-4f4a-a4a5-5cefbaa8ded7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.155742 Aug 30 18:18:37.491203 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 925/1837] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:37 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:37.512348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:37.516073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:37.545746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:37.547052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:37.550485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:37.551599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:37.553465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:37.555743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:37.597150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:18:37.627974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:37.685102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c18f105-f9b5-4e4b-a59e-cbc98c9f7b6c tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1970 microversion: 2.25 time: 1.631649 Aug 30 18:18:37.709592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 913/1838] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:36 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1970 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:37.733899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:37.734977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:37.801835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:37.806993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:37.807920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:37.817877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:37.824315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:37.825256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:38.027692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:38.070994 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96fe564b-a059-4ac6-baa0-65d6fb4537ac tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 200 len: 1294 microversion: 2.1 time: 0.560973 Aug 30 18:18:38.072143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 926/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:37 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 1294 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:38.098273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:38.114279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:38.153769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:38.159395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:38.163191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:38.182299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:38.186138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:38.189511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.127601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:39.145210 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0572e7fd-dadd-40b8-9808-6a7811dd11df tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1511 microversion: 2.1 time: 1.067873 Aug 30 18:18:39.162116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 927/1840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:38 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1511 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:39.168983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:39.170116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:39.178379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.179387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.180365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.181311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.181983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.182938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.625135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:39.654508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a50a11a9-de27-4895-b9a1-8b412a650b01 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 0.490490 Aug 30 18:18:39.663201 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 928/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:39 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:39.690199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:39.703088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.704319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.707637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.718625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.720244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.723062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.754269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:39.763087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b126732d-a16c-4ea9-b6ff-6423d0e0c2cd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1502 microversion: 2.1 time: 2.051533 Aug 30 18:18:39.773868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 914/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:37 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1502 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:39.814494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2da58752-b972-497a-b973-27c0b5bf6848 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56617430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:39.846036 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e677ec9e-1b6d-4250-ad61-a19dbf1382ad tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.160945 Aug 30 18:18:39.847500 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 929/1843] 10.222.0.25 () {60 vars in 1217 bytes} [Tue Aug 30 18:18:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:18:39.919279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:39.919279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:39.953454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.953870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.970495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:39.972454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:39.972454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:39.972454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:40.052025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2da58752-b972-497a-b973-27c0b5bf6848 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.273751 Aug 30 18:18:40.056942 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 915/1844] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:39 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:40.093580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:40.094217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:40.119159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 HTTP/1.1 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '66aea12a-c124-473d-a154-1b6a5a61cfe8'} Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:18:40.124520 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:18:40.141759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:40.144892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:40.146330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43c0349f-5b0c-4d69-bd0e-e2a9b1331a41 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 404 len: 111 microversion: 2.1 time: 0.242858 Aug 30 18:18:40.146330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 930/1845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:39 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:18:40.162664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-10", "block_migration": "auto"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:40.172623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:40.202686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:40.207007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:40.207866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:40.210687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:40.215045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:40.215869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:40.386889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'flavor' on Instance uuid 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:18:40.427077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Going to try to live migrate instance to n-h2-854119-10 {{(pid=122589) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:18:41.033413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:41.050315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3737f77d-ed04-41b0-9160-76616fa3a108 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1511 microversion: 2.1 time: 0.989967 Aug 30 18:18:41.052623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 916/1846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:40 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1511 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:41.090253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8fd433-73c2-4ef2-a49d-a5793adbbea8", "tag": "7ed8e005-f455-4d1d-ab98-760f924796b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:41.107746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:41.108700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:41.109403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:41.137719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] Creating event network-changed:7ed8e005-f455-4d1d-ab98-760f924796b3 for instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 on n-h2-854119-10 Aug 30 18:18:41.151547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-245ead27-c24b-4245-81e7-cb52d06ba4f6 req-b6e3291c-56fc-4ea3-851e-050f5571501d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090401 Aug 30 18:18:41.155305 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 917/1847] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:41.174245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-681833305", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:41.323244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:18:43.564472 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dec03db2-6648-467b-a266-9af9019ed5b5 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089/action" status: 202 len: 0 microversion: 2.25 time: 3.423298 Aug 30 18:18:43.566152 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 931/1848] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:18:40 2022] POST /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089/action => generated 0 bytes in 3426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:18:43.577851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:43.588999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:43.613308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:43.622183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:43.626116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:43.629090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:43.633431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:43.637065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:44.694864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:44.726149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b151084-43d3-482d-8d52-91e4a796b87a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 1.154253 Aug 30 18:18:44.733926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 932/1849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:43 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:44.753903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:44.771278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:44.784541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:44.785355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:44.785968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:44.787008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:44.787704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:44.788680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:44.792073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:18:44.792647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:18:44.793057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:18:44.793542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:18:44.794184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:18:44.808588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=68 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:44.821797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:44.825353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:44.825969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:44.827457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:44.829235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:44.834925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:44.875591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:44.886555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:44.912630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:18:44.915541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:18:45.043093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ad20253-0b97-4302-b7be-d79dff66ff54 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.871980 Aug 30 18:18:45.046868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 918/1850] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:18:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:18:45.051962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0c1b592-d70f-4389-ad3d-2de6788bf72e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e5663daf0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:45.214685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0c1b592-d70f-4389-ad3d-2de6788bf72e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.159556 Aug 30 18:18:45.214685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 919/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:45 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:45.244532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:45.249973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:45.266188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:45.329388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:45.329891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:45.330374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:45.331162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:45.331630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:45.332064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:45.425541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:45.434396 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-12936879-fc9b-449e-8073-07e4203f6d4b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1477 microversion: 2.1 time: 0.690732 Aug 30 18:18:45.454630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 933/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:44 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1477 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:45.460430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:45.461329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:45.481008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:45.483908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:45.484655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:45.485665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:45.486303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:45.486991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:45.501117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:45.707662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:45.723991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:45.731514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:45.735371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:46.702521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:46.713636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b4e2756-975b-44e7-95e8-8bf4bf2ccb3f tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.499847 Aug 30 18:18:46.715388 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 920/1853] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:18:45 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:46.726468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:46.732106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:46.742767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:46.744363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:46.745599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ea595020-a6c1-4dc7-8126-5a6b04cc6738 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 1.289309 Aug 30 18:18:46.746174 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 934/1854] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:45 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:46.773569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:46.774128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:46.775949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:46.779769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:46.780550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:46.782697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:46.786070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91418471-7792-4eb6-9b64-5affe39385ed tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '.version_select at 0x7f4e56a070d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:46.800661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91418471-7792-4eb6-9b64-5affe39385ed tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:46.806821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91418471-7792-4eb6-9b64-5affe39385ed tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:46.809893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91418471-7792-4eb6-9b64-5affe39385ed tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:46.885516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91418471-7792-4eb6-9b64-5affe39385ed tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.101177 Aug 30 18:18:46.901172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 935/1855] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:18:46 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:46.921345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:46.928953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:46.949452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:46.955487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:46.956478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:46.957422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:46.961446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:46.962159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:47.164166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:47.203824 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-823dab09-7c54-4bad-94bc-185c669da5b6 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1266 microversion: 2.1 time: 0.486916 Aug 30 18:18:47.206864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 921/1856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:46 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:47.221901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6a9d3df-a902-4f05-9a60-3a158a7fec4e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e5663d1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:47.324106 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f6a9d3df-a902-4f05-9a60-3a158a7fec4e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.113569 Aug 30 18:18:47.325092 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 922/1857] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:47 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:47.330748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:47.338987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:47.340404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-998211043', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:47.347528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:47.348381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:47.349491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:47.352162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:47.352934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:47.353615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:47.581151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:47.603441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8d007ee-12ca-42a3-94c1-6c1349f4c4ab tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 0.696522 Aug 30 18:18:47.619878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 936/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:46 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:47.643648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:47.654438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:47.675858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:47.676732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:47.680131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:47.684410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:47.695307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:47.698965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:47.730963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:47.981327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:48.015183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:48.016138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:48.017375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:48.324885 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-decadfbf-0890-4c4e-a768-27a665a09668 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1630 microversion: 2.1 time: 0.710779 Aug 30 18:18:48.333499 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 937/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:47 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1630 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:48.346130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:48.372775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:48.402659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:48.407117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:48.408678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:48.410855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:48.417291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:48.418133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:48.539000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:49.165414 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a16d01b3-7f06-4c3e-9af1-744a3630b428 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-998211043" status: 200 len: 1514 microversion: 2.1 time: 1.838805 Aug 30 18:18:49.167558 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 923/1860] 10.222.0.25 () {58 vars in 1261 bytes} [Tue Aug 30 18:18:47 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-998211043 => generated 1514 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:49.173234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:49.174408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:49.192277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:49.198506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.201268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.201915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.202909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.206026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.207101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.217792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:49.222431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:49.227905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68a24d2a-703e-424e-82cc-2b76fceabdb1 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.892044 Aug 30 18:18:49.266423 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 938/1861] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:48 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:49.289047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38d3929c-5cb9-4ad2-af36-70487272c099 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56a075e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:49.397299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:49.408642 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38d3929c-5cb9-4ad2-af36-70487272c099 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1411 microversion: 2.1 time: 0.140364 Aug 30 18:18:49.411698 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30b8a799-baca-4119-86df-7787bd1d1b06 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1272 microversion: 2.1 time: 0.242398 Aug 30 18:18:49.426373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 939/1862] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:49 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:49.426373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-10730ef1-1c54-43d1-924e-cf157a1c51cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: .version_select at 0x7f4e56a07790>, body: {"keypair": {"name": "tempest-keypair-637583441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyEdtmbzWVe9aG/zi9WNO2OVG99a99tAukHPVv1XILdeeIK/PrIcud68FG9pU2jOGeh9UCKmRKkAKPWI85vex7JqrcPjeoZMdXZpOvqHPCnyjX2ztMFbXnt7o1UNQXAow=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:49.427815 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 924/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:49 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:49.437137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:49.443182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:49.452006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-10730ef1-1c54-43d1-924e-cf157a1c51cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for project d91f68afbea64466b5abc3357706730a. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:18:49.457754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.459118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.461765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.464220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.466848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.467859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.468439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-10730ef1-1c54-43d1-924e-cf157a1c51cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for user cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 and project d91f68afbea64466b5abc3357706730a. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:18:49.527299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-10730ef1-1c54-43d1-924e-cf157a1c51cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108797 Aug 30 18:18:49.530478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 940/1864] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:18:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:49.538112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:49.555362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:49.561229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:49.576990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.577816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.578866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.581364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:49.584757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:49.585697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:49.983958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:50.305783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:50.343598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:50.345252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:50.346212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:50.921112 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5122212-097f-4056-9546-5287fe24ef83 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.391448 Aug 30 18:18:50.923208 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 941/1865] 10.222.0.25 () {58 vars in 1173 bytes} [Tue Aug 30 18:18:49 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:50.929065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:50.936030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:50.952625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:50.953665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:50.955239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:50.958642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:50.959597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:50.960490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:51.159162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:51.184520 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48e7997b-7ef5-416c-8d75-29974394dfee tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 1.747646 Aug 30 18:18:51.189446 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 925/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:49 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:51.210217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b5d8054-d14b-4b1a-a5ca-26100326097b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566d6e50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:52.226277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:52.246916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:52.252982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:52.258571 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad933c6b-f2ff-4a24-9c98-11575ae218ac tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 1.331554 Aug 30 18:18:52.261359 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 942/1867] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:50 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:52.275086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:52.282476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:52.310125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:52.311030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:52.311655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:52.314789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:52.316180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:52.319990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:52.839016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:52.876645 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58d870fa-e071-468f-aca5-2829330cae7d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.613753 Aug 30 18:18:52.893003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 943/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:52 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:52.921355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:52.939962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:52.942988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.servers [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Removing options 'limit' from query {{(pid=122589) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 18:18:52.945592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:52.983149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:52.983777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:52.990551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:52.993008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:52.996012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:52.997385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:53.143328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:53.187927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:53.219663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:53.220990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:53.746584 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5b49213-4349-4486-b88b-88004e9e3a90 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.850635 Aug 30 18:18:53.758505 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 944/1869] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 18:18:52 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:53.758505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:53.758505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:53.773366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:53.774579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:53.777689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:53.778583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:53.779066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:53.779506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:54.101685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:54.129690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31221f79-575f-41f4-bdcf-b517bf1d0636 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 0.380691 Aug 30 18:18:54.132491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 945/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:53 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:54.149538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:54.154015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:54.181845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:54.182793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:54.186309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:54.190128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:54.194106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:54.195285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:54.660568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:54.676122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:54.678540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:54.680546 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7ee88c0b-16db-4bbb-8e70-ece89c52ea7c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.546628 Aug 30 18:18:54.682950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 946/1871] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:54 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:54.689616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8fd433-73c2-4ef2-a49d-a5793adbbea8", "name": "network-vif-plugged", "status": "completed", "tag": "7ed8e005-f455-4d1d-ab98-760f924796b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:54.722278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:54.725802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:54.726503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:54.771746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] Creating event network-vif-plugged:7ed8e005-f455-4d1d-ab98-760f924796b3 for instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 on n-h2-854119-10 Aug 30 18:18:54.796935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-29a90f3f-2634-4651-9e0a-75378e32c11d req-b9245fa2-0c45-4fc7-9c47-87321e93dac8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110517 Aug 30 18:18:54.799581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 947/1872] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:54.816942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:54.861043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:54.864694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:54.896067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:54.896647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:54.907893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:54.909898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:54.911224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:54.912693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:55.127392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:55.299110 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a9ad29b-b2a4-48fd-8cf8-7327f76ae054 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.497610 Aug 30 18:18:55.300966 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 948/1873] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:18:54 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:55.314865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:55.317553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:55.339821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:55.340742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:55.341405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:55.342579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:55.343234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:55.343830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:55.674293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:55.690028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2742d897-9098-433c-b89b-0d7575cfeac9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.387561 Aug 30 18:18:55.690683 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 949/1874] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:55 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:55.726162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:55.727010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:55.747645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:55.748218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:55.749217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:55.753280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:55.753810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:55.758922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.168790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.183995 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f75cadf2-0ca4-4700-ad1e-842949d6b0bf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1308 microversion: 2.1 time: 0.474725 Aug 30 18:18:56.197408 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 950/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:55 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:56.197408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:56.197408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.198028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.servers [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Removing options 'limit' from query {{(pid=122589) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 18:18:56.199563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:56.211366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.212871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.213501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.214523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.215090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.215617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.294184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:56.491363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1380cb3-ca71-460a-8a19-52b5fbea07fb tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.304842 Aug 30 18:18:56.498574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 951/1876] 10.222.0.25 () {58 vars in 1150 bytes} [Tue Aug 30 18:18:56 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:56.516782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:56.517406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:56.524280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.524775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.525220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.525970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.526463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.526895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.881731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.902415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.905017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.906653 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-098b640a-9839-45f1-b917-476c7b857daa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.406886 Aug 30 18:18:56.908787 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 952/1877] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:56 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:56.917022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:56.924885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:56.925948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:56.932473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.933399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.934119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.935294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:56.936051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:56.936745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:56.986656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:57.051747 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-502c05ca-17a9-4dbc-b303-6889e83a4241 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.141437 Aug 30 18:18:57.053652 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 953/1878] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:18:56 2022] GET /compute/v2.1/servers => generated 1010 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:57.060613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:57.061666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:57.069855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.070832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.071551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.072955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.073728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.074429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.370498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:57.379478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-823ed76e-97ce-44ab-b7d0-ac51d538ff71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.324355 Aug 30 18:18:57.380078 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 954/1879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:57 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:57.395317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:57.400960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:57.404747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:57.417812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.418979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.419511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.420906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.421415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.421861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.467219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:57.543477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:57.646937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:57.650270 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c96ee1a6-5cb6-42d2-9351-eebfe5067921 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.262693 Aug 30 18:18:57.651731 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 955/1880] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:18:57 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:57.657085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:57.658146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:57.665762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:57.667780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.668781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.669475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.670612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:57.671465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:57.672511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:57.971038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:58.113015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:58.144537 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a261dfdd-d839-4414-aa52-2cf867d64361 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1488 microversion: 2.1 time: 0.491315 Aug 30 18:18:58.151769 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 956/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:57 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1488 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:58.176332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:58.183138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:58.184021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.servers [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Removing options 'limit' from query {{(pid=122589) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 18:18:58.184868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:58.191808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.192765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.193601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:58.194770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.195470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.196081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:58.260385 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60d42def-aaed-4a77-950f-ff82605b5abe tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.089427 Aug 30 18:18:58.261245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 957/1882] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 18:18:58 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:58.281858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:58.282577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:58.296022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.301566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.303199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:58.304332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.308250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.308981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:58.758973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:58.770556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:58.772079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:58.773823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc807466-72d3-4116-b90f-db0c30f6477b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.504630 Aug 30 18:18:58.798531 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 958/1883] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:18:58 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:18:58.818868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:18:58.828903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:58.861741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.879270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.879678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:58.880479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:58.881222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:58.881827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:59.184184 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-705429cf-5200-43f3-9fd6-ad901d5a6b1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "PUT /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1083 microversion: 2.1 time: 0.383893 Aug 30 18:18:59.194951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 959/1884] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:18:58 2022] PUT /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1083 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:18:59.204601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:59.228616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:18:59.236182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-998211043', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:18:59.272820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:59.273753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:59.274588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:59.278291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:59.279461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:59.283063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:59.456588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:18:59.532234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:18:59.816892 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f22f464a-12a0-443c-94c7-2d9f90fd0b9a tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-998211043" status: 200 len: 345 microversion: 2.1 time: 0.618852 Aug 30 18:18:59.841293 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 960/1885] 10.222.0.25 () {58 vars in 1240 bytes} [Tue Aug 30 18:18:59 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-998211043 => generated 345 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:18:59.851720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:18:59.853368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:18:59.864434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:59.865925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:59.867106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:18:59.868826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:18:59.870046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:18:59.871142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:00.548778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:00.571032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-158edce8-59af-4f69-bb8b-9c8ccfb644dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.726962 Aug 30 18:19:00.572398 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 961/1886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:18:59 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:00.590743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:00.592020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:00.613827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:00.614919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:00.615806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:00.620072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:00.622488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:00.623378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:01.125291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:01.140201 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d2f6ecc1-a5d0-4ddc-be0c-19f481d8acf8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1509 microversion: 2.1 time: 0.566303 Aug 30 18:19:01.140830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 962/1887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:00 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:01.166280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=73 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:01.169355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:01.175687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:01.196306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:01.197343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:01.197802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:01.198679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:01.199156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:01.200340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:01.739575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:01.776138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:01.787148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:01.797185 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c843acd-5963-4cce-ac4f-10f5b2d99f8f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.643861 Aug 30 18:19:01.801171 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 963/1888] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:01 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:01.826256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:01.861228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:01.874382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:01.874382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:02.095010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:19:02.206441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b9a9e8f-6307-410e-86a8-cd46bee13b5c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "POST /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.402633 Aug 30 18:19:02.210153 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 964/1889] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:01 2022] POST /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:02.237986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66cbf98-70c0-4e72-9138-8ded6d4c127a", "tag": "13be2eec-4dac-43a9-8e9a-46d77deaa285"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:02.275592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:02.276366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:02.277061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:02.336586 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] Creating event network-changed:13be2eec-4dac-43a9-8e9a-46d77deaa285 for instance a66cbf98-70c0-4e72-9138-8ded6d4c127a on n-h1-854119-10 Aug 30 18:19:02.347559 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d64fb5fb-00be-4715-aaf8-e99037a98255 req-e2ab6fab-4855-498f-a59b-2ba9c38e0a6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135566 Aug 30 18:19:02.357581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 965/1890] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:02.378511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:02.386780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:02.414992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:02.416448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:02.419044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:02.420107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:02.421276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:02.424812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:03.168179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:03.728656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:03.760905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa003b68-0bc4-43d9-ae45-f61ae96d2c98 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1509 microversion: 2.1 time: 1.399189 Aug 30 18:19:03.769638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 966/1891] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:02 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1509 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:03.775205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:03.775819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:03.790384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:03.790928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:03.791350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:03.796365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:03.796920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:03.798105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:03.954368 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b5d8054-d14b-4b1a-a5ca-26100326097b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1420 microversion: 2.1 time: 12.756639 Aug 30 18:19:03.980999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 926/1892] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:18:51 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1420 bytes in 12789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:04.000723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2144933063", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "52c8298b-12f8-4e95-8e3d-1e6d6e6336e2"}], "security_groups": [{"name": "tempest-securitygroup--338162630"}], "key_name": "tempest-keypair-637583441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:04.290094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:04.320375 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4cff4260-ce3b-47f2-832a-74f5b912a1de tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.548855 Aug 30 18:19:04.328907 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 967/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:03 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:04.355749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:04.363430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:04.374101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:04.375532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:04.376270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:04.377314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:04.378113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:04.378790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:04.749853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:04.781151 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d38cbf6-8917-401f-8787-036173f602e7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 0.448794 Aug 30 18:19:04.798971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 968/1894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:04 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:04.806549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:04.807610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:04.816937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:04.817992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:04.818828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:04.820129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:04.821106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:04.821840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:04.882316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] validate_networks() for [('52c8298b-12f8-4e95-8e3d-1e6d6e6336e2', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:05.132535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:05.149471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:05.152643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:05.154763 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7fcc047e-19a8-4a85-9203-1da267875ab4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.353480 Aug 30 18:19:05.156262 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 969/1895] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:04 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:05.163363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:05.164474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:05.174434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.175390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.176038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:05.177595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.179409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.180698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:05.225153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:05.278897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:05.380725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcb77004-e666-42f5-a7e4-a864db24ef57 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 204 len: 0 microversion: 2.1 time: 0.216247 Aug 30 18:19:05.382566 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 970/1896] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:05 2022] DELETE /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:05.393062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-819da57b-c256-4fc3-a8cc-7aeecff1406c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56a5e160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:05.490025 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-819da57b-c256-4fc3-a8cc-7aeecff1406c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 200 len: 1420 microversion: 2.1 time: 0.104749 Aug 30 18:19:05.492803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 971/1897] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:05 2022] GET /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:05.498478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:05.499537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:05.516622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.518355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.519048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:05.520071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.520756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.521911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:05.834047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:05.845382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4560c454-8ce2-423d-a110-c3da203a31c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.351118 Aug 30 18:19:05.846524 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 972/1898] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:05 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:05.852304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:05.852958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:05.861059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.861576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.862040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:05.863213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:05.863723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:05.866744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:06.213710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:06.240100 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3c3b102-6502-456e-9662-4e080463b8d0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1515 microversion: 2.1 time: 0.389399 Aug 30 18:19:06.244283 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 973/1899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:05 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:06.254670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60cb2387-291c-4795-8cbf-8450d9d81069 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56a85b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:07.687031 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60cb2387-291c-4795-8cbf-8450d9d81069 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 204 len: 0 microversion: 2.1 time: 1.441196 Aug 30 18:19:07.687821 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 974/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:06 2022] DELETE /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 0 bytes in 1443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:07.700470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:07.704726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:07.744599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:07.745499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:07.752324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:07.755547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:07.757803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:07.758708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:07.793344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:19:07.794152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:19:07.794988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:19:07.795508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:19:07.796031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:19:07.815921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:07.816574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:07.817142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:07.826566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:07.828331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:07.830421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:07.875803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:07.888977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for user cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 and project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:07.945783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:19:07.953780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:19:08.085373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbad1c2f-9257-4aba-ad0f-28f23d291425 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.099200 Aug 30 18:19:08.088513 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 927/1901] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:19:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 4106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:19:08.102165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:08.103982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:08.112854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.113675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.114306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.117411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.118169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.118850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.540469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:08.567676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:08.569779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:08.572400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c816558a-1b17-45fd-abe3-c03d71837138 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.482577 Aug 30 18:19:08.586394 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 928/1902] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:08 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:08.586394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:08.586394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:08.586394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.587226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.587790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.588824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.589837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.590615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.701977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:08.722006 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d1bafee-5f28-406d-bbce-11b0fdafe2a9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 1.032416 Aug 30 18:19:08.724892 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 975/1903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:07 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:08.738180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:08.739143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:08.756651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.758232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.760839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.763627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.764272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.765276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.920769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:08.940948 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8667cdeb-c8e6-478b-afe7-962836f3396f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1473 microversion: 2.1 time: 0.214554 Aug 30 18:19:08.941681 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 976/1904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:08 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:08.956526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:08.957121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:08.971780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.972619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.973757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:08.976577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:08.978082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:08.978964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.033011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:09.232505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-388e9ccb-5141-4cbc-a0d7-96a45e483477 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 204 len: 0 microversion: 2.1 time: 0.289281 Aug 30 18:19:09.232908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 977/1905] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:08 2022] DELETE /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:09.253064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1", "name": "network-vif-unplugged", "status": "completed", "tag": "2759ed98-d63a-42f4-b804-bf659c5fbac7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:09.287215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.287829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.288356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.312965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] Creating event network-vif-unplugged:2759ed98-d63a-42f4-b804-bf659c5fbac7 for instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 on n-h1-854119-10 Aug 30 18:19:09.325350 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7285e9bd-2cc3-4fc9-82f1-4b87e9508b25 req-3f455042-2688-4798-bb26-56c79b7081f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090973 Aug 30 18:19:09.337176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 978/1906] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:09.351085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7aab9745-40eb-40d0-b8c2-8f940949f838 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:09.352573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7aab9745-40eb-40d0-b8c2-8f940949f838 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:09.376991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:09.539642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7aab9745-40eb-40d0-b8c2-8f940949f838 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:09.553604 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7aab9745-40eb-40d0-b8c2-8f940949f838 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1234 microversion: 2.1 time: 0.214777 Aug 30 18:19:09.555423 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 979/1907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:09 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1234 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:09.564468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8fd433-73c2-4ef2-a49d-a5793adbbea8", "name": "network-vif-deleted", "tag": "7ed8e005-f455-4d1d-ab98-760f924796b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:09.605042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:09.607924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.609259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.611095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.615027 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a334dd8d-bdfd-4345-b880-bbd983aa75b7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 1.040339 Aug 30 18:19:09.621152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 929/1908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:08 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:09.631982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] Creating event network-vif-deleted:7ed8e005-f455-4d1d-ab98-760f924796b3 for instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 on n-h2-854119-10 Aug 30 18:19:09.641206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-713eaf69-78f3-4bed-a347-d9ba23df51ef req-f455a1e8-a52b-4c55-b964-20baeeed9b63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082992 Aug 30 18:19:09.646498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 980/1909] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:09.652542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:09.653262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:09.653508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2144370421", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6934b7e3-effd-490c-a322-f67172841720"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:09.666929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.667429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.667928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.668703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.669400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.669988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.793137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] validate_networks() for [('6934b7e3-effd-490c-a322-f67172841720', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:09.907281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:09.926535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:09.930521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:09.932979 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edf13703-ba28-4d2e-a167-d5029b99204f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.285594 Aug 30 18:19:09.934216 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 981/1910] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:09 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:09.944372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:09.945184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:09.954668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.955324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.955878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:09.956676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:09.957980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:09.957980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.175273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:10.200952 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-956597d4-3cd3-4512-9149-a901dc2f96e5 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 0.260051 Aug 30 18:19:10.204009 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 982/1911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:09 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:10.224118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:10.228567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:10.243760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.244354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.244797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.245674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.246139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.246884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.302050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.302710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.303154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.303839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lazy-loading 'fault' on Instance uuid 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:10.429409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:10.461492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6545652e-f2f3-4117-9600-50a5f7c66920 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 200 len: 1319 microversion: 2.1 time: 0.256099 Aug 30 18:19:10.463571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 983/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:10 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:10.581007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:10.581733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:10.601212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.608331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.610034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.610942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.612237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.612592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.861497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:10.902020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ef789c5-7e58-46fb-80e6-579255d8f8ce tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1286 microversion: 2.1 time: 0.325163 Aug 30 18:19:10.905685 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 984/1913] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:10 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1286 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:10.923634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:10.935302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:10.960454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.961380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.962186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:10.963595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:10.964449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:10.965217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:11.658284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:11.703290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bac77e44-13fa-4797-bdc8-7740617e211d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.792486 Aug 30 18:19:11.709394 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 985/1914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:10 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:11.729351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:11.731054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:11.750072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:11.753598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:11.755885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:11.758818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:11.760327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:11.761167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:12.162657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:12.197686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:12.205277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:12.216964 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99b36373-b7b7-4a97-aba6-0a62502787ec tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.504513 Aug 30 18:19:12.219495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 986/1915] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:11 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:12.249873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:12.251498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:12.280587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:12.281311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:12.281974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:12.283282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:12.284088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:12.284837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:12.655112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:19:12.656845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:19:12.658418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:19:12.659287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:19:12.660064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:19:12.683830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:12.687118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:12.689959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:12.697920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:12.698833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:12.701624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:12.772273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:12.815408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for user 1cc40f3a740645d1af38042ad00935b1 and project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:12.894607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:19:12.901003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:19:13.053398 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52fb451f-e881-46c9-a5a7-25639d47b793 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.430977 Aug 30 18:19:13.057407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 930/1916] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:19:13.070793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cbf98-70c0-4e72-9138-8ded6d4c127a", "name": "network-vif-plugged", "status": "completed", "tag": "13be2eec-4dac-43a9-8e9a-46d77deaa285"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:13.100521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.106899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.108100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.132284 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] Creating event network-vif-plugged:13be2eec-4dac-43a9-8e9a-46d77deaa285 for instance a66cbf98-70c0-4e72-9138-8ded6d4c127a on n-h1-854119-10 Aug 30 18:19:13.169389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d3169704-95b5-4005-844a-e88aa6ae9332 req-4f31462c-6385-4ad4-8462-d2d69d54e9fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109357 Aug 30 18:19:13.170017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 931/1917] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:13.227868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:13.242994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:13.265270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.272074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.277787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.279122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.279985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.281666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.340148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 HTTP/1.1 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1e8fd433-73c2-4ef2-a49d-a5793adbbea8'} Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:13.357829 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:19:13.376141 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:13.379927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:19:13.384981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56e4f16f-d2e4-4722-87c2-7b0577963ca8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 404 len: 111 microversion: 2.1 time: 0.209532 Aug 30 18:19:13.411298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 932/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:13 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:19:13.439832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:13.441375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:13.471898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.479113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.481239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.486836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.491659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.494801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.593417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:13.608715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-838b48ba-5075-4169-a435-682d21dd68f2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 1.387354 Aug 30 18:19:13.613333 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 987/1919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:12 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:13.627366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089", "name": "network-vif-unplugged", "status": "completed", "tag": "716b674d-8d47-4636-b179-8e863e4198be"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:13.703640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.705959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.710473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.763774 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] Creating event network-vif-unplugged:716b674d-8d47-4636-b179-8e863e4198be for instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 on n-h1-854119-10 Aug 30 18:19:13.793421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d2240008-ee5b-4e4d-ba1c-964cdfac0d71 req-303a3ed8-3502-4afb-bf42-8b75f2bd86bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175072 Aug 30 18:19:13.798388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 988/1920] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:13.815864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:13.816630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:13.834191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.847058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.847567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.851447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:13.852359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:13.852359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:13.899159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:14.012016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:14.048623 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4066b655-3f5e-419e-a60e-3fb624245ecf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1292 microversion: 2.1 time: 0.634596 Aug 30 18:19:14.059998 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 933/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:13 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1292 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:14.084111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-837aa136-3f6c-43a2-80c7-ac2ce5348dcb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:14.085240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-837aa136-3f6c-43a2-80c7-ac2ce5348dcb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:14.419500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:14.429302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07fc9e87-4c80-4bf2-bfbc-8eaf8a180add tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1314 microversion: 2.1 time: 0.629076 Aug 30 18:19:14.443511 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 989/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:13 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:14.451140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:14.452235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:14.465163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-837aa136-3f6c-43a2-80c7-ac2ce5348dcb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:14.477699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:14.478706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:14.479345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:14.480320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:14.482134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:14.483329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:14.502748 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-837aa136-3f6c-43a2-80c7-ac2ce5348dcb tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1208 microversion: 2.1 time: 0.439697 Aug 30 18:19:14.520670 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 934/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:14 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1208 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:14.531895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-273792935", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "00b6b809-e902-4afc-b99f-c6c0f3344d62"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:14.714411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] validate_networks() for [('00b6b809-e902-4afc-b99f-c6c0f3344d62', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:15.197320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:15.209967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:15.211327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:15.212596 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32a85dbe-d08b-4835-95b7-0cc96cd4cad3 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.766011 Aug 30 18:19:15.213582 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 990/1924] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:14 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:15.219779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1", "name": "network-vif-deleted", "tag": "2759ed98-d63a-42f4-b804-bf659c5fbac7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:15.237513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.237981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.238584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.256005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] Creating event network-vif-deleted:2759ed98-d63a-42f4-b804-bf659c5fbac7 for instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 on n-h1-854119-10 Aug 30 18:19:15.261704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2af64047-5745-4555-bf3d-c8cbb049fc02 req-34fecfdd-0482-4cea-820b-242d1e47a3b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046681 Aug 30 18:19:15.262673 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 991/1925] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:15.269740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:15.270612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:15.280086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.280621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.281064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.282441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.282735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.283163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.628250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:15.642578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91c17b20-16c5-420a-a864-1ba68261a725 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 0.378560 Aug 30 18:19:15.660615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 992/1926] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:15 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:15.678443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:15.679205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:15.689048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.689851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.690521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.691594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.692367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.693106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.833903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:15.892106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21a4bc59-dc2d-4e52-b981-55b0d02873fe tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1292 microversion: 2.1 time: 0.229717 Aug 30 18:19:15.899496 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 993/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:15 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1292 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:15.914912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:15.916685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:15.978238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.979831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.980669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:15.990791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:15.991593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:15.992342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:16.426127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:16.479999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1514cb3-27ad-443f-886c-f6306bcd457e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1501 microversion: 2.1 time: 0.572985 Aug 30 18:19:16.497264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 994/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:15 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1501 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:16.528171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:16.529277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:16.544969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:16.548258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:16.552780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:16.557099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:16.557963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:16.559148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:16.720535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:19:16.721058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:19:16.721801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:19:16.722324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:19:16.722909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:19:16.738079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:16.750192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:16.750914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:16.752293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:16.752580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:16.753977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:16.790945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:16.797389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Getting quotas for user 7cdab9aabec443feb88e7642921429b7 and project eaa2f9cf926a4a638da83ecf797564a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:16.819276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:19:16.822210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:19:16.921537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:16.944595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a518618d-534c-46c4-b324-333615b8d45f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415778 Aug 30 18:19:16.946792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 935/1929] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:19:16.956110 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-586ea460-1445-4a93-8472-3109267e884a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1268 microversion: 2.1 time: 0.450967 Aug 30 18:19:16.963389 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 995/1930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:16 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1268 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:16.966575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089", "tag": "716b674d-8d47-4636-b179-8e863e4198be"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:16.992207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:16.993985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:17.016997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.018845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.019945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.022337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.024063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.025311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.033936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.042423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.046993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.097763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] Creating event network-changed:716b674d-8d47-4636-b179-8e863e4198be for instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 on n-h1-854119-10 Aug 30 18:19:17.104901 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a487b849-6e44-46e9-a3ed-fe946c5a9218 req-360e8b36-e2c4-4298-81c0-56e9f79aa504 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154234 Aug 30 18:19:17.108253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 936/1931] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:17.124384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:17.127467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:17.162090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.165143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.166683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.168091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.168962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.169650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.343665 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c2639ba-5647-4e44-9fed-5a7b71402bb3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a/action" status: 202 len: 0 microversion: 2.1 time: 0.233394 Aug 30 18:19:17.352665 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 937/1932] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:17 2022] POST /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:17.398732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:17.405935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:17.447922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.449150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.450392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:17.452005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:17.453357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:17.454235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.226828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:18.246419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:18.249950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:18.253404 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-33860604-e482-426c-a5a5-79c379011dfc tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 1.286693 Aug 30 18:19:18.255464 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 996/1933] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:16 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:18.290988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:18.292177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:18.306764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.309873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.311190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.313251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.314507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.316296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.733337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:18.760142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c3e5de6-21df-40bd-9faa-52d329fe7488 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.501144 Aug 30 18:19:18.761872 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 997/1934] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:18 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:18.779035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:18.803322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:18.863498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.871550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.877072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:18.878898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.889190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.890221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8b20bf94-44b1-4b39-918f-1b05e0c9bfc2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1521 microversion: 2.1 time: 1.520231 Aug 30 18:19:18.892104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 938/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:17 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1521 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:18.899529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.900675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.904826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:18.911679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:18.937145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.938296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.939094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:18.940534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:18.941259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:18.943020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:19.081608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:19.094449 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c77b1876-00b5-4154-a366-4f95430c6770 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1204 microversion: 2.1 time: 0.330297 Aug 30 18:19:19.107595 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 998/1936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:18 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1204 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:19.128309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:19.129386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:19.145025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:19.145524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:19.148635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:19.151379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:19.151873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:19.154222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:19.547180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:19.670156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:19.679087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f0e576a-5455-4608-bd30-61c266b57444 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.562885 Aug 30 18:19:19.686889 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 999/1937] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:19 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:19.707349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:19.713985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:19.738956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:19.740492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:19.741019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:19.741471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:19.750842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:19.751430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:19.751899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.185558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:20.200402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:20.204244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:20.209405 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4c6205c-7c6c-4123-a93a-8bf0566cb0b2 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.515567 Aug 30 18:19:20.212153 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1000/1938] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:19 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:20.231453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:20.232419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:20.247189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.250238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.250907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.254679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.257054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.258525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.610684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:20.623148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b8bb49c-5d28-467f-873c-9bf7bba26282 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1486 microversion: 2.1 time: 1.729496 Aug 30 18:19:20.635229 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 939/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:18 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1486 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:20.635229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:20.635229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:20.658820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.659327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.660451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.661282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.661762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.662197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.724292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:20.750295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e2c2a2f-a5a2-40a7-a93d-c8c33bfdd430 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.532003 Aug 30 18:19:20.751266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1001/1940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:20 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:20.781698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:20.790649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:20.797920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.798722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.804328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:20.807970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:20.808657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:20.809274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.011843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.027072 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-911a6a2c-28d3-4655-87df-947e69e3a5ce tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1266 microversion: 2.1 time: 0.255239 Aug 30 18:19:21.043409 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1002/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:20 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:21.057352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:21.058162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:21.066960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.073165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.074031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.076376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.077152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.084526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.140381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:21.206999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.232680 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84017f56-274c-41f6-b2a4-c3f3744522d9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1498 microversion: 2.1 time: 0.606395 Aug 30 18:19:21.254480 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 940/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:20 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1498 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:21.271548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:21.275900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:21.292752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.296831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.297603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.300263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.303718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.304341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.332265 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b893d04-74e6-497e-942d-f4661ab66c27 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 204 len: 0 microversion: 2.1 time: 0.283932 Aug 30 18:19:21.336489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1003/1943] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:21 2022] DELETE /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:21.352986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:21.353838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:21.365915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.366625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.368157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.369539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.370025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.370743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.763184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.769399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.775437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.776759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93b37a37-9221-4994-90e6-658c4adb85a6 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 0.436598 Aug 30 18:19:21.781907 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1004/1944] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:21 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:21.802149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:21.814244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:21.815616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:21.834748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.835276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.835731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.836945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:21.837408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:21.838731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:21.902830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:21.905302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:21.969287 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9adffc40-8095-4181-ad05-18464e5354d7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.185990 Aug 30 18:19:21.972153 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1005/1945] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Aug 30 18:19:21 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:21.986691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:21.998284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:22.017877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.023345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.031375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.032162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.032647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.033094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.067156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:22.092495 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc3df7ba-0c13-4ee7-801a-680109cbc0bd tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.831623 Aug 30 18:19:22.093775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 941/1946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:21 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:22.115228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:22.116132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:22.123756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.124577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.125202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.126135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.126834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.127436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.446059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:22.469090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06f23851-bc21-4b3b-82c0-addff5d854cf tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.356769 Aug 30 18:19:22.470755 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 942/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:22 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:22.471712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:22.481289 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d43d955b-6d25-4f93-9add-ffd4fad8a894 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1492 microversion: 2.1 time: 0.506893 Aug 30 18:19:22.489005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:22.491031 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1006/1948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:21 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1492 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:22.497092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:22.499362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:22.515731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.516933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.517586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.518546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.519651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.520370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.522295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.522836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.523017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.615613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Going to try to start instance {{(pid=122590) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:19:22.702940 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-755a4357-bad5-4cf1-affd-7b0f06716bf7 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "POST /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.229764 Aug 30 18:19:22.708469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 943/1949] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:22 2022] POST /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:22.716167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:22.733654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.735576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.736513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.768146 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] Creating event network-changed:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h2-854119-10 Aug 30 18:19:22.781044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c57c35f2-cdca-46fb-b4c3-da46f62d7284 req-01c510b0-1945-407f-bf8d-70eb3db06287 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067401 Aug 30 18:19:22.783668 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 944/1950] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:22.813152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:22.813717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:22.853734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.857835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.861902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:22.865409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:22.874219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:22.874913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:23.836600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:23.849208 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d708e2c3-f84a-4805-b4bd-3717a979f45d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 1.356579 Aug 30 18:19:23.852945 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1007/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:22 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:23.879415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:23.880622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:23.893178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:23.893842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:23.894491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:23.895519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:23.899662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:23.900285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:24.138009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:24.153810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-add6c24f-34b7-490a-bcab-2f7f8d5cd218 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1507 microversion: 2.1 time: 1.365962 Aug 30 18:19:24.159228 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 945/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:22 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1507 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:24.166963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d26ffd-b054-4f05-a06f-246822e47992", "tag": "4c0b1a71-dd4a-4b2d-b825-632131dc76ab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:24.213316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:24.215879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:24.216813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:24.281480 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] Creating event network-changed:4c0b1a71-dd4a-4b2d-b825-632131dc76ab for instance a6d26ffd-b054-4f05-a06f-246822e47992 on n-h2-854119-10 Aug 30 18:19:24.300647 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0715e92c-ae29-489a-9c12-0d537315535d req-d9211498-9064-40cc-8a5a-40271d073528 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139517 Aug 30 18:19:24.305471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 946/1953] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:24.329912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:24.333386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:24.357724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:24.359905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:24.362076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:24.371090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:24.375397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:24.382180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.253339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.259477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:25.273717 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73b0f493-5159-4c61-9bef-4ca77ac5ca7d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.959652 Aug 30 18:19:25.275676 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 947/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:24 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:25.300102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.303408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:25.311145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:25.323273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.325198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.330105 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bdbb869-ccd6-4bcb-894e-c04b5363583b tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 1.472116 Aug 30 18:19:25.337012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1008/1955] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:23 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:25.341868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.345160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.350632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:25.351264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:25.355286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.361580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.362450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.363374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.381051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.381829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.396124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.398216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.399866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.400572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.761667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.774530 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e9612de-2ac5-42c0-ad35-7dde280193f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 200 len: 1492 microversion: 2.1 time: 0.430569 Aug 30 18:19:25.778645 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1009/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:25 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 1492 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:25.792184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:25.800429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:25.823793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.827604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.830776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.837778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:25.843489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:25.844082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:25.960151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:25.973915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9aa4e91-1a04-431f-8462-8fa3527b030d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.692399 Aug 30 18:19:25.973915 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 948/1957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:25 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:25.989192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:25.989192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:26.026187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:26.026750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:26.027352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:26.028012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:26.028485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:26.035681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:26.769190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:26.814290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=20 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:26.991350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:27.024654 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e083af94-a735-4c3e-9df2-056565d8e82b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 1.236342 Aug 30 18:19:27.033137 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1010/1958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:25 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:27.444074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66cbf98-70c0-4e72-9138-8ded6d4c127a", "name": "network-vif-deleted", "tag": "13be2eec-4dac-43a9-8e9a-46d77deaa285"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:27.478027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:27.482062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:27.484788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:27.549742 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] Creating event network-vif-deleted:13be2eec-4dac-43a9-8e9a-46d77deaa285 for instance a66cbf98-70c0-4e72-9138-8ded6d4c127a on n-h1-854119-10 Aug 30 18:19:27.567486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c4d16fb8-8a3e-4bf3-b1b1-d2c20aaa472c req-02581fd2-442a-4bdb-8f34-e10fc0174068 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.530448 Aug 30 18:19:27.574803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1011/1959] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:27.603988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:27.629911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:27.656845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:27.658015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:27.659980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:27.661594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:27.662781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:27.670143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:28.719307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:28.759633 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2335a6cc-e458-40f9-8608-2145eb7dee6d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1507 microversion: 2.1 time: 2.785594 Aug 30 18:19:28.784898 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 949/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:25 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1507 bytes in 2801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:28.829409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:28.837923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:28.887044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:28.893040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:28.894261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:28.899633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:28.921412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:28.923367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:29.114525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:29.163091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90b0a35d-a50a-4627-82cb-e815647afeac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 1.585086 Aug 30 18:19:29.176074 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1012/1961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:27 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:29.188547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:29.194732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:29.217426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:29.220143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:29.223424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:29.225237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:29.232053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:29.233165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:29.299296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a HTTP/1.1 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a66cbf98-70c0-4e72-9138-8ded6d4c127a'} Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:29.311901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:19:29.317927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:29.324927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:19:29.326927 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be20c2e6-4632-49f8-8d34-6363095d77d9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 404 len: 111 microversion: 2.1 time: 0.148571 Aug 30 18:19:29.330367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1013/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:29 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:19:29.361420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:29.363125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:29.394238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:29.395417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:29.396452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:29.402256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:29.403566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:29.407350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.129391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.146717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-488a23c0-7a20-4b4f-83dd-05852c3d06c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.813581 Aug 30 18:19:30.171053 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1014/1963] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:29 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:30.183354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.187850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:30.189481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:30.202202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.204523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.205535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.206664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.208562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.210307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.211506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.219273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.221032 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-806103aa-cc0b-45e3-905a-bd0c0ccd427c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1486 microversion: 2.25 time: 1.429653 Aug 30 18:19:30.224831 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 950/1964] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:28 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1486 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:30.252460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf3d3c8-a4b7-4f45-85f4-6d61461618d4", "tag": "9e09b09c-d4dc-41df-878a-813f67e94119"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:30.262522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:30.271237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.272360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.273035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.287404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] Creating event network-changed:9e09b09c-d4dc-41df-878a-813f67e94119 for instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 on n-h1-854119-10 Aug 30 18:19:30.293503 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6d6157e0-9a99-47b6-acdb-e09e047ca92f req-3eeae0de-b93a-469b-b83a-f0099da082e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066252 Aug 30 18:19:30.295335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 951/1965] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:30.300936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:30.302016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:30.310701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.311671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.312211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.313056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.313615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.314135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.674965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.685771 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e11384c-bf57-4fe5-8374-b57637af512f tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 0.512892 Aug 30 18:19:30.699110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1015/1966] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:30 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:30.706135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-17098755", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:30.769099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:30.772941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:30.783600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3cf3fad-d52a-4806-b0ac-a5a55c018d98 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1511 microversion: 2.1 time: 0.486678 Aug 30 18:19:30.795140 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 952/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:30 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:30.807856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:30.808759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:30.816808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.817638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.818217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:30.819238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:30.819847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:30.820279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.147761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:31.157917 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b78c46e8-ca95-4710-be2a-9dd36600e679 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.361230 Aug 30 18:19:31.171471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 953/1968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:30 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:31.179529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:31.187100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:31.188466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.servers [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Removing options 'limit' from query {{(pid=122590) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 18:19:31.189423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:31.191161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.191971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.192413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.193377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.193921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.194433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.196651 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d66c10b-7402-4abc-a328-e259fa2ffbf0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.021802 Aug 30 18:19:31.204804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 954/1969] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 18:19:31 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:19:31.210799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:31.211423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:31.219981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.220239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.220831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.221622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.221977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.222601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.470249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:31.481192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2232caf1-18d6-48d5-ac19-a7fddff45b0e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.274889 Aug 30 18:19:31.486923 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 955/1970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:31 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:31.492965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:31.497694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:31.516427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.517504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.517980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.518747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.519208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.519642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.673322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:19:31.673866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:19:31.674206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:19:31.675307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:19:31.676101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:19:31.692492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.693428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.694030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.695200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.696765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.697396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.732526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:31.740359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:31.758797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:19:31.761670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:19:31.816154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:31.825579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b6c022d-3aa4-4b83-b6d9-1a510480ad20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1511 microversion: 2.1 time: 0.337239 Aug 30 18:19:31.834525 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 956/1971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:31 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:31.854645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:31.855555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:31.862540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.863336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.864188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.866051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:31.866843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:31.867461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:31.941327 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fceeb992-4225-4eb1-a2c0-9cabb03cf0cb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235443 Aug 30 18:19:31.942080 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1016/1972] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:19:31.974226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:31.982159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:32.034690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.040099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.041547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.050105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.059313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.059982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.355735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.366430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.370229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.373760 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0933ba98-2486-4467-90b3-396fd01a2b7a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1476 microversion: 2.25 time: 0.524913 Aug 30 18:19:32.375745 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 957/1973] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:31 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1476 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:32.386654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:32.389256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:32.406296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.406865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.407314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.408050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.408531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.408984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.557551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.567528 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c09f1f7-2a83-495c-8e80-b6fba83365f7 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 0.623913 Aug 30 18:19:32.585702 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1017/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:31 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:32.598489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b53a6e36-7f17-4227-99f1-e869b43bc101 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:32.599419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b53a6e36-7f17-4227-99f1-e869b43bc101 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:32.717711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b53a6e36-7f17-4227-99f1-e869b43bc101 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.730209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b53a6e36-7f17-4227-99f1-e869b43bc101 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1213 microversion: 2.1 time: 0.139359 Aug 30 18:19:32.733324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1018/1975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:32 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:32.745045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:32.746237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:32.762724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.766747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.767538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.768817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.772119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.772795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.774943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:32.788884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8164ace8-a708-4788-927e-957de327f3e2 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1511 microversion: 2.1 time: 0.411826 Aug 30 18:19:32.790542 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 958/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:32 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:32.816057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "name": "network-vif-plugged", "status": "completed", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:32.878090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.878616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.879061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.926205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] Creating event network-vif-plugged:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h2-854119-10 Aug 30 18:19:32.935685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1237f1d1-7929-4755-bbe8-ddeb844e70aa req-749ee784-b8a5-4000-a403-32cdd6c6498d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142743 Aug 30 18:19:32.937133 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 959/1977] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:32.952232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10f0eabe-c133-4dee-97ed-1e848450c4f0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '.version_select at 0x7f4e565d8d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:32.956864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10f0eabe-c133-4dee-97ed-1e848450c4f0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:32.957641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10f0eabe-c133-4dee-97ed-1e848450c4f0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:32.958692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10f0eabe-c133-4dee-97ed-1e848450c4f0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:32.993103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10f0eabe-c133-4dee-97ed-1e848450c4f0 tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2804 microversion: 2.25 time: 0.054339 Aug 30 18:19:32.994254 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 960/1978] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Aug 30 18:19:32 2022] GET /compute/v2.1/os-migrations => generated 2804 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:33.003349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:33.009651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:33.034090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.035011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.035548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.036656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.037303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.037720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.418474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:33.433883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17c8c678-99ed-4280-8687-d598918c7840 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1359 microversion: 2.1 time: 0.437955 Aug 30 18:19:33.437879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 961/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:32 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:33.475237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:33.477693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:33.500417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.503239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.505754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.508690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.509479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.510966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.561348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:33.573687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e2ab431-0533-40ab-a975-1fc377aa0fac tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.837937 Aug 30 18:19:33.579029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1019/1980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:32 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:33.585133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:33.595038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:33.618083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.622510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.626664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.628579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:33.630180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:33.638527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:33.963802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:33.984095 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c40983fb-2ba7-4c67-b184-c05585a5c66c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1512 microversion: 2.1 time: 0.544397 Aug 30 18:19:33.995490 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 962/1981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:33 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:34.009586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.010197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:34.028702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.029207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.029656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.030435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.030908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.031346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.086731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] Lazy-loading 'services' on Instance uuid 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:34.114264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a4cd1f7-f32e-44e1-b066-4fd869080f1e tempest-LiveAutoBlockMigrationV225Test-1246960920 tempest-LiveAutoBlockMigrationV225Test-1246960920-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1970 microversion: 2.25 time: 0.533876 Aug 30 18:19:34.132921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1020/1982] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:33 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1970 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:34.142886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.144070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:34.164750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.169273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.170936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.172174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.176233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.179694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.299085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:34.312028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-85982366-41f6-4f1c-adb7-d033c21493a1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1265 microversion: 2.1 time: 0.180139 Aug 30 18:19:34.328951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1021/1983] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:34 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:34.337494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.348072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:34.349445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'ip': '172.20.0.7', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:34.384473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:34.410415 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ae86838-bc3e-4934-9b49-6afbff9fe830 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 0.413623 Aug 30 18:19:34.411398 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 963/1984] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:33 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:34.432035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.433236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:34.440754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.441502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.442458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.443436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.444409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.444935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.476533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:34.642867 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97880279-1a67-4420-baa5-d0a8cf51dcaf tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 204 len: 0 microversion: 2.25 time: 0.216790 Aug 30 18:19:34.644596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 964/1985] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:19:34 2022] DELETE /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:19:34.654735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.655931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:34.661407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.662662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.663633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.665971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.666754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.667795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.668677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.669396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.670373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.671433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:34.672554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:34.673292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:34.918593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:34.968985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:34.975900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:34.987288 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bcbc597-091b-450c-987b-e9825dad305a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1541 microversion: 2.1 time: 0.339778 Aug 30 18:19:34.988390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 965/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:34 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1541 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:34.998668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:34.999306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.022273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.045995 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a3f2d90-25a9-420f-abd4-71f978f99486 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.7" status: 200 len: 345 microversion: 2.1 time: 0.715715 Aug 30 18:19:35.049339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1022/1987] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:19:34 2022] GET /compute/v2.1/servers?ip=172.20.0.7 => generated 345 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:35.060284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:35.061714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:35.076349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.076982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.077297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.078035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.079625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.081436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.306627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:35.322975 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ecd562a-7654-4076-b31e-c8c26c28d27c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.333084 Aug 30 18:19:35.324238 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 966/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:34 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:35.332689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d26ffd-b054-4f05-a06f-246822e47992", "name": "network-vif-plugged", "status": "completed", "tag": "4c0b1a71-dd4a-4b2d-b825-632131dc76ab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:35.348562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.349801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.350924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.375525 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] Creating event network-vif-plugged:4c0b1a71-dd4a-4b2d-b825-632131dc76ab for instance a6d26ffd-b054-4f05-a06f-246822e47992 on n-h2-854119-10 Aug 30 18:19:35.382113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a1267870-de75-4490-b7b9-9b2e9e701171 req-ba7dca92-4c7f-407e-8cd4-772f08cac759 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056191 Aug 30 18:19:35.383184 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 967/1989] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:35.394313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:35.395069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:35.405326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.405913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.406434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.407621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.408528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.409152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.554250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c210cbc5-53b0-42a6-9410-957ea29c87ae tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166122 Aug 30 18:19:35.556875 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 968/1990] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:19:35 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:35.589428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:35.593953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:35.606996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.609749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.610561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.611513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.612690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.614038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.721639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:35.725723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:35.740318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:35.744767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:35.746522 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb20320b-3165-4906-809e-8ffee92cae4c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1482 microversion: 2.25 time: 0.696083 Aug 30 18:19:35.752121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1023/1991] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:35 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1482 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:35.771218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:35.777104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:35.807145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.807731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.808174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.808925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:35.809388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:35.809819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:35.984372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:35.993182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-82aa5a57-b338-4de0-b935-e6a8544ea62f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1271 microversion: 2.1 time: 0.238752 Aug 30 18:19:35.993829 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1024/1992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:35 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:36.007637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:36.007637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:36.009135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.010377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.010828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.013672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.015771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.016886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.286198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:36.298186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4ac25b3-d382-4403-810b-92c1e7a8f2d3 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1511 microversion: 2.1 time: 0.734942 Aug 30 18:19:36.301821 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 969/1993] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:35 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:36.322989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:36.325551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:36.335878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.339453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.341114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.355391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.362739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.363765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.725508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:36.751469 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54f72d4a-b996-4cc6-a894-978d3b683f44 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 0.754627 Aug 30 18:19:36.756756 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1025/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:35 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:36.766005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:36.766732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:36.775636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.776581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.777363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.789868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.791172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.791953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.845754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:36.856342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-adefedd7-5414-4354-a38e-e1fe17d3ba1c tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1511 microversion: 2.1 time: 0.538792 Aug 30 18:19:36.857404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 970/1995] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:36 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:36.862715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:36.863542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:36.887354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.888401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.889091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:36.889973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:36.891330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:36.892527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.252968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:37.273214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:37.275996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:37.277571 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06c0f3c8-66b2-40ae-986c-55c180327f6a tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1482 microversion: 2.25 time: 0.418828 Aug 30 18:19:37.290444 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 971/1996] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:36 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1482 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:37.290444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:37.290444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:37.298393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.299069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.299656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.300441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.300959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.301453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.375412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:37.404229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a16348f8-dca3-441c-b2ca-72db52fabf0e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1308 microversion: 2.1 time: 0.645787 Aug 30 18:19:37.409032 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1026/1997] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:36 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:37.418997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:37.419718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:37.435349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.435996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.436541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.437581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.438045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.438499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.785057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:37.806693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-473694b8-cc98-4a8e-b0fd-c13e48a28f10 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.395982 Aug 30 18:19:37.827480 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1027/1998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:37 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:37.841192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf3d3c8-a4b7-4f45-85f4-6d61461618d4", "name": "network-vif-plugged", "status": "completed", "tag": "9e09b09c-d4dc-41df-878a-813f67e94119"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:37.889433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.890416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.890979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.910060 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] Creating event network-vif-plugged:9e09b09c-d4dc-41df-878a-813f67e94119 for instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 on n-h1-854119-10 Aug 30 18:19:37.917292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d1bb2f17-a0e2-40b0-9f51-db80ab3516d7 req-ae569167-662a-409b-916a-8f6db074d96a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093994 Aug 30 18:19:37.919088 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1028/1999] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:37.926975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:37.929403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:37.938949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.939486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.939935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:37.940923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:37.941644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:37.942082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.535746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:38.554632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99c80d0a-a354-47bf-87d4-649e2191b8dd tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1512 microversion: 2.1 time: 1.273505 Aug 30 18:19:38.557275 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 972/2000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:37 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1512 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:38.580086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089", "name": "network-vif-deleted", "tag": "716b674d-8d47-4636-b179-8e863e4198be"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:38.618389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:38.620420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:38.621600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.653762 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] Creating event network-vif-deleted:716b674d-8d47-4636-b179-8e863e4198be for instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 on n-h2-854119-10 Aug 30 18:19:38.667338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6034ebb0-d247-4bba-af5e-3b2a31fcdb9f req-a6c3269c-6262-4ee9-b2c6-b192dec62970 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106928 Aug 30 18:19:38.669990 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 973/2001] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:38.686693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:38.691364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:38.706320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:38.712543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:38.712906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.716780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:38.722199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:38.722799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.777673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:38.793321 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57666160-fa0a-4023-a09c-07a9e1a75355 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1308 microversion: 2.1 time: 0.871682 Aug 30 18:19:38.795202 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1029/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:37 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1308 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:38.808036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:38.808926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:38.835733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:38.836887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:38.837497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.838628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:38.839281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:38.839852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:38.932100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:38.964197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:38.967649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:38.969853 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a3c59153-c1c1-46d1-a3ca-2779f91ef089 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.298212 Aug 30 18:19:38.982407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 974/2003] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:38 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:38.982837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:38.995976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:39.001622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:39.016495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.017492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.018694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.020390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.021309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.022120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.085610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:39.140979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:39.155320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.156678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.157263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.453568 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b241c62-8454-4066-b89e-9cd265f41b49 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.480199 Aug 30 18:19:39.455564 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 975/2004] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:19:38 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:39.479612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:39.483428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:39.513127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.515824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.518929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.521427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.526970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.528015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.636343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:39.659329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5684854-aae3-4bba-bc46-b1e214be1be3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1488 microversion: 2.1 time: 0.862552 Aug 30 18:19:39.662623 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1030/2005] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:38 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1488 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:39.676446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:39.694599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:39.695720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:39.870571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.875453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.876608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.878044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:39.881466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:39.882643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:39.991399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:40.044561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.062802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d2e001d4-08b6-4890-9d99-26c30e2fd2f2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.603645 Aug 30 18:19:40.077040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 976/2006] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:39 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:40.089665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89fa5066-6bfc-4719-b1cf-db750750e1c0", "tag": "462321ce-718b-4f9c-99e7-b5beb8bde24d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:40.111125 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6bc6129d-7ecd-4056-a80b-2685b103c456 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.444872 Aug 30 18:19:40.112103 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1031/2007] 10.222.0.25 () {58 vars in 1150 bytes} [Tue Aug 30 18:19:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:40.134679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.135239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.135997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.137019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:40.137859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.159796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.159796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.159796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.161732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.165222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.169335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.176377 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] Creating event network-changed:462321ce-718b-4f9c-99e7-b5beb8bde24d for instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 on n-h1-854119-10 Aug 30 18:19:40.192930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-186451ff-df46-44af-b10a-ddb8cb28a6f7 req-0af24b52-37e8-4421-ab6e-17819a677bb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118870 Aug 30 18:19:40.196557 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 977/2008] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:40.208759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:40.211877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.225522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.225522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.225791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.229628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.230187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.230665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.240890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lazy-loading 'flavor' on Instance uuid a6d26ffd-b054-4f05-a06f-246822e47992 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:40.494139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06a4dbd4-4306-4678-99e3-034cf84b8422 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992/action" status: 202 len: 0 microversion: 2.1 time: 0.368880 Aug 30 18:19:40.500274 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1032/2009] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:40 2022] POST /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:40.510535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:40.511815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.522663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.524263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.524929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.525889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.526578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.527204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.547078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.561983 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4742cc57-b88d-4378-aabd-cfff299c9d00 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1488 microversion: 2.1 time: 0.361414 Aug 30 18:19:40.563464 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 978/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:40 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1488 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:40.568520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:40.574831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.576547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:40.582899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.583753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.584566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.585522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.586461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.587371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.693073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.704167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.716651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:40.719220 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d15077e2-3f94-4090-abc4-12744b65e77d tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.217160 Aug 30 18:19:40.733740 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1033/2011] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:40 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:40.746694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:40.746694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.758935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:40.761956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.762496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.766851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.767668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.768165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.768616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.872971 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0fae50b-420f-4d7f-9383-cbe4c5c61876 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.308134 Aug 30 18:19:40.873569 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 979/2012] 10.222.0.25 () {58 vars in 1212 bytes} [Tue Aug 30 18:19:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:40.894172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-624232829"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:40.900260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:40.919308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.919816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.920264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:40.921002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:40.921459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:40.921885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.110162 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ccb1961-7350-44f4-b4fb-6c73d3b880e6 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "PUT /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1073 microversion: 2.1 time: 0.233876 Aug 30 18:19:41.112789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 980/2013] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:19:40 2022] PUT /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1073 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:41.118047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:41.147372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.147985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.148437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.185110 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] Creating event network-changed:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h2-854119-10 Aug 30 18:19:41.193762 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bd1025bf-7b3a-437c-bf74-3c0573388a17 req-f6cafadb-6142-4f28-945c-ffc62c8aeee5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079374 Aug 30 18:19:41.198496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 981/2014] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:41.207361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:41.217159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:41.218236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:41.218591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:41.227366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.228130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.229867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.231185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.231667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.232102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.236539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e87e1208-3ddd-49e5-a352-6353a2ff7fd5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1496 microversion: 2.1 time: 0.501315 Aug 30 18:19:41.244572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1034/2015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:40 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1496 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:41.256270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:41.266170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:41.284625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.285453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.286093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.287102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.287744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.288405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.394034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:41.543296 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7195ceb-a30f-4db0-952f-767b1a27274b tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.342682 Aug 30 18:19:41.553110 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 982/2016] 10.222.0.25 () {58 vars in 1196 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:41.553327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:41.556330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:41.575891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.576560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.577014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.578699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.579178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.579813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.607950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:41.617065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ef38e58-4c22-489e-b9b8-264f6cc08661 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.370992 Aug 30 18:19:41.634572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1035/2017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:41.635739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:41.648987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:41.658189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:41.659062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': '-998211043', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:41.668669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.669719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.669719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.670322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:41.670806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:41.671274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:41.836908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:41.974492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-02a4c6c3-44dd-4998-8561-8c1686cfd052 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-998211043" status: 200 len: 345 microversion: 2.1 time: 0.329275 Aug 30 18:19:41.991435 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1036/2018] 10.222.0.25 () {58 vars in 1156 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers?name=-998211043 => generated 345 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:42.000335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:42.000672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:42.011641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.012407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.013073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.014181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.014939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.015588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.033473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:42.043780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a34d472-e310-4d2f-839d-6ddf1cd40068 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1499 microversion: 2.1 time: 0.494775 Aug 30 18:19:42.046383 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 983/2019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1499 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:42.063461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:42.075949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:42.082142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:42.101608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.105439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.106090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.108655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.109630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.112913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.636353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:42.648632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:42.650273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:42.658059 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1d561d2-d049-4148-beb9-cd98c2eeb86f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.658605 Aug 30 18:19:42.658815 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1037/2020] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:41 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:42.688624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:42.689259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:42.708889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.709390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.709831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.710602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:42.711058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:42.711803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:42.759826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:42.851214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:42.996148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a78e8964-8c64-494f-a4e5-7d8e5b87c918 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.941077 Aug 30 18:19:42.997286 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 984/2021] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Aug 30 18:19:42 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:43.041158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:43.042598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:43.064509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.065280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.066002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.069168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.070070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.070978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.541838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:43.549285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:43.553456 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-42c7557a-16b0-4158-ae13-d222044373b0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1499 microversion: 2.1 time: 0.878879 Aug 30 18:19:43.555315 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1038/2022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:42 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1499 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:43.560968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:43.561850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:43.571081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.572105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.572740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.573723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.574569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.575211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.607404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:43.621705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1753022d-2a87-4e26-bf7d-28acf8ffa395 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 200 len: 1479 microversion: 2.1 time: 0.623051 Aug 30 18:19:43.624631 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 985/2023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:42 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 1479 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:43.645808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:43.658651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:43.659592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-99821104', 'deleted': False, 'project_id': '89cfeb97afa342df912b046bea6023b8'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:19:43.669202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.669962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.672971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.679025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:43.681041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:43.684456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:43.926533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:19:43.931674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:43.948947 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-367af654-f03e-4b8c-8c2f-d97560541d84 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.392020 Aug 30 18:19:43.952301 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1039/2024] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:43 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:43.979645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:43.997900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.002520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.003047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.065874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:19:44.074822 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16c38cb8-6682-413c-b52c-28f2548f2d08 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-99821104" status: 200 len: 345 microversion: 2.1 time: 0.447523 Aug 30 18:19:44.094561 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 986/2025] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Aug 30 18:19:43 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-99821104 => generated 345 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:44.102082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-132023454"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:44.108285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:44.155106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.155806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.160468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.163161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.165474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.168516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.188710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-805a54ce-08f9-434b-99c6-68b92c82b0ea tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "POST /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4/action" status: 202 len: 0 microversion: 2.1 time: 0.232733 Aug 30 18:19:44.188710 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1040/2026] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:43 2022] POST /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:44.235478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:44.236385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:44.246400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:44.248729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.249275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.253033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.253033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.253033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.253033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.435704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:44.445618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:44.447126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:44.465240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e25b0770-ea35-4a4a-8525-14c74b6f2d3e tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.260800 Aug 30 18:19:44.468221 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1041/2027] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:44 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:44.519204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:44.519806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:44.582286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.585291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.588568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.593227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.596466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.597260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.644251 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95b1d5eb-9d26-45bb-bb96-503c4d669d8c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992/action" status: 202 len: 0 microversion: 2.1 time: 0.544149 Aug 30 18:19:44.647656 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 987/2028] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:44 2022] POST /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:19:44.658867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:44.668066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:44.668312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:44.683623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.685590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.686377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.688719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:44.689628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:44.702558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:44.883083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f282297a-58c7-46af-b9b2-d712c23947b4 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 204 len: 0 microversion: 2.1 time: 0.413162 Aug 30 18:19:44.884084 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1042/2029] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:44 2022] DELETE /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:44.896548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0213e3d-a1f7-4497-96ee-b6fe9bd27106 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56afd280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:44.972019 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0213e3d-a1f7-4497-96ee-b6fe9bd27106 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.086503 Aug 30 18:19:44.974634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1043/2030] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:44 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:44.988665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:45.001834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:45.025300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.026981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.031459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.033235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.034942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.036939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.181065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.195528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc960ca5-891f-42a7-a900-85d1a1c05661 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.546192 Aug 30 18:19:45.203541 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 988/2031] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:44 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:45.222173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:45.224019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:45.237308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.239452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.240220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.241043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.242393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.246297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.398480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.408340 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-10af0300-aed7-4909-9530-76fa80f552b9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1518 microversion: 2.1 time: 0.431206 Aug 30 18:19:45.422619 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1044/2032] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:44 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:45.491842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:45.492952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:45.508342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.510188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.510897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.515432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:45.519496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:45.520457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:45.682313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.696894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.718727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.720405 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b9fce39-6279-48ed-8ab3-19a9b413d1d8 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.234707 Aug 30 18:19:45.722917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1045/2033] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:45 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:45.794149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:45.829486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d50312a-9aa0-4a8e-a561-b6a4c20eb8b5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.622431 Aug 30 18:19:45.836746 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 989/2034] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:45 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:45.993735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53e87e20-e873-4ae9-969d-e30d123415e7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56d41940>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:46.094859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53e87e20-e873-4ae9-969d-e30d123415e7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.110430 Aug 30 18:19:46.103375 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1046/2035] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:45 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:46.228280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:46.231055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:46.271276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.271689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.272169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.272960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.273438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.273867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.430251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:46.431193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:46.446663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.450943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.451609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.454297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.461011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.468079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.595850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:46.627716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a40f1a1-5644-45cb-b608-6dbffc2e80aa tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.410678 Aug 30 18:19:46.628733 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 990/2036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:46 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:46.743300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:46.743925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:46.757636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.758188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.758668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.759418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:46.759884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:46.760312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:46.988113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:47.025324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:47.029217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:47.041075 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af76cf5e-7ba7-4f62-b184-d05918932b2f tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 200 len: 1265 microversion: 2.25 time: 0.301887 Aug 30 18:19:47.064013 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 991/2037] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:46 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:19:47.079040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:47.079841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:47.100995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.101926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.102572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:47.103492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.104109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.106595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:47.622879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:47.664315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b9e0274-03aa-4c38-bf61-e7841c924e12 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.592443 Aug 30 18:19:47.678374 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 992/2038] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:47 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:47.683092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d638fd1-2033-4326-8b67-594ee2b2536a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e565d8c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:47.792563 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d638fd1-2033-4326-8b67-594ee2b2536a tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.123918 Aug 30 18:19:47.807927 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 993/2039] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:47 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:47.816924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:47.823170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:47.868296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.871615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.872796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:47.885067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:47.886593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:47.887768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.237247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:48.263295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-879168fa-2e20-435c-ac19-29c10ce2e7d0 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1518 microversion: 2.1 time: 1.837864 Aug 30 18:19:48.268477 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1047/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:46 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1518 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:48.274446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:48.289478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:48.312079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.312594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.313039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.313785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.317464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.320325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.383687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] HTTP exception thrown: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Request method failure captured: Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 HTTP/1.1 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLqwUOyA7LuEkCUlqYrsnNqBZKhN8FSQ3NVh41o_NKFzfoMAYoBz623LfPK8LAjUsBG62J0VEWfgBiAU-o6aKYcIurLSUrJ4ONAfENtHSrKagR48BEicjWVKUU_E2kLNeLSzF4TqoX2jeupOq4h7YbI_J5KC8JhZgXNh7N3zSWk-gM Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6774c9dbc6b44018a09893dabeee643a Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089'} Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. Aug 30 18:19:48.385725 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. Aug 30 18:19:48.392213 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:48.398569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Returning 404 to user: Instance 2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:19:48.400137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20bfbe37-2332-419b-bd24-5ffdc2107fe4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089" status: 404 len: 111 microversion: 2.25 time: 0.130106 Aug 30 18:19:48.400751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1048/2041] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:48 2022] GET /compute/v2.1/servers/2c63e0a2-b5f4-4cb6-8ad8-71cc5aca2089 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:19:48.486239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:48.502260 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-824e90d4-492f-4159-a366-c6d0068f670c tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.692178 Aug 30 18:19:48.504017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 994/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:47 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:48.690811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:48.691621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:48.701635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.703497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.705083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.710956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.724492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.725307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.809867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252ca05b-b434-4391-b93d-af5c4cd29425", "name": "network-vif-deleted", "tag": "883f528f-d73b-455b-a484-3f46be46fff1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:48.836936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:48.837677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:48.838113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:48.876753 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] Creating event network-vif-deleted:883f528f-d73b-455b-a484-3f46be46fff1 for instance 252ca05b-b434-4391-b93d-af5c4cd29425 on n-h2-854119-10 Aug 30 18:19:48.887144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f404f990-0832-4392-99d7-ef519322db29 req-115b98c1-471a-4ad7-a33a-164455f8d2a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083247 Aug 30 18:19:48.887858 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 995/2043] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:19:48.896492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1bde270-a8d7-47f1-adcb-79b682966a63 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e5663d8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:49.014723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1bde270-a8d7-47f1-adcb-79b682966a63 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.124349 Aug 30 18:19:49.017623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 996/2044] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:48 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:49.299973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:49.300730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:49.303573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:49.340066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:49.340418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:49.340967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.341794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:49.342313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:49.351386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.463126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:49.463632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:49.464076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.464550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lazy-loading 'fault' on Instance uuid 252ca05b-b434-4391-b93d-af5c4cd29425 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:49.498628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:49.518578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b914f98-f387-4734-ae34-c4cb47513a02 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 0.831566 Aug 30 18:19:49.522532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1049/2045] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:48 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:49.541919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-273d7683-0f42-4fef-b642-ce0ea947937d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Action: 'create', calling method: .version_select at 0x7f4e56d41e50>, body: {"keypair": {"name": "tempest-keypair-1121363298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+umSInUdrQKKEViHX1WUKx1o3J9sfkANaTXF+Gc7o53x/Oj5qYf0RdUklJYjfjV1TcAFrCVu0DdqwyxzKVvV71NXwbUlkgpHgBi7Cx8ZHxdT4HqYmSy/G8SF/xqzhHlg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:49.563607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:49.573073 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00aec808-761b-4169-972e-b09654a606e9 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 200 len: 1311 microversion: 2.1 time: 0.277020 Aug 30 18:19:49.573942 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 997/2046] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:49 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:49.579984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:49.580816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:49.588297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:49.589020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:49.589612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.590557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:49.591184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:49.591775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:49.597255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-273d7683-0f42-4fef-b642-ce0ea947937d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Getting quotas for project 1680292b36ac42deb267e040910c8194. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:19:49.613917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-273d7683-0f42-4fef-b642-ce0ea947937d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Getting quotas for user a12223f3ae4c440895564252bc80b3eb and project 1680292b36ac42deb267e040910c8194. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:19:49.682805 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-273d7683-0f42-4fef-b642-ce0ea947937d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.159003 Aug 30 18:19:49.684228 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1050/2047] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:19:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:19:49.903327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:49.936862 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-344f8833-b16e-463d-b892-e7776de4fd07 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.359838 Aug 30 18:19:49.962775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 998/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:49 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:50.032263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40edd621-5408-4345-8be7-00321eb9c717 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e5663d160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:50.186268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fa5066-6bfc-4719-b1cf-db750750e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "462321ce-718b-4f9c-99e7-b5beb8bde24d"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:50.220118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.220600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.220962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.230489 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-40edd621-5408-4345-8be7-00321eb9c717 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.200271 Aug 30 18:19:50.231189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 999/2049] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:50 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:50.267846 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] Creating event network-vif-plugged:462321ce-718b-4f9c-99e7-b5beb8bde24d for instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 on n-h1-854119-10 Aug 30 18:19:50.275873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2b44db47-be81-44a0-933b-0f71ab5dac94 req-c3cdc92b-0d82-4475-a5f0-11d737530938 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321280 Aug 30 18:19:50.276917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1051/2050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:50.543592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:50.544542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:50.570052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.571272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.571820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.575322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.576411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.580947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.601950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:50.602985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 252ca05b-b434-4391-b93d-af5c4cd29425] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:50.625997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.627542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.631460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.634144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.634963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.637659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.705032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] HTTP exception thrown: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Request method failure captured: Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 HTTP/1.1 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlRUZEGnIF9uhvds8T0QgZ3SQp80K595ejJRl_XS6THF2XXwJxoQRmH4cTYptCV0HUW0csuqRmhsCaIJEMnYNJtn1TtFaIg4A3Y-1lZrxS8EDo81nNHnubsPDqjPztwfUK5w5FTo5-0pXKkHllisLEvzjwfJE7Cb7EjmVlIPbXs6Fb8 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89cfeb97afa342df912b046bea6023b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: fea7bfb1bebd47a7bf227b89a77fbc72 Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '252ca05b-b434-4391-b93d-af5c4cd29425'} Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:50.718960 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Returning 404 to user: Instance 252ca05b-b434-4391-b93d-af5c4cd29425 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be825bc3-c652-4bf4-adf6-c22e95000940 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425" status: 404 len: 111 microversion: 2.1 time: 0.127169 Aug 30 18:19:50.725256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1052/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:50 2022] GET /compute/v2.1/servers/252ca05b-b434-4391-b93d-af5c4cd29425 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:19:50.733380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:50.736904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:50.747815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.749354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.749794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.754719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:50.756400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:50.756855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:50.832261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:51.023047 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fe54e12-6b39-454d-b9f0-627bb3a69f20 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 204 len: 0 microversion: 2.1 time: 0.294089 Aug 30 18:19:51.024051 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1053/2052] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:50 2022] DELETE /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:51.031621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:51.032465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:51.055322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.056230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.062330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.063314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.063903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.065078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.581542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:51.604735 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e0f6776-f909-4031-911f-85e01beaabf5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 1.064771 Aug 30 18:19:51.620461 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1000/2053] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:50 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:51.644530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:51.646071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:51.668997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:51.671161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.672392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.682129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.683334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:51.684042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:51.684746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:51.687088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:51.708140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:51.745932 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00a33ac9-ed67-4ccd-afe2-c2e0fb288f3a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.718169 Aug 30 18:19:51.751497 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1054/2054] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:51 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:51.769586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc00f596-d3f1-4229-957c-f6696a403935 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e57400af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:51.788967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:51.918884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc00f596-d3f1-4229-957c-f6696a403935 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.163823 Aug 30 18:19:51.923383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1055/2055] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:51 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:52.168493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:52.178431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-037e8ff3-7ddd-46dd-b6c8-1862acce0eec tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1517 microversion: 2.1 time: 0.556360 Aug 30 18:19:52.180363 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1001/2056] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:51 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1517 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:52.596929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d26ffd-b054-4f05-a06f-246822e47992", "name": "network-vif-plugged", "status": "completed", "tag": "4c0b1a71-dd4a-4b2d-b825-632131dc76ab"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:52.632883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:52.633856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:52.660325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.661270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.662046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.674580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.683792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.689037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.702925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.709195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.714013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.791006 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] Creating event network-vif-plugged:4c0b1a71-dd4a-4b2d-b825-632131dc76ab for instance a6d26ffd-b054-4f05-a06f-246822e47992 on n-h2-854119-10 Aug 30 18:19:52.844045 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bfade2a4-d05b-42b7-8362-e46d1e9cfd37 req-db4ea3ed-35ee-4969-8a61-5b94b8244de4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255186 Aug 30 18:19:52.844878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1056/2057] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:52.860373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:52.861641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:52.873890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.874499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.874915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:52.875675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:52.892945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:52.893756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:53.757648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:54.612290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:54.620977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:19:54.667901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05dbcc66-c2a6-400d-b259-5573a883b618 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 1.820590 Aug 30 18:19:54.674711 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1057/2058] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:52 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:54.727772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-396a5858-cbcf-4290-a3c1-82e8de8247e2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56b54280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:54.875447 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-396a5858-cbcf-4290-a3c1-82e8de8247e2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.167410 Aug 30 18:19:54.884380 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1058/2059] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:54 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:54.912851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:54.920795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:54.962769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:54.972063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:54.976527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:54.979046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:54.983202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:54.985221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:55.052637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:55.082946 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e033150-c717-4628-949e-7a21c15090c5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1313 microversion: 2.1 time: 2.439839 Aug 30 18:19:55.083758 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1002/2060] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:52 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1313 bytes in 2460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:55.109934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4", "name": "network-vif-deleted", "tag": "977a737b-f17a-4418-a601-8c9175757e80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:55.164783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:55.170055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:55.171124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:55.200314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:55.214927 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] Creating event network-vif-deleted:977a737b-f17a-4418-a601-8c9175757e80 for instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 on n-h1-854119-10 Aug 30 18:19:55.216727 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd142898-7cbd-4b4b-9584-78a3f5521a88 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1305 microversion: 2.1 time: 0.330320 Aug 30 18:19:55.217836 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1059/2061] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:54 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1305 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:55.226769 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-177a16df-fb53-4baa-ba7b-46c036389443 req-9306927c-fcd0-4a7f-895f-d9361001f686 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126265 Aug 30 18:19:55.241425 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1003/2062] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:19:55.712547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:55.718615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:55.735944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:55.737114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:55.739124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:55.740989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:55.743012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:55.749179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:55.898993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e5da0c4-7dc9-4674-8ac1-808c0da01827 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566f6a60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:55.996946 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e5da0c4-7dc9-4674-8ac1-808c0da01827 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.103392 Aug 30 18:19:56.000222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1004/2063] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:55 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:56.104981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:56.106647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:56.126497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.127455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.128135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.129193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.129939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.130879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.189232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:56.212172 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fe35d6b-e63e-45c6-85d0-43d842dd0cf2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.502994 Aug 30 18:19:56.218564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1060/2064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:55 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:56.240884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:56.242280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:56.268800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.270173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.271216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.272705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.277456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.278522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.403698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.404641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.406167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.409343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lazy-loading 'fault' on Instance uuid ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:56.550673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:56.576411 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac183e58-73c6-44e4-98e6-b83cc7568bac tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 200 len: 1310 microversion: 2.1 time: 0.331517 Aug 30 18:19:56.591166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1061/2065] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:56 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:56.915009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:56.933276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-343857228", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1a766d50-e263-467d-b516-cb6b8339caf2"}, {"port": "fdf7ba45-d5a0-471a-829e-43218c97999f", "tag": "port-1"}, {"port": "3012161b-7ba2-4442-9060-f57a7f5ad3fe", "tag": "port-2"}, {"uuid": "445f3130-93cd-4d1c-8b08-9df99384649d", "tag": "net-1"}, {"uuid": "445f3130-93cd-4d1c-8b08-9df99384649d"}, {"uuid": "a7fbec3a-ca38-4dc0-b455-faaf7b128619", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a7fbec3a-ca38-4dc0-b455-faaf7b128619", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "26b4f23a-cd6d-429e-afdb-32b4a445feae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f985755f-cb36-4781-b8cc-560dfa139250", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "37ea4232-84c8-481d-939f-517dc5c54493", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1238179984"}], "key_name": "tempest-keypair-1121363298", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:56.936309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b520570e-32b4-4796-936b-4e04a933b155 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1501 microversion: 2.1 time: 0.834255 Aug 30 18:19:56.938253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1005/2066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:56 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1501 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:19:56.968403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:19:56.970856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:56.987156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:56.997129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:56.997923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:56.998924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:57.004676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:57.005518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:57.086965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lazy-loading 'flavor' on Instance uuid 89fa5066-6bfc-4719-b1cf-db750750e1c0 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:19:57.274852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] validate_networks() for [('1a766d50-e263-467d-b516-cb6b8339caf2', None, None, None, None, None), (None, None, 'fdf7ba45-d5a0-471a-829e-43218c97999f', None, None, None), (None, None, '3012161b-7ba2-4442-9060-f57a7f5ad3fe', None, None, None), ('445f3130-93cd-4d1c-8b08-9df99384649d', None, None, None, None, None), ('445f3130-93cd-4d1c-8b08-9df99384649d', None, None, None, None, None), ('a7fbec3a-ca38-4dc0-b455-faaf7b128619', '10.2.2.100', None, None, None, None), ('a7fbec3a-ca38-4dc0-b455-faaf7b128619', '10.2.2.200', None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:19:57.428778 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea546b19-2c7b-412f-bd7c-1b98f8aadcdd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0/action" status: 202 len: 0 microversion: 2.1 time: 0.468418 Aug 30 18:19:57.430667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1006/2067] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:19:56 2022] POST /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:19:57.439460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1df2d5c4-45b8-4cdf-b3c7-ba4672cc1ce7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e564ba820>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:57.515096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1df2d5c4-45b8-4cdf-b3c7-ba4672cc1ce7 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.081954 Aug 30 18:19:57.515697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1007/2068] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:57 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:57.532912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:57.535642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:57.553206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:57.554057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:57.554771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:57.556968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:57.560191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:57.560912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.044722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:58.080069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0eab22b-ef8d-4c53-835b-a51dd1d73a19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.560516 Aug 30 18:19:58.081047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1008/2069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:57 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:58.099326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.100198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.112567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.113436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.114190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.115137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.116133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.116825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.453327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:19:58.463087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1d14464-8336-40a5-8c1b-8440e70546a3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.368789 Aug 30 18:19:58.483481 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1009/2070] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:58 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:58.483481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.483481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.502638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.503137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.503712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.504465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.506725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.509148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.537529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] HTTP exception thrown: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Request method failure captured: Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 HTTP/1.1 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlRUZEGnIF9uhvds8T0QgZ3SQp80K595ejJRl_XS6THF2XXwJxoQRmH4cTYptCV0HUW0csuqRmhsCaIJEMnYNJtn1TtFaIg4A3Y-1lZrxS8EDo81nNHnubsPDqjPztwfUK5w5FTo5-0pXKkHllisLEvzjwfJE7Cb7EjmVlIPbXs6Fb8 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89cfeb97afa342df912b046bea6023b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: fea7bfb1bebd47a7bf227b89a77fbc72 Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4'} Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:19:58.543775 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Returning 404 to user: Instance ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3739bebc-754e-458a-9b90-f774b30cc1ea tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4" status: 404 len: 111 microversion: 2.1 time: 0.073058 Aug 30 18:19:58.548729 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1010/2071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:19:58 2022] GET /compute/v2.1/servers/ce2b36d8-21cf-4d9c-bfe7-c7a96ad249d4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:19:58.553454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.554048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.562567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.563079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.563595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.564318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.564930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.565468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.639568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:58.857453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52f10338-2707-4558-9796-52a58f88bcfa tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 204 len: 0 microversion: 2.25 time: 0.308331 Aug 30 18:19:58.858315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1011/2072] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:19:58 2022] DELETE /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:19:58.863857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91824187-3e08-43c6-94a6-fc5c183ae5ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e564089d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.974245 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91824187-3e08-43c6-94a6-fc5c183ae5ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.114221 Aug 30 18:19:58.978504 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1012/2073] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:19:58 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:19:58.983782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:58.984428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:58.992510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.993100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.993549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:58.994290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:58.994918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:58.995763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:59.047286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:19:59.332472 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-79617d6f-ab38-4d16-abf5-ced8a967bd85 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 204 len: 0 microversion: 2.1 time: 0.350797 Aug 30 18:19:59.333661 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1013/2074] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:19:58 2022] DELETE /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:19:59.354101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:19:59.354101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:19:59.371535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:59.372417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:59.373373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:59.374724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:19:59.375657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:19:59.376434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:19:59.642021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:00.266501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:00.302449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:00.305900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:00.317116 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a02e6cc-360f-461e-a59c-482ac1e411ca tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1729 microversion: 2.25 time: 0.979077 Aug 30 18:20:00.322194 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1014/2075] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:19:59 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1729 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:00.347315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:00.349498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:00.374989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:00.375765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:00.376534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:00.388546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:00.390844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:00.391619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:00.786063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:00.801837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6c2242e-d74e-450a-956a-07bf10545df8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.477916 Aug 30 18:20:00.818573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1015/2076] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:00 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:00.831722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:00.832839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:00.876265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:00.877362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:00.878152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:00.883756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:00.885416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:00.886982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:01.393682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:01.426941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-203184ce-d226-4a70-9e7e-f47a15580c2e tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1517 microversion: 2.1 time: 0.606604 Aug 30 18:20:01.429084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1016/2077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:00 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1517 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:01.439580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:01.441462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:01.465192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:01.470552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:01.472905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:01.475476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:01.477887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:01.482029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:01.500782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:01.708724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:01.710181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:01.711177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:01.713490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:01.714443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:01.761407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:01.763524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:01.768153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:01.772536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:01.774419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:01.775953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:01.873652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Getting quotas for project 1680292b36ac42deb267e040910c8194. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:01.903055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Getting quotas for user a12223f3ae4c440895564252bc80b3eb and project 1680292b36ac42deb267e040910c8194. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:01.992051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:02.012723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-830dc68a-4814-42e0-a76e-23b13f746cd9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.581435 Aug 30 18:20:02.027153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1017/2078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:01 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:02.032235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48e683dc-6366-4dfa-8bb9-8d3009a18c2b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566eb550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:02.138601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48e683dc-6366-4dfa-8bb9-8d3009a18c2b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.109779 Aug 30 18:20:02.150461 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1018/2079] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:02 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:02.173683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:02.181308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:02.213654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:20:02.214589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:02.215461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:02.216279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:02.216995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='26b4f23a-cd6d-429e-afdb-32b4a445feae',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f985755f-cb36-4781-b8cc-560dfa139250',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37ea4232-84c8-481d-939f-517dc5c54493',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:20:02.220915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:02.222627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:02.224796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:02.511557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:02.562298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:02.573290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:02.593073 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0205971-6531-48d7-b99a-c8822eb23031 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1663 microversion: 2.25 time: 0.426888 Aug 30 18:20:02.597047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1019/2080] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:02 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1663 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:02.626911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:02.632865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:02.681214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:02.684261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:02.684898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:02.685909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:02.686560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:02.690221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.085416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.095754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52b88999-4f2d-4c9e-96d9-7016ae673bcf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.494970 Aug 30 18:20:03.114492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1020/2081] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:02 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:03.114492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:03.114492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.132694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.201715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25a15aa4-5cfd-4854-92df-b769f6b5e057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.276532 Aug 30 18:20:03.211115 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1062/2082] 10.222.0.25 () {62 vars in 1189 bytes} [Tue Aug 30 18:19:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 6287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 18:20:03.217271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7b0c7-d077-48d1-8342-8175f4e4c3cd", "name": "network-vif-deleted", "tag": "a79b3418-ae05-4c24-9d13-6e0d889becf9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:03.229348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.230122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.230834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.231490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lazy-loading 'fault' on Instance uuid 1a70c470-7d78-4f95-b30f-8639054d5e6d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:20:03.247535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.253528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.254059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.310190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] Creating event network-vif-deleted:a79b3418-ae05-4c24-9d13-6e0d889becf9 for instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd on n-h1-854119-10 Aug 30 18:20:03.320154 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b012953-44a0-47b7-9b75-879e9d839d92 req-273f3078-44d3-48d0-a017-9fdbfa1339de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106693 Aug 30 18:20:03.321574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1063/2083] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:03.351295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea7bfb1bebd47a7bf227b89a77fbc72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cfeb97afa342df912b046bea6023b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.359830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:03.360770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:03.368816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e348938-0372-4b2c-80b8-cc197063cd5d tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 200 len: 1310 microversion: 2.1 time: 0.269367 Aug 30 18:20:03.371048 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1021/2084] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:03 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:03.379026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fecfcdbb-baec-4bd9-bdf2-7c4d6f490463 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56630040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:03.383025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.385319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.385929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.389278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.390006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.394303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.480609 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fecfcdbb-baec-4bd9-bdf2-7c4d6f490463 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.107856 Aug 30 18:20:03.492950 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1022/2085] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:03 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:03.517662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:03.525002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:03.743234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.764227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.775034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.776652 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-603055ae-843c-4daf-b6f4-36e183487e28 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1285 microversion: 2.32 time: 0.282025 Aug 30 18:20:03.780083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1023/2086] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:03 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1285 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:03.782141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:03.803233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b61c69c-11dc-488b-8ad7-41ca48d9d59e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.477906 Aug 30 18:20:03.806326 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1064/2087] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:03 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:03.815762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:03.819479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:03.843424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.843965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.844925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.845787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.848026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.848692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.938805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:03.938805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:03.939366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:03.939984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lazy-loading 'fault' on Instance uuid b6b7b0c7-d077-48d1-8342-8175f4e4c3cd {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:20:04.142519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:04.143604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:04.156573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.158771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.160419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:04.161543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.162856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.166689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:04.336776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:04.360325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:04.367843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:04.374066 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30ee088b-1956-471b-929a-c43fb8a81075 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 200 len: 1375 microversion: 2.25 time: 0.589107 Aug 30 18:20:04.376044 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1024/2088] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:03 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 1375 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:04.410212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:04.411992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] [instance: 1a70c470-7d78-4f95-b30f-8639054d5e6d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:04.442033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.447451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.450395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:04.458688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.473287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.481750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:04.484185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:04.525268 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] HTTP exception thrown: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Request method failure captured: Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d HTTP/1.1 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlRUZEGnIF9uhvds8T0QgZ3SQp80K595ejJRl_XS6THF2XXwJxoQRmH4cTYptCV0HUW0csuqRmhsCaIJEMnYNJtn1TtFaIg4A3Y-1lZrxS8EDo81nNHnubsPDqjPztwfUK5w5FTo5-0pXKkHllisLEvzjwfJE7Cb7EjmVlIPbXs6Fb8 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89cfeb97afa342df912b046bea6023b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89cfeb97afa342df912b046bea6023b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 89cfeb97afa342df912b046bea6023b8 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-599014959 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: fea7bfb1bebd47a7bf227b89a77fbc72 Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListServerFiltersTestJSON-599014959-project Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1a70c470-7d78-4f95-b30f-8639054d5e6d'} Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:04.529196 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. Aug 30 18:20:04.532380 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:04.537457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] Returning 404 to user: Instance 1a70c470-7d78-4f95-b30f-8639054d5e6d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:04.540476 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1509b6c1-d504-4dc3-a18e-639ca3048542 tempest-ListServerFiltersTestJSON-599014959 tempest-ListServerFiltersTestJSON-599014959-project] 10.222.0.25 "GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d" status: 404 len: 111 microversion: 2.1 time: 0.135369 Aug 30 18:20:04.542661 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1025/2089] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:04 2022] GET /compute/v2.1/servers/1a70c470-7d78-4f95-b30f-8639054d5e6d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:20:04.559658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b3e14420-ad23-4ab3-adec-446c1218764c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566bbca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:04.560542 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5bf652b8-7ac1-46c7-ae03-1c78f714c6c9 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.403089 Aug 30 18:20:04.563169 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1065/2090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:04 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:20:04.665259 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b3e14420-ad23-4ab3-adec-446c1218764c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.119522 Aug 30 18:20:04.676465 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1026/2091] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:04 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:04.810145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:04.811263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:04.841147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:04.841815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:04.864790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.866266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.868986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:04.870563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:04.880334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:04.881412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.080201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:05.092876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:05.095715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:05.111482 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-08523286-cdc9-4c40-a87a-4da9bc9cff51 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1285 microversion: 2.32 time: 0.308143 Aug 30 18:20:05.112051 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1066/2092] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:04 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:05.291190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:05.305183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7291c77-85c5-411f-a027-7d2b79bece1e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.467657 Aug 30 18:20:05.311823 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1027/2093] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:04 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:05.355045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a70c470-7d78-4f95-b30f-8639054d5e6d", "name": "network-vif-deleted", "tag": "5f9ad00e-1596-4afb-b44f-b698c81bff7e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:05.379538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:05.389685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:05.390674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.398066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:05.398832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: b6b7b0c7-d077-48d1-8342-8175f4e4c3cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:05.416720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:05.418298 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] Creating event network-vif-deleted:5f9ad00e-1596-4afb-b44f-b698c81bff7e for instance 1a70c470-7d78-4f95-b30f-8639054d5e6d on n-h2-854119-10 Aug 30 18:20:05.420720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:05.423258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.431766 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-83a11671-997d-40af-8f3b-3fc86b477f2c req-4cb532da-a414-4f08-934d-8db407b1d985 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080145 Aug 30 18:20:05.432752 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1067/2094] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:05.435803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:05.436316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:05.436768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.465580 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] HTTP exception thrown: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Request method failure captured: Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd HTTP/1.1 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLqwUOyA7LuEkCUlqYrsnNqBZKhN8FSQ3NVh41o_NKFzfoMAYoBz623LfPK8LAjUsBG62J0VEWfgBiAU-o6aKYcIurLSUrJ4ONAfENtHSrKagR48BEicjWVKUU_E2kLNeLSzF4TqoX2jeupOq4h7YbI_J5KC8JhZgXNh7N3zSWk-gM Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6774c9dbc6b44018a09893dabeee643a Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b6b7b0c7-d077-48d1-8342-8175f4e4c3cd'} Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. Aug 30 18:20:05.467490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. Aug 30 18:20:05.471358 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:05.472773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Returning 404 to user: Instance b6b7b0c7-d077-48d1-8342-8175f4e4c3cd could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:05.473871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8a3640b-15c1-410a-b63c-2f667bcf7172 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd" status: 404 len: 111 microversion: 2.25 time: 0.080603 Aug 30 18:20:05.475109 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1028/2095] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:05 2022] GET /compute/v2.1/servers/b6b7b0c7-d077-48d1-8342-8175f4e4c3cd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:20:05.483728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3f3c2af-8d08-4082-8137-a97a5e7a0d89 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '.version_select at 0x7f4e56b78a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:05.536919 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3f3c2af-8d08-4082-8137-a97a5e7a0d89 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883248818" status: 204 len: 0 microversion: 2.25 time: 0.056014 Aug 30 18:20:05.542540 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1068/2096] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Aug 30 18:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883248818 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:20:05.590547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:05.591826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:05.604792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:05.605538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:05.606153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.607088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:05.609496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:05.610088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:05.685576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-036d717b-cb2d-42d9-ae12-44d0aead3894 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56afd4c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:05.802735 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-036d717b-cb2d-42d9-ae12-44d0aead3894 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.120613 Aug 30 18:20:05.803623 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1069/2097] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:05 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:06.164849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:06.166142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:06.200550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:06.201780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:06.204100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:06.212080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:06.221583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:06.225419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:06.248847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:06.272747 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c000397b-7768-497e-b3ad-30624e9b9839 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.685908 Aug 30 18:20:06.299208 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1029/2098] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:05 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:06.336604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:06.340302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:06.375757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:06.376724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:06.377577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:06.389878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:06.393653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:06.396317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:06.440332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:06.483729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:06.490776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:06.492395 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f926761a-448a-41a6-8f66-c9e0d29a3759 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1519 microversion: 2.32 time: 0.334448 Aug 30 18:20:06.510487 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1070/2099] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:06 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1519 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:06.822186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f187f0e8-7389-47f2-a005-0e60f5c0580e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56f7d3a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:06.948191 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f187f0e8-7389-47f2-a005-0e60f5c0580e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.131880 Aug 30 18:20:06.949267 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1071/2100] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:06 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:20:07.329361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:07.330407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:07.345270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:07.351106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:07.351888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:07.352893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:07.353655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:07.354006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:07.703447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:07.711835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:07.755766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-895eb2bb-74d7-43b4-babf-a85da4eb4f03 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 1.415716 Aug 30 18:20:07.756362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b12d23cf-f14c-414a-a37f-209a7f29d2a2 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.431108 Aug 30 18:20:07.757420 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1072/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:07 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:07.759798 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1030/2102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:06 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:07.793803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:07.797730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:07.810902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:07.811390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:07.813631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:07.815388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:07.819108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:07.819788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:07.933979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:07.944629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:07.968338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:07.969844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a0e0882-10ab-4bb9-b7e3-4f9bc259be60 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1593 microversion: 2.32 time: 0.211094 Aug 30 18:20:07.974726 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1073/2103] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:07 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1593 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:07.978511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc462f2b-6774-4a3e-9caf-4f2f742f4e90 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56408d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:08.117361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc462f2b-6774-4a3e-9caf-4f2f742f4e90 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.147455 Aug 30 18:20:08.118005 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1031/2104] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:07 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:08.791314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:08.792965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:08.812312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:08.819856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:08.827454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:08.828192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:08.828805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:08.829674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:08.835842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:08.836047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:08.836857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:08.840141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:08.841602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:08.843024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:08.844029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:08.845253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.112318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:09.125899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-45139aa7-f3e4-4218-acd6-62cb143c58b3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.347562 Aug 30 18:20:09.126539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1074/2105] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:08 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:09.158567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:09.159698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:09.167741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:09.170243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.171135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.171831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.172828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.174131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.174856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.273428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:09.289223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:09.296188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:09.303258 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-331ac84d-e10b-4534-aedf-5eb0b9b08cc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1593 microversion: 2.32 time: 0.158165 Aug 30 18:20:09.330834 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1075/2106] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:09 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1593 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:09.342925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:09.343743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:09.376323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.382256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.383074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.389440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.390242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.390915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.449812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:20:09.460294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:09.509320 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08c52449-629e-4787-abdf-1888481ef77a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1509 microversion: 2.1 time: 0.710249 Aug 30 18:20:09.512468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1032/2107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:08 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1509 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:09.526447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b6555bf-30be-440b-96b1-4278e12d65e2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566d75e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:09.580355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f751752a-3cc2-484b-a340-97ffaf00cc41 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 204 len: 0 microversion: 2.25 time: 0.246153 Aug 30 18:20:09.581803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1076/2108] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:20:09 2022] DELETE /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:20:09.595182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:09.596172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:09.608670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.609656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.610333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.611341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:09.612059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:09.612698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:09.642432 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b6555bf-30be-440b-96b1-4278e12d65e2 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.119446 Aug 30 18:20:09.646150 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1033/2109] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:09 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:10.002304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:10.020045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:10.023260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:10.025893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9cc0ee93-ea86-4a3b-b98f-3c125ecdc7f4 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1548 microversion: 2.25 time: 0.438076 Aug 30 18:20:10.027889 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1077/2110] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:09 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1548 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:10.187193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:10.239869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:10.263418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.265083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.267396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:10.269390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.270800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.271914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:10.329679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:10.331950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:10.360039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.366930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.370517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:10.374620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.375928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.377358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:10.776856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:10.804584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-785cf96b-320c-4d91-b7b1-c89da996f4d4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.653477 Aug 30 18:20:10.806198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1034/2111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:10 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:20:10.834789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:10.841439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:10.860818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.871233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.877132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:10.878374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:10.879014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:10.884213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:11.554276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:11.572219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bac4de2a-abb9-4a24-84b1-f42d925c1628 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1486 microversion: 2.1 time: 0.744257 Aug 30 18:20:11.588279 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1035/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:10 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1486 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:11.610111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-842b2d48-a356-4ac1-8e8b-0ec4f962c1e5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e565d8f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:11.688477 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-842b2d48-a356-4ac1-8e8b-0ec4f962c1e5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.098886 Aug 30 18:20:11.689408 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1036/2113] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:11 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:11.700509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:11.703786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:11.720675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:11.723103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:11.725555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:11.727526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:11.729007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:11.731437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:11.833795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:11.957186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:11.994707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:11.996623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:11.999674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcec3b23-524c-4114-8a45-5a0981b326f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1661 microversion: 2.32 time: 1.674181 Aug 30 18:20:12.004107 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1078/2114] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:10 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1661 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:20:12.013204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1279953494"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:12.023181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:12.044810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.045781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.046332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.050208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.053025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.053672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.161129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:12.266623 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9c908d8-e8e3-48e1-8b8c-fdc388154235 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "PUT /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1060 microversion: 2.1 time: 0.261015 Aug 30 18:20:12.267958 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1079/2115] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:20:12 2022] PUT /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1060 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:12.276887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:12.277710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:12.288400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.289154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.289740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.291261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.291912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.292709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.584749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:12.614583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:12.624703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:12.630990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed61d8b1-d367-4411-bb84-0a6d778d3681 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 200 len: 1548 microversion: 2.25 time: 0.932356 Aug 30 18:20:12.634093 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1037/2116] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:11 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 1548 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:12.657347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b48c5-5ba4-4ec3-9b6d-43841332c913", "name": "network-vif-deleted", "tag": "0eca8698-165b-4ee7-a71e-96c553b7c4fc"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:12.695312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.703884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.705243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.753970 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] Creating event network-vif-deleted:0eca8698-165b-4ee7-a71e-96c553b7c4fc for instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 on n-h1-854119-10 Aug 30 18:20:12.777854 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4fec67fe-fabf-479b-a36f-a300814b90b3 req-2981342c-74c4-42eb-9caf-0bb2809187f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136339 Aug 30 18:20:12.780028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1038/2117] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:12.798897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:12.803316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:12.847388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.848408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.848979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.849933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:12.854785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:12.855737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:12.979882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:12.990893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5678e6be-7e63-43a8-a27a-d0e9a2043421 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.719309 Aug 30 18:20:12.991685 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1080/2118] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:12 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:13.348646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1247244861", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:13.465618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:13.465780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:13.466273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:13.466947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:13.468002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:13.478589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:13.519468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.522036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.526188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:13.535480 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84a479bf-96c5-4ed3-a32f-7f087512073b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1487 microversion: 2.1 time: 0.750309 Aug 30 18:20:13.537457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.542822 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1039/2119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:12 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1487 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:13.543558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.548383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:13.584469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e636c64-c552-450f-b879-49fe8c4cc6e3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566bbd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:13.687880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Getting quotas for project 41b61486c14a4585bebfc770b2a688b4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:13.732032 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e636c64-c552-450f-b879-49fe8c4cc6e3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.185566 Aug 30 18:20:13.734806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Getting quotas for user 3f65e82186664f75adbf08084359652d and project 41b61486c14a4585bebfc770b2a688b4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:13.735215 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1040/2120] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:13 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:13.753455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:13.758211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:13.765879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:13.789357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:20:13.791991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.792178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:20:13.792508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.794877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:13.797018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.798697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.799398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:13.896907 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4f7fb54-fda9-40aa-bc4e-3fba695d2131 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.903940 Aug 30 18:20:13.898197 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1081/2121] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:20:13.914498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:13.915918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:13.924159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.932430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.933168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:13.934079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:13.934751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:13.935341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:14.713417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:14.753433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66e71612-7465-423e-9b18-36f8bb457253 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1487 microversion: 2.1 time: 0.840066 Aug 30 18:20:14.767016 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1082/2122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:13 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1487 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:14.787044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:14.790385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 6d7b48c5-5ba4-4ec3-9b6d-43841332c913] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:14.824612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:14.825125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:14.825566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:14.826304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:14.840255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:14.841182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:14.886458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] HTTP exception thrown: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Request method failure captured: Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 HTTP/1.1 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlLqwUOyA7LuEkCUlqYrsnNqBZKhN8FSQ3NVh41o_NKFzfoMAYoBz623LfPK8LAjUsBG62J0VEWfgBiAU-o6aKYcIurLSUrJ4ONAfENtHSrKagR48BEicjWVKUU_E2kLNeLSzF4TqoX2jeupOq4h7YbI_J5KC8JhZgXNh7N3zSWk-gM Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6774c9dbc6b44018a09893dabeee643a Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '6d7b48c5-5ba4-4ec3-9b6d-43841332c913'} Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. Aug 30 18:20:14.893124 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:14.896874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Returning 404 to user: Instance 6d7b48c5-5ba4-4ec3-9b6d-43841332c913 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:14.898901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-567e2f1e-ae56-4638-a026-a405170c1849 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913" status: 404 len: 111 microversion: 2.25 time: 0.138111 Aug 30 18:20:14.906825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1083/2123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:14 2022] GET /compute/v2.1/servers/6d7b48c5-5ba4-4ec3-9b6d-43841332c913 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:20:14.921065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:14.921707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:15.154276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.168768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.175535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.179543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-251e3556-30f1-4d17-b30c-c1351fcf96ff tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc" status: 200 len: 1278 microversion: 2.47 time: 0.271049 Aug 30 18:20:15.182129 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1084/2124] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:14 2022] GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:15.195794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:15.198501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:15.239058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:15.240759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:15.243693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:15.248275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:15.252244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:15.252890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:15.529127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.558766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.561026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:15.562703 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77f9ad0f-d9ad-4532-860b-de20c4c02238 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1708 microversion: 2.32 time: 1.826036 Aug 30 18:20:15.567968 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1041/2125] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:13 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1708 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:15.599690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f00a580-934d-4b72-9576-076e1040d72f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e565d8c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:15.765674 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f00a580-934d-4b72-9576-076e1040d72f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.184048 Aug 30 18:20:15.774913 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1042/2126] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:15 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:15.826731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:15.830111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:15.887384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:15.891592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:15.893001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:15.894734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:15.896666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:15.897818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.034078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:20:16.102728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:16.413053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:16.458385 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18afb1ce-4cf3-4adf-a252-9bb313afea8c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 1.272018 Aug 30 18:20:16.459912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1085/2127] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:15 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:16.496523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:16.497349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:16.520025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-280501ea-58fe-4b9a-8d60-1a87c73b4a8e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 204 len: 0 microversion: 2.1 time: 0.742665 Aug 30 18:20:16.525510 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1043/2128] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:15 2022] DELETE /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:20:16.539892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2113844753", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:16.543573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.544399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.545161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.546465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.547261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.547986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.721642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:16.724638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:16.728470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:16.729741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:16.731903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:16.738880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:20:16.774747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.782091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.790383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.796115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.797160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.800606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.912890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Getting quotas for project 41b61486c14a4585bebfc770b2a688b4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:16.928011 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a9766c8-82f5-456f-b255-22277db22f9c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 204 len: 0 microversion: 2.25 time: 0.462142 Aug 30 18:20:16.931738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Getting quotas for user 3f65e82186664f75adbf08084359652d and project 41b61486c14a4585bebfc770b2a688b4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:16.935137 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1086/2129] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:20:16 2022] DELETE /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:20:16.946815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:16.953758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:16.978833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.979848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.980778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.982208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:16.983361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:16.984000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:16.995347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:20:17.006532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:20:17.085117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:17.194891 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04f7a106-c389-4d6e-a77a-a365d4885973 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.667233 Aug 30 18:20:17.196562 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1044/2130] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:20:17.565892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:17.567416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:17.594699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:17.597228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:17.598213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:17.601193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:17.602410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:17.603039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:17.878624 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-726d773b-c769-4365-b082-35d1d3f9ea73 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1813 microversion: 2.1 time: 0.931300 Aug 30 18:20:17.880708 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1087/2131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:16 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1813 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:17.894470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:17.896897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:17.915447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:17.916934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:17.919033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:17.920153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:17.923372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:17.924215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:18.625941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:18.639779 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d1c895f-231c-42bf-9744-a1c07e436c9d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1493 microversion: 2.1 time: 1.441848 Aug 30 18:20:18.649667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1045/2132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:17 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1493 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:18.672226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8b79433c-7af2-43c6-88bc-c72afe2495d6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566f3e50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:18.881059 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8b79433c-7af2-43c6-88bc-c72afe2495d6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.225450 Aug 30 18:20:18.885052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1046/2133] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:18 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:18.906131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:18.907468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:18.934287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:18.935168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:18.935725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:18.944143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:18.944143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:18.944944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:18.971226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:18.991273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:18.994246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:18.996283 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-970a883b-fb25-4bb1-809c-e5aaea801b09 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1755 microversion: 2.32 time: 1.113129 Aug 30 18:20:18.997681 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1088/2134] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:17 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1755 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:19.003009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:19.006607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:19.015263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.016029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.016697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:19.018142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.018829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.019458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:19.096435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa2984d8-8e44-4471-9d4a-b4facbb82933 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "PUT /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 992 microversion: 2.47 time: 0.096807 Aug 30 18:20:19.098215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1089/2135] 10.222.0.25 () {62 vars in 1297 bytes} [Tue Aug 30 18:20:18 2022] PUT /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 992 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:20:19.114255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:19.117150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:19.169143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.169958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.171310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:19.175103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.177594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.178860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:19.738903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:19.776962 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2ed7773-9e4b-4f49-af01-92adf55047aa tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 0.671174 Aug 30 18:20:19.786332 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1090/2136] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:19 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:19.836492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:19.853899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.854946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.860546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:19.887455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:19.888346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:19.889904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:20.058250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae5afa2d-4fa6-4ce9-8e06-59868cefaad6 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.237034 Aug 30 18:20:20.061496 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1091/2137] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:20:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:20.084358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:20.085153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:20.109735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:20.115218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:20.115218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:20.121219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:20.121754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:20.124917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:20.479391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:20.505583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:20.525646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:20.527106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c9a1368-3a40-47a1-a973-d018fee6d412 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1330 microversion: 2.47 time: 0.462013 Aug 30 18:20:20.527737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1092/2138] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:20 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1330 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:20.558216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:20.558905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:20.567635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:20.568759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:20.569684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:20.570927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:20.571813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:20.572836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:21.197690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:21.217108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:21.232567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:21.250487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78bae3ff-61c7-4c52-ab3c-8a3e7ead3ee0 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1562 microversion: 2.25 time: 2.363653 Aug 30 18:20:21.278749 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1047/2139] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:18 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1562 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:21.301046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-765a5b99-ad4d-4edb-9e9b-0d724818f34d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56c05040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:21.431022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:21.450543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7523d68c-2ed0-473a-9444-54d85d65c7f0 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1493 microversion: 2.1 time: 0.921649 Aug 30 18:20:21.453495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1093/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:20 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1493 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:21.473582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:21.476338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:21.493521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:21.496582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:21.497325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:21.500784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:21.501597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:21.508038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:21.546858 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-765a5b99-ad4d-4edb-9e9b-0d724818f34d tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1437 microversion: 2.1 time: 0.259741 Aug 30 18:20:21.557328 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1048/2141] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:21 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1437 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:21.594156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:21.607343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:21.662369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:21.664650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:21.672920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:21.674953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:21.683192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:21.684976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:22.191512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.222619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.241054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.252651 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f2dae72-b2fb-4686-9c6e-21e6e6cd9279 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1802 microversion: 2.32 time: 0.796025 Aug 30 18:20:22.259655 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1094/2142] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:21 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1802 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:22.280362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:22.284334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:22.328852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:22.334184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:22.338032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:22.351253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:22.352225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:22.354857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:22.911109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.951726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.955788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:22.974851 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a11c787c-1fdd-4f89-81b1-c88c53730857 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1336 microversion: 2.47 time: 0.712395 Aug 30 18:20:22.979564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1095/2143] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:22 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1336 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:22.997345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:23.004973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:23.042890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.045358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.050502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.059977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.061296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.065194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.406984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:23.440356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:23.448340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:23.455179 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-804c2bff-8e3c-4218-ac15-8920fbfe9bea tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1562 microversion: 2.25 time: 0.464497 Aug 30 18:20:23.456579 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1096/2144] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:22 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1562 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:23.477545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:23.480923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:23.505952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.509799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.513305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.517412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.518691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.523420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.536058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:23.658320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:23.664361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.668229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.668862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.684827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lazy-loading 'fault' on Instance uuid bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:20:23.692212 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7cd34e2d-9862-43e1-872f-057cd0729123 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1507 microversion: 2.1 time: 2.129530 Aug 30 18:20:23.699867 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1049/2145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:21 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1507 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:23.744029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-970bf557-f295-41b1-a822-75e567b8deb9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e565cc0d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:23.747175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:23.763424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-827f6c53-6755-4481-b36b-5ad0dd3bd1c1 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 200 len: 1310 microversion: 2.1 time: 0.301058 Aug 30 18:20:23.776378 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1097/2146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:23 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:23.790557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf3d3c8-a4b7-4f45-85f4-6d61461618d4", "name": "network-vif-deleted", "tag": "9e09b09c-d4dc-41df-878a-813f67e94119"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:23.821321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.822016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.822663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.869208 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] Creating event network-vif-deleted:9e09b09c-d4dc-41df-878a-813f67e94119 for instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 on n-h1-854119-10 Aug 30 18:20:23.888531 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-84afaeb6-7129-49c6-bdd0-2a072956ef5a req-c8311135-12b5-4c68-bba2-e683c80cd47b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109542 Aug 30 18:20:23.889981 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1098/2147] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:23.912405 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-970bf557-f295-41b1-a822-75e567b8deb9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1446 microversion: 2.1 time: 0.195969 Aug 30 18:20:23.913628 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1050/2148] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:23 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:23.914549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:23.919604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:23.936775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.939929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.940630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.941702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:23.944112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:23.944781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:23.945248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0dd77a42-a8a2-487a-ae0f-ba3d66a56e88 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56630040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:24.057483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0dd77a42-a8a2-487a-ae0f-ba3d66a56e88 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 200 len: 1446 microversion: 2.1 time: 0.125939 Aug 30 18:20:24.080922 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1051/2149] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:23 2022] GET /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:24.099412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:24.101648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:24.119705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.120492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.122438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.126998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.127702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.128238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.306396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.326807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.332787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.335864 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f432947-dc95-4092-97ef-3c486b2400ce tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1802 microversion: 2.32 time: 0.441146 Aug 30 18:20:24.336610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.350371 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1099/2150] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:23 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1802 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:24.350371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a2abfaba-fc51-466e-b30f-9a8f61a15962 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56afd280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:24.367328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.369821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.371374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78e32cf9-dcd6-4e36-9448-c2652ac82b07 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1336 microversion: 2.47 time: 0.288460 Aug 30 18:20:24.372288 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1052/2151] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:24 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1336 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:24.479912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:24.480524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:24.493612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.496066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.496725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.497987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.499812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.501570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.727738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.774612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.776383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6774c9dbc6b44018a09893dabeee643a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f43bac114c41ed96e7c7d50864818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:24.791756 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1bdf0a9f-8e21-4dcc-91f7-005b30c5b390 tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 200 len: 1520 microversion: 2.25 time: 0.313987 Aug 30 18:20:24.807957 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1053/2152] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:24 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:24.839467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0995faf2-943b-4d05-bd21-5e03bab4e1f2", "name": "network-vif-deleted", "tag": "ec4484bb-9771-4814-afda-e3b077dcf3f1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:24.862008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.864867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.885431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.945844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] Creating event network-vif-deleted:ec4484bb-9771-4814-afda-e3b077dcf3f1 for instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 on n-h1-854119-10 Aug 30 18:20:24.970223 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-46a08fb5-c37b-4766-8440-9c25c32a3ce8 req-a12f0189-fef4-4803-9e0e-b4852bfb0849 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147728 Aug 30 18:20:24.971429 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1054/2153] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:24.983892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:24.984899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:24.994187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.995026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.995653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:24.997009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:24.997652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:24.998237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.166020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=16 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:25.334941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:25.354222 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34358fb3-dcc0-4507-a6ab-c7faa3f6589f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.376381 Aug 30 18:20:25.358260 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1055/2154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:24 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:25.375379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:25.376143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:25.402514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.403126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.403523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.404376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.404855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.405280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.427660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 HTTP/1.1 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bdf3d3c8-a4b7-4f45-85f4-6d61461618d4'} Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:25.429528 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:25.433269 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e8f92655-5477-472a-8c0c-9576de4ec39e tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 404 len: 111 microversion: 2.1 time: 0.071925 Aug 30 18:20:25.439142 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1056/2155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:25 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:25.456431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c884ee-721c-4bf2-920b-e6932511e294", "device": "/dev/xvdb"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:25.459697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:25.478703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.478825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.479213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.480017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.480372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.480797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.836664 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a2abfaba-fc51-466e-b30f-9a8f61a15962 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 204 len: 0 microversion: 2.1 time: 1.493165 Aug 30 18:20:25.838830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1100/2156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:24 2022] DELETE /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 0 bytes in 1498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:20:25.861511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:25.862882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:25.884608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.885519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.888310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:25.889917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:25.890880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:25.893214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.456733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6395934-610c-4dca-a926-747e6a600971 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.013201 Aug 30 18:20:26.470907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1057/2157] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:20:25 2022] POST /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 194 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:26.484591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:26.486627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:26.500655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.502459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.503528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.505192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.506248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.507338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.687577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.716700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.718417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.719669 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e9fd587-ab2e-470c-a7fa-f2579d5b35c2 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1849 microversion: 2.32 time: 0.878999 Aug 30 18:20:26.727190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1101/2158] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:25 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1849 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:26.756825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:26.760257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:26.776384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.778850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.779569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.784909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.786129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.786819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.787399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.788709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.790504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:26.811049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1bef356f-cafd-426f-93c5-7fa318e8fe70 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1357 microversion: 2.47 time: 0.335479 Aug 30 18:20:26.820054 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:26.820463 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1058/2159] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:26 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:26.832484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 HTTP/1.1 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bdf3d3c8-a4b7-4f45-85f4-6d61461618d4'} Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:26.846102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:26.851277 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.854191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:26.855809 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2090f104-b35c-4f15-9dd0-5991516550d8 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 404 len: 111 microversion: 2.1 time: 0.115051 Aug 30 18:20:26.863175 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1102/2160] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:26 2022] DELETE /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:26.863620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:26.864538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] [instance: 0995faf2-943b-4d05-bd21-5e03bab4e1f2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:26.890024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.894441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:26.897212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.897897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.898856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.899655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.900079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.900442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:26.928608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.930226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.933441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.934908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:26.938317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:26.939311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:26.972825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:26.974673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] HTTP exception thrown: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Request method failure captured: Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 HTTP/1.1 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlLqwUOyA7LuEkCUlqYrsnNqBZKhN8FSQ3NVh41o_NKFzfoMAYoBz623LfPK8LAjUsBG62J0VEWfgBiAU-o6aKYcIurLSUrJ4ONAfENtHSrKagR48BEicjWVKUU_E2kLNeLSzF4TqoX2jeupOq4h7YbI_J5KC8JhZgXNh7N3zSWk-gM Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29f43bac114c41ed96e7c7d50864818b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 29f43bac114c41ed96e7c7d50864818b Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422 Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6774c9dbc6b44018a09893dabeee643a Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1032245422-project Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '0995faf2-943b-4d05-bd21-5e03bab4e1f2'} Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. Aug 30 18:20:26.993281 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. Aug 30 18:20:27.003170 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:27.012862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] Returning 404 to user: Instance 0995faf2-943b-4d05-bd21-5e03bab4e1f2 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:27.015336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d73b3f9-6e50-40bb-b883-422f8f3a172c tempest-LiveAutoBlockMigrationV225Test-1032245422 tempest-LiveAutoBlockMigrationV225Test-1032245422-project] 10.222.0.25 "GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2" status: 404 len: 111 microversion: 2.25 time: 0.189378 Aug 30 18:20:27.017809 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1059/2161] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:26 2022] GET /compute/v2.1/servers/0995faf2-943b-4d05-bd21-5e03bab4e1f2 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:20:27.042955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Action: 'create', calling method: .version_select at 0x7f4e566f64c0>, body: {"keypair": {"name": "tempest-keypair-421609892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwHFvgliyPekWGIR5gSyu8gOJ/xyTWxHQr16bcyFLhX2uK1yTuMuxJIbKuc3RnwBsjkik+id7T+gVtldAUxDszTemoxInl0AE8zWGlsrJ+FrpGulALis36e/ZsmIuFcEQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:27.094185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:20:27.123986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Getting quotas for project eab2ff903c844c2bbeffab1c8fda61fc. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:27.144616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Getting quotas for user 9b5d25aea63b469b922af291fe70c4d6 and project eab2ff903c844c2bbeffab1c8fda61fc. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:27.231918 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [05691806-9948-4b3e-b3f3-43567c822b5c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:20:27.383480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1bf5b40-2e0f-4eb7-8747-587f0696aa29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 204 len: 0 microversion: 2.1 time: 0.502966 Aug 30 18:20:27.384022 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1103/2162] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:26 2022] DELETE /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:20:27.390086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:27.390836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:27.425030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:27.425998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:27.426649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:27.433180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:27.436864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:27.437892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.018115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:28.036594 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-368dfebf-092f-457a-a213-01c0dd3b77ef tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.651236 Aug 30 18:20:28.037579 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1104/2163] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:27 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:28.046898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:28.056602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:28.075938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.076835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.080920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.082405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.083164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.083852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.245130 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [05691806-9948-4b3e-b3f3-43567c822b5c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34856. Aug 30 18:20:28.278076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:28.279198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:28.283742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:28.284760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:28.285786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:28.323588 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62209b3a-ba70-427e-b0a2-680cb18304e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 1.295129 Aug 30 18:20:28.332207 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1060/2164] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:20:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1309 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:20:28.372682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:28.389913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: bdf3d3c8-a4b7-4f45-85f4-6d61461618d4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:28.422455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.423337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.424058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.444872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.451018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.456135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.542960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:28.547180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:28.568188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:28.579005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.579607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.579936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.581589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.581589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 HTTP/1.1 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bdf3d3c8-a4b7-4f45-85f4-6d61461618d4'} Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:28.584964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. Aug 30 18:20:28.591738 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:28.596770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.601397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:28.603691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a74eb545-f593-400c-9793-ab638ced0682 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4" status: 404 len: 111 microversion: 2.1 time: 0.268291 Aug 30 18:20:28.616680 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1061/2165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:28 2022] GET /compute/v2.1/servers/bdf3d3c8-a4b7-4f45-85f4-6d61461618d4 => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:28.628120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fa5066-6bfc-4719-b1cf-db750750e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "462321ce-718b-4f9c-99e7-b5beb8bde24d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:28.690918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.698463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.700230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.772487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] Creating event network-vif-plugged:462321ce-718b-4f9c-99e7-b5beb8bde24d for instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 on n-h1-854119-10 Aug 30 18:20:28.802874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fd411663-10ca-44ee-969f-46d24c8da49a req-a7fb8ba6-592a-45d5-9dbb-3169aa97a225 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178496 Aug 30 18:20:28.803061 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0bed0dd7-0972-4d84-b2b9-4c27c5afce90 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "POST /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82/action" status: 202 len: 1079 microversion: 2.47 time: 0.753952 Aug 30 18:20:28.806917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1105/2166] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:20:28 2022] POST /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82/action => generated 1079 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 18:20:28.825313 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1062/2167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:28.833484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1187635071", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6934b7e3-effd-490c-a322-f67172841720"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:28.882565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:28.883801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:28.950595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.951337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.962673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:28.974700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:28.977432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:28.978190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:29.112904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] validate_networks() for [('6934b7e3-effd-490c-a322-f67172841720', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:20:29.947499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:30.557246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:30.577481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:30.593108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:30.598955 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-37766b55-b05f-480b-8110-fb5a820f5512 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1849 microversion: 2.32 time: 1.753267 Aug 30 18:20:30.606841 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1063/2168] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:28 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1849 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:30.638727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:30.641020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:30.661224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.667271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.668742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.672021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.676596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.677899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.745102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 HTTP/1.1 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1e8fd433-73c2-4ef2-a49d-a5793adbbea8'} Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:30.756544 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:30.764157 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:30.767810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:30.769983 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec7cd0b4-ec61-44e1-b5b3-7c920d69b330 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 404 len: 111 microversion: 2.1 time: 0.156946 Aug 30 18:20:30.775793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:30.775793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:30.776691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:30.777818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:30.777818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:30.778764 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1064/2169] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:30 2022] DELETE /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:30.790110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:30.791540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:30.803214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.804396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.806578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.808114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.812956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.814255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.814507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.814792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.815233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.822540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:30.827200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:30.830943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:30.926546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:30.941740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Getting quotas for user 1cc40f3a740645d1af38042ad00935b1 and project 60f1b4b0a4db421c8a3e96a99cd78290. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:30.972757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:20:30.977360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:20:31.008090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:31.024462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:31.031001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:31.036098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44c6fa30-d002-432e-942d-36abab8deec9 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.255272 Aug 30 18:20:31.041295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1065/2170] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:30 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:31.061489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "a94e2401-6899-4923-9211-c9fb86eac7ef"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:31.098858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.111488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.112437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-059aca8d-2af3-4c95-9dfe-b27583aa2016 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303005 Aug 30 18:20:31.112998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.113919 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1106/2171] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:20:31.141021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:31.151955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:31.169021 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] Creating event network-changed:a94e2401-6899-4923-9211-c9fb86eac7ef for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:31.179036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.183517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.186251 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a09f26a5-4b94-48ef-b6b0-410e8cece169 req-aaa8f122-ac8a-437c-a70f-1ea651fb3cc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142797 Aug 30 18:20:31.186485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.187632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.188479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.189256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.190646 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1066/2172] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:31.213588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:31.219993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 1e8fd433-73c2-4ef2-a49d-a5793adbbea8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:31.240997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.245743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.253459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.255265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.256224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.257081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.308993 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 HTTP/1.1 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1e8fd433-73c2-4ef2-a49d-a5793adbbea8'} Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:31.320333 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. Aug 30 18:20:31.323757 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:31.326453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 1e8fd433-73c2-4ef2-a49d-a5793adbbea8 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:31.328212 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0e8aa65-af78-4f42-8c51-31e1b4730d51 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8" status: 404 len: 111 microversion: 2.1 time: 0.126398 Aug 30 18:20:31.329995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1067/2173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:31 2022] GET /compute/v2.1/servers/1e8fd433-73c2-4ef2-a49d-a5793adbbea8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:31.340703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d26ffd-b054-4f05-a06f-246822e47992", "name": "network-vif-unplugged", "status": "completed", "tag": "4c0b1a71-dd4a-4b2d-b825-632131dc76ab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:31.388283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:31.396822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:31.397933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:31.497665 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] Creating event network-vif-unplugged:4c0b1a71-dd4a-4b2d-b825-632131dc76ab for instance a6d26ffd-b054-4f05-a06f-246822e47992 on n-h2-854119-10 Aug 30 18:20:31.545654 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0f09c2fa-38db-40c6-b52c-5663c13c840c req-b8749ced-3c0d-4fa2-a4b3-f3cd7a95c8fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207929 Aug 30 18:20:31.554177 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1068/2174] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:31.613270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab3c62cb-318f-4b13-9c89-f94322664fb1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:31.614550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab3c62cb-318f-4b13-9c89-f94322664fb1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:32.168119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:32.201412 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d10603a6-0a07-4cc3-a96b-b293a80cd13e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 1.069865 Aug 30 18:20:32.210050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab3c62cb-318f-4b13-9c89-f94322664fb1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:32.222818 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1107/2175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:31 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:32.236986 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab3c62cb-318f-4b13-9c89-f94322664fb1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1208 microversion: 2.1 time: 0.680298 Aug 30 18:20:32.241989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1069/2176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:31 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1208 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:32.253862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:32.263884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:32.264385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:32.265140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:32.293593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.294925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.296388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.297437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.297610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.299103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.299861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.300633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.302044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.302878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.311530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.312277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.376750 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.381125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd HTTP/1.1 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '43c21033-4f8e-41fc-960b-065945bb00fd'} Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:32.383492 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3fc676c2-6928-4bb9-96ad-4395dabf997d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 404 len: 111 microversion: 2.1 time: 0.160689 Aug 30 18:20:32.389779 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1108/2177] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:32 2022] DELETE /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:32.404448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:32.405065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:32.428385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.428932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.429391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.472361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.476169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.485852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.739770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:32.774569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:32.781337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:32.785288 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9636f065-ca87-496e-908b-fb78e0a5d5ae tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.394216 Aug 30 18:20:32.794031 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1109/2178] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:32 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:32.813050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:32.816421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 43c21033-4f8e-41fc-960b-065945bb00fd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:32.847033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.848529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.849545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.851648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:32.855292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:32.856224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:32.947626 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd HTTP/1.1 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '43c21033-4f8e-41fc-960b-065945bb00fd'} Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:32.957301 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. Aug 30 18:20:32.964571 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:32.971406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 43c21033-4f8e-41fc-960b-065945bb00fd could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:32.978117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8d02f2e-b5cd-4c1b-8dbb-8d6790ce0abe tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd" status: 404 len: 111 microversion: 2.1 time: 0.179477 Aug 30 18:20:32.981222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1110/2179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:32 2022] GET /compute/v2.1/servers/43c21033-4f8e-41fc-960b-065945bb00fd => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:32.994436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:32.995979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:33.015615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.016886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.019254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.024803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.028581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.030774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.092592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 HTTP/1.1 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7e5ff321-27d6-415c-847d-c1e590ac57f8'} Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:33.098780 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:33.102229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-793b304c-c96e-4f9d-81a1-5a583750a615 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 404 len: 111 microversion: 2.1 time: 0.115589 Aug 30 18:20:33.106800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1111/2180] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:32 2022] DELETE /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:20:33.121860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:33.123058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 7e5ff321-27d6-415c-847d-c1e590ac57f8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:33.142302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.143229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.143945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.144994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.145925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.146661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.173046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 HTTP/1.1 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7e5ff321-27d6-415c-847d-c1e590ac57f8'} Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.178511 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. Aug 30 18:20:33.182267 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.186252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 7e5ff321-27d6-415c-847d-c1e590ac57f8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:33.187551 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b91007d4-0f87-4ff7-8c66-6758e4ca1b23 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8" status: 404 len: 111 microversion: 2.1 time: 0.073360 Aug 30 18:20:33.188365 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1112/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:33 2022] GET /compute/v2.1/servers/7e5ff321-27d6-415c-847d-c1e590ac57f8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:33.198309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:33.199511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:33.208088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.209032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.209757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.211042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.211889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.212607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.231169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c HTTP/1.1 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'af351fca-85d3-49c5-950a-1d4e5ae3649c'} Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:33.233221 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.236634 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.242162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:33.243846 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-907f558d-fece-4a16-a881-6d222461ae19 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 404 len: 111 microversion: 2.1 time: 0.049468 Aug 30 18:20:33.244853 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1113/2182] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:33 2022] DELETE /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:33.283572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:33.285240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: af351fca-85d3-49c5-950a-1d4e5ae3649c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:33.307508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.310607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.314127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.321280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.322463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.323476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.389476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c HTTP/1.1 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'af351fca-85d3-49c5-950a-1d4e5ae3649c'} Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:33.392463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance af351fca-85d3-49c5-950a-1d4e5ae3649c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:33.396229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9841b526-ce56-4616-8cd5-0845bfc3f3cf tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c" status: 404 len: 111 microversion: 2.1 time: 0.129719 Aug 30 18:20:33.408302 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1114/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:33 2022] GET /compute/v2.1/servers/af351fca-85d3-49c5-950a-1d4e5ae3649c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:33.422809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:33.428880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:33.450077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.451036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.455333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:33.456685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:33.457579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:33.458405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.023578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:34.073760 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b8d33c2-2775-42e2-a3d7-cc15aa318d7f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.655828 Aug 30 18:20:34.078130 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1115/2184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:33 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:34.116670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:34.120930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:34.163417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.172584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.173077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.176745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.179814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.184569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.527414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:34.529835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:34.553519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-410fd858-179d-4737-9d8a-e5f9e2ab71c3 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1278 microversion: 2.1 time: 0.472074 Aug 30 18:20:34.558574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1116/2185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:34 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1278 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:34.576416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:34.577194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:34.600696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.601684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.604133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.608662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.610009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.612113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.672655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f HTTP/1.1 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '38e0183a-6cab-4b65-92da-0d443f88252f'} Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:34.677989 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:34.682715 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:34.686197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:34.688795 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-688651f5-cf6a-4d29-b83b-6c1abef54518 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 404 len: 111 microversion: 2.1 time: 0.128811 Aug 30 18:20:34.692470 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1117/2186] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:34 2022] DELETE /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:34.705364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:34.709105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:34.725975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.727091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.728964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:34.731375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:34.732832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:34.733439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.069448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.092361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.097291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.101726 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c60d5df7-3a98-4f18-a86b-f9445a8f9823 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.406921 Aug 30 18:20:35.103640 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1118/2187] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:34 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:35.138646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d26ffd-b054-4f05-a06f-246822e47992", "name": "network-vif-deleted", "tag": "4c0b1a71-dd4a-4b2d-b825-632131dc76ab"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:35.199828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.200757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.203918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.226291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] Creating event network-vif-deleted:4c0b1a71-dd4a-4b2d-b825-632131dc76ab for instance a6d26ffd-b054-4f05-a06f-246822e47992 on n-h2-854119-10 Aug 30 18:20:35.237160 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4c31a222-a52e-45f8-b50d-6de320b9ba7b req-509f621a-6159-4d4d-8178-fa1db754161a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130036 Aug 30 18:20:35.238856 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1119/2188] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:35.251198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:35.252444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: 38e0183a-6cab-4b65-92da-0d443f88252f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:35.261050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.261555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.261995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.262808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.263279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.264534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.317775 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f HTTP/1.1 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '38e0183a-6cab-4b65-92da-0d443f88252f'} Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:35.319924 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.325296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance 38e0183a-6cab-4b65-92da-0d443f88252f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:35.327542 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6bcced99-4004-4628-8d6f-ee5281afad76 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f" status: 404 len: 111 microversion: 2.1 time: 0.085907 Aug 30 18:20:35.328218 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1120/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:35 2022] GET /compute/v2.1/servers/38e0183a-6cab-4b65-92da-0d443f88252f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:35.341589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:35.342585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:35.364438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.364704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.368718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.374841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.375731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.376325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.401653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.452273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.471656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:35.474047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2cc2e254-af8c-42f7-82f6-d3047d8a43b3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1870 microversion: 2.32 time: 3.229861 Aug 30 18:20:35.488378 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1070/2190] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:32 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1870 bytes in 3245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:35.503949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:35.505268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:35.529190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.530185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.531231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.536542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.537333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.539382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.581542 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 HTTP/1.1 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b6605714-fdea-43e2-9fdc-5de69b7fa4c2'} Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:35.584488 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:35.588033 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:35.599111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:35.600795 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eee4368d-1c44-4afd-ae15-c380c929845b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2" status: 404 len: 111 microversion: 2.1 time: 0.110655 Aug 30 18:20:35.605779 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1071/2191] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:35 2022] DELETE /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:35.620290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:35.622181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:35.634840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.637100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.638038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:35.639427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:35.640517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:35.641855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.044666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:36.066009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca8bf6bf-6e2e-475b-a7b1-036d490342ce tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.727772 Aug 30 18:20:36.080891 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1121/2192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:35 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:36.080891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:36.080891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: b6605714-fdea-43e2-9fdc-5de69b7fa4c2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:36.112447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.119258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.120055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.121048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.127597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.128389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.159799 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 HTTP/1.1 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b6605714-fdea-43e2-9fdc-5de69b7fa4c2'} Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:36.167620 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. Aug 30 18:20:36.171387 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:20:36.173967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance b6605714-fdea-43e2-9fdc-5de69b7fa4c2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:36.176310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-882526ca-c764-46bd-a5c1-aaf4fb0aa563 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2" status: 404 len: 111 microversion: 2.1 time: 0.103530 Aug 30 18:20:36.180950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1122/2193] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:36 2022] GET /compute/v2.1/servers/b6605714-fdea-43e2-9fdc-5de69b7fa4c2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:36.193981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:36.201571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:36.222495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.223404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.224088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.225605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.235493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.236055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.481580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:36.504824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:36.519611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:36.521279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1fc0614b-cd79-4552-8267-7bf85d7be102 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.338931 Aug 30 18:20:36.524582 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1123/2194] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:36 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:36.549327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:36.550216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:36.582599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.583290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.584156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.585005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:36.585824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:36.592266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:36.668004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:20:36.930859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-803cd781-0908-44aa-9d41-9b3ceb5f4912 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 204 len: 0 microversion: 2.1 time: 0.394807 Aug 30 18:20:36.934701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1124/2195] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:20:36 2022] DELETE /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:20:36.964017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:36.971087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:37.006231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.009608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.012324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:37.017245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.018460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.019424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:37.022705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:37.037427 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb30e159-6d0b-4618-ac7f-e5f72f8db9bc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 1.429638 Aug 30 18:20:37.062602 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1072/2196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:35 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:37.096292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:37.097565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:37.125269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.125803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.126431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:37.127228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.127799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.128555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:37.716611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:37.733310 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff012c7f-d5a2-4714-bdb7-ee8cdec04c1a tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1478 microversion: 2.1 time: 0.668369 Aug 30 18:20:37.734683 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1073/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:37 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1478 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:37.752266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:37.753359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:37.770848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.775908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.776694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:37.777685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:37.778602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:37.779273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.132795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.171543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.177932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.179473 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e0a3811-e987-495e-be84-08b036e2807a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1870 microversion: 2.32 time: 1.243301 Aug 30 18:20:38.191351 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1125/2198] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:36 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1870 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:38.196378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "fdf7ba45-d5a0-471a-829e-43218c97999f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:38.212486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.213363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.214414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.257137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] Creating event network-changed:fdf7ba45-d5a0-471a-829e-43218c97999f for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:38.278759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d2d805cf-df44-4624-b9ec-8a58018257cb req-caff1dcf-0ddb-4ab5-a9f1-e2a87f86a895 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085937 Aug 30 18:20:38.284564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1126/2199] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:38.305724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:38.306532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:38.319864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.320592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.321259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.322045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.322621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.323049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.324291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.397317 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4e2fb4f-53ad-4452-a4bd-b0ef7c01388b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.654002 Aug 30 18:20:38.400050 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1074/2200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:37 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:38.431207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:38.435663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:38.463443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.466962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.467781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.468751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.470180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.470900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.516173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.530293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.531788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:38.537362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24529832-265d-4f41-a0e3-d34f022559d2 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.251210 Aug 30 18:20:38.537977 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1127/2201] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:38 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:38.559932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ab854-717b-4ef7-8c58-c1bfce0b2df8", "tag": "dcac9f94-6e92-4d83-8dbf-41e6f66fcad4"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:38.575542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.576332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.584004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.608092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] Creating event network-changed:dcac9f94-6e92-4d83-8dbf-41e6f66fcad4 for instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 on n-h1-854119-10 Aug 30 18:20:38.624344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b0fb927e-f4f0-4a72-a381-c6b3efb1903b req-8f0af914-ea76-495c-9824-da5c16005ade service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078220 Aug 30 18:20:38.625402 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1128/2202] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:38.778938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:38.780224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:38.789085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.790001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.790944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:38.792552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:38.793219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:38.793796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:39.058639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:39.068904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddec5f4a-ff77-47cf-aede-fe19e63f5197 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1478 microversion: 2.1 time: 0.295115 Aug 30 18:20:39.072790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1129/2203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:38 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1478 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:39.207804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:39.210003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:39.228552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:39.229564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:39.230501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:39.232038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:39.233010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:39.233961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:39.713359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:39.750387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:39.757571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:39.763370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-768da824-5646-4405-939a-464b376b49eb tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 0.560296 Aug 30 18:20:39.766615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1130/2204] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:39 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:39.775978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:39.777952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:39.792971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:39.793817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:39.794485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:39.795450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:39.796126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:39.796737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.058219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.074267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9c2c16c-03c7-45e1-a41b-fd0f77ec2695 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.304876 Aug 30 18:20:40.075277 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1131/2205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:39 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:40.090329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:40.090329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:40.093398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.094021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.094589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.095400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.096049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.096581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.256320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.274917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.280779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.285023 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-79c5915a-b397-45aa-8882-a8f8e308c13c tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.207237 Aug 30 18:20:40.297570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.298884 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1132/2206] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:40 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:40.323495 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f25780dd-93fe-42a5-b5c0-350e13e1806b tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 1.917801 Aug 30 18:20:40.324369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1075/2207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:38 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:40.331441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:40.333501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:40.348365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.349307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.350450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.351558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.352439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.353330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.792490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:40.793695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:40.809835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.810591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.811909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.815251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:40.819508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:40.822638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:40.853701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:40.893539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:40.897364 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f73049e7-5794-44b8-aa8b-dc5e66a1e18b tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1478 microversion: 2.1 time: 0.597196 Aug 30 18:20:40.897980 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1133/2208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:40 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1478 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:41.091111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "3012161b-7ba2-4442-9060-f57a7f5ad3fe"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:41.101035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:41.115367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:41.115863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:41.116733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:41.135667 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] Creating event network-changed:3012161b-7ba2-4442-9060-f57a7f5ad3fe for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:41.143499 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ddca8211-6b4a-40cd-a4ea-26d2c9883e94 req-b49bf389-3f80-4bc1-ab20-33ef7863ec59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057067 Aug 30 18:20:41.144952 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1134/2209] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:20:41.158288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:41.158919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:41.171683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:41.173762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:41.174409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:41.176854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:41.179050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:41.179506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:41.741366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:41.797525 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3a2b8df-d3aa-4792-a5c4-712202777067 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.621403 Aug 30 18:20:41.800004 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1135/2210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:41 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:41.827724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:41.832658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:41.852436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:41.854086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:41.894263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:41.895796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:41.896734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:41.897661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:41.933321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:42.091841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.102791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.104263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.117948 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-455e6f60-1277-4571-aba2-bf13062e63fa tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.315024 Aug 30 18:20:42.118628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1136/2211] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:41 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:42.124114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:42.124641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:42.147487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.147940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.148380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.149099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.149696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.150603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.235020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:42.608459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.663503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.673516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.679767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-217bd232-1e13-4cd8-999b-f808f9dd3bd5 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 1.888271 Aug 30 18:20:42.683407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1076/2212] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:40 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:20:42.705268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:42.706272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:42.730674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.731185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.731835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.732732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.733818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.734480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.911586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.925698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cdab9aabec443feb88e7642921429b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2f9cf926a4a638da83ecf797564a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:42.945668 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86b349bc-ac2c-4344-ae2b-e12785844639 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 0.825147 Aug 30 18:20:42.950924 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1137/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:42 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:42.962906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:42.966174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:42.984663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.985179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.985629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.986409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:42.986913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:42.987345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:42.997780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edc442b9-beb1-40f8-84f7-6fc80c0ad18d tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 200 len: 1436 microversion: 2.1 time: 0.311731 Aug 30 18:20:43.000787 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1077/2214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:42 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 1436 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:43.148643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:43.153692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:43.181933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:43.183464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:43.186223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:43.187441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:43.190726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:43.191470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:43.383035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:43.406813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:43.411927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:43.414638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f134a91d-5537-402e-b5e5-a473e9fe6ee0 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.274333 Aug 30 18:20:43.418189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1078/2215] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:43 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:20:43.432175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9bb091-4177-4564-a210-3751e1cfbfae", "name": "network-vif-deleted", "tag": "fa8af5ca-a418-4416-b391-5e4fe71f8b1d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:43.456862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:43.457598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:43.458210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:43.488109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] Creating event network-vif-deleted:fa8af5ca-a418-4416-b391-5e4fe71f8b1d for instance fc9bb091-4177-4564-a210-3751e1cfbfae on n-h2-854119-10 Aug 30 18:20:43.502182 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d26d254a-37d3-46e5-ae47-7f6d39e6a594 req-cf5a298f-7ff7-42e6-87e9-ced21f04166b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082426 Aug 30 18:20:43.506795 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1079/2216] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:43.627644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:43.647839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3449b242-6e26-435e-81e4-88c3f8df76b8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.692866 Aug 30 18:20:43.647839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1138/2217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:42 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:43.710083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:43.710874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:43.726922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:43.728970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:43.731342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:43.732186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:43.732668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:43.733097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:43.971892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:43.974805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:44.009141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.010050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.012886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.016665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.017155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.017688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.364667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.384371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.386439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.390871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52ca986b-8f6b-49c6-b315-61fda9390e8a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 0.686248 Aug 30 18:20:44.393359 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1080/2218] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:43 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:20:44.414537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:44.420656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] [instance: fc9bb091-4177-4564-a210-3751e1cfbfae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:44.434798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.440840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.441778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.444888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.445576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.447950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.483132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] HTTP exception thrown: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Request method failure captured: Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae HTTP/1.1 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlO0tYRwBviOoQlnp1B640tC9f4tIil8dzm-bxb-zGSJRL6P1xOY3ig5EhkOEsfQLFtmZWO3oFoZpC301ZnR35UocOnSNtoxQ_PB7ZfCar44Ya5YsvgqG_arp89pb-diGiSnQhxAVT8RM_qqCCKbTR4aBcMSvDVbzHnv4ySTCpRmOJE Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaa2f9cf926a4a638da83ecf797564a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestJSON-1581729891 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eaa2f9cf926a4a638da83ecf797564a8 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestJSON-1581729891 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7cdab9aabec443feb88e7642921429b7 Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestJSON-1581729891-project Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fc9bb091-4177-4564-a210-3751e1cfbfae'} Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:20:44.488550 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. Aug 30 18:20:44.492262 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:20:44.496535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] Returning 404 to user: Instance fc9bb091-4177-4564-a210-3751e1cfbfae could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:20:44.499795 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9611992c-9d80-4d98-ae2c-eb8fd0678345 tempest-ServersTestJSON-1581729891 tempest-ServersTestJSON-1581729891-project] 10.222.0.25 "GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae" status: 404 len: 111 microversion: 2.1 time: 0.105191 Aug 30 18:20:44.508021 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1081/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:44 2022] GET /compute/v2.1/servers/fc9bb091-4177-4564-a210-3751e1cfbfae => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:20:44.521241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:44.522075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:44.541029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.541837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.545028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.546105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.546769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.548706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.784883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.800001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.802552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:44.807305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7be3dc3-f838-43dd-a8ae-82aa41490def tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.297775 Aug 30 18:20:44.808717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1082/2220] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:44 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:44.813674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:44.814870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:44.822779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.823530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.824142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.825010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:44.825619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:44.826676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:44.982952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:45.001195 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d653f36-a3d3-4c50-8484-551549dccadc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 1.036742 Aug 30 18:20:45.008720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1139/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:43 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:45.039374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1664663067", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "149f451e-96c4-4253-924a-3245a5a362c7"}, {"port": "5a150048-908c-4d8d-a180-1280d4dcfa98", "tag": "port-1"}, {"port": "c7b9917f-c612-494f-bb46-629acf69b6c1", "tag": "port-2"}, {"uuid": "eaf11205-ab88-4a8b-933d-9c23debfd73b", "tag": "net-1"}, {"uuid": "eaf11205-ab88-4a8b-933d-9c23debfd73b"}, {"uuid": "c984d109-bac5-4edc-8663-0a0a4c97df17", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c984d109-bac5-4edc-8663-0a0a4c97df17", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a92531aa-f068-4506-b338-cc7f4e82999b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3d378625-a861-4ee1-8187-6382b3b82bc7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7f59c647-d155-4ee9-a81c-8db79b08aeba", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--941129007"}], "key_name": "tempest-keypair-421609892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:45.301312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] validate_networks() for [('149f451e-96c4-4253-924a-3245a5a362c7', None, None, None, None, None), (None, None, '5a150048-908c-4d8d-a180-1280d4dcfa98', None, None, None), (None, None, 'c7b9917f-c612-494f-bb46-629acf69b6c1', None, None, None), ('eaf11205-ab88-4a8b-933d-9c23debfd73b', None, None, None, None, None), ('eaf11205-ab88-4a8b-933d-9c23debfd73b', None, None, None, None, None), ('c984d109-bac5-4edc-8663-0a0a4c97df17', '10.2.2.100', None, None, None, None), ('c984d109-bac5-4edc-8663-0a0a4c97df17', '10.2.2.200', None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:20:45.643590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:45.677595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a32bb813-10b8-48cc-b131-d8520ab382a5 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.861556 Aug 30 18:20:45.682575 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1083/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:44 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:45.707534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:45.708553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:45.716684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:45.717457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:45.718078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:45.719025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:45.719654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:45.720243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:46.194511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.205589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.213156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.215877 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23ee063d-4c6f-4956-92e5-51a03c9ba5f3 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 0.531022 Aug 30 18:20:46.230849 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1084/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:45 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:46.240767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "457819b0-f0ad-4289-9a70-e3e8e269c9c1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:46.252853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:46.254018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:46.254748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:46.291864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] Creating event network-changed:457819b0-f0ad-4289-9a70-e3e8e269c9c1 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:46.320286 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bf7984a3-463e-4672-ba0b-4c1db1ac6524 req-f9f11e19-49d0-4854-8c9a-b6e16149dbe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087665 Aug 30 18:20:46.321672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1085/2224] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:46.328583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:46.329718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:46.337878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:46.338807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:46.339512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:46.341582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:46.342724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:46.343455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:46.540541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.553828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.567874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:46.569300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78dea0ce-09e2-4e73-b356-c16b340efa11 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.245911 Aug 30 18:20:46.587468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1086/2225] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:46 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:46.592893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:46.593603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:46.601460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:46.601957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:46.606666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:46.607994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:46.608495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:46.608944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:47.306751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:47.362244 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8bb3d5da-7355-4f68-a1b3-eda0e681cfee tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 0.773523 Aug 30 18:20:47.367137 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1087/2226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:46 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:47.376140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:47.382056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:47.384735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:47.402755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:47.403436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:47.403886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:47.404629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:47.405092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:47.405519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:48.763725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:48.775506 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a448186-d027-476a-b76f-3f435da4b34f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 1.407026 Aug 30 18:20:48.779826 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1088/2227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:47 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:48.789500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:48.793170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:48.808691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:48.810682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:48.812561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:48.813553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:48.816316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:48.816997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:49.524803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.543752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:49.559995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.567085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.576089 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0683693-e8b9-4615-b75e-3ce912bf2d25 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 0.790361 Aug 30 18:20:49.583467 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1089/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:48 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:49.596265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:49.616137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:49.665016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:49.665945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:49.666772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:49.668081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:49.668935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:49.669712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:49.924668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.981486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.991367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:49.998009 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a42aeaa-ff44-475f-a22d-61116a371506 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.410353 Aug 30 18:20:49.999921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1090/2229] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:49 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:50.016633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:50.019015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:50.051773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:50.053164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:50.060609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:50.062373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:50.067287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:50.071267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:51.356097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:51.380174 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a478620-1a8b-4f59-bc17-1ddf77f4cd29 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1308 microversion: 2.1 time: 1.377579 Aug 30 18:20:51.383024 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1091/2230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:50 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1308 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:51.392232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ab854-717b-4ef7-8c58-c1bfce0b2df8", "name": "network-vif-plugged", "status": "completed", "tag": "dcac9f94-6e92-4d83-8dbf-41e6f66fcad4"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:51.407112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:51.408205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:51.408952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:51.423605 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] Creating event network-vif-plugged:dcac9f94-6e92-4d83-8dbf-41e6f66fcad4 for instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 on n-h1-854119-10 Aug 30 18:20:51.429708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b3902040-324b-43f4-a585-2fbac1d48988 req-fb3656f1-f871-4b55-bd18-2b080a21e061 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044663 Aug 30 18:20:51.431317 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1092/2231] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:51.437443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "a642fd74-5a94-4293-9322-bf021b5f9e5b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:51.463654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:51.465018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:51.465626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:51.483432 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] Creating event network-changed:a642fd74-5a94-4293-9322-bf021b5f9e5b for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:51.495840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a6d857be-5824-4293-8fa1-3059d952cf8e req-2dabe967-b49e-4dce-ba7b-219ada5a28a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062579 Aug 30 18:20:51.497348 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1093/2232] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:51.521458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:51.523084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:51.541494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:51.541995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:51.542471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:51.545036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:51.545036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:51.545036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:52.205068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:52.219519 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3aa1ee8-033d-4da5-8443-932e65708521 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.720276 Aug 30 18:20:52.238401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1094/2233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:51 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:52.238653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:52.239383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:52.250520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:52.251174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:52.251917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:52.252837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:52.253611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:52.254261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:53.240196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:53.365918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:53.377102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:53.387141 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d966b4c9-c6d6-4d9e-aad9-aaf9c9060e23 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 1.153501 Aug 30 18:20:53.391786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1095/2234] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:52 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:53.401122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:53.431692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:53.459283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:53.465089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:53.468597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:53.472966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:53.475694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:53.477522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.108180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:20:54.109248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:20:54.109880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:20:54.110487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:20:54.111061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:20:54.128464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.131016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.132882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.133943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.138313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.139050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.142982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:54.163037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Getting quotas for project eab2ff903c844c2bbeffab1c8fda61fc. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:20:54.174490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Getting quotas for user 9b5d25aea63b469b922af291fe70c4d6 and project eab2ff903c844c2bbeffab1c8fda61fc. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:20:54.183224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:54.185585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:54.185743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:20:54.198787 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9440ec4d-9411-476c-836a-29f4c14d4a38 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1366 microversion: 2.47 time: 0.796431 Aug 30 18:20:54.199768 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1096/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:53 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1366 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:54.209762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:54.210799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:54.252268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.254842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.258160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.259520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.260370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.261141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.787981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:20:54.790900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a92531aa-f068-4506-b338-cc7f4e82999b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3d378625-a861-4ee1-8187-6382b3b82bc7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f59c647-d155-4ee9-a81c-8db79b08aeba',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:20:54.850040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:54.884215 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-824e6e02-9cb7-4752-ae78-577a1a2b14ea tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1488 microversion: 2.1 time: 0.678047 Aug 30 18:20:54.888688 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1097/2236] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:54 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1488 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:54.922313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:54.940685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:54.968536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.969543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.970431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:54.971474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:54.973342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:54.974093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:55.779154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:55.782725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-440cab22-4f66-41ee-9e16-38c4c5a5e777 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.769082 Aug 30 18:20:55.797544 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1140/2237] 10.222.0.25 () {62 vars in 1189 bytes} [Tue Aug 30 18:20:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 10785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:20:55.799185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5544e80d-b63c-4e76-b5e1-fa8a9ac99897 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.905877 Aug 30 18:20:55.799801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1098/2238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:54 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:55.804879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:55.806110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:55.822822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:55.823897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:55.824504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:55.825396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:55.826026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:55.826685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:55.837875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "42940854-ee1d-4fa4-a985-343440ca2eb8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:55.881105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:55.891282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:55.892014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:55.916086 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] Creating event network-changed:42940854-ee1d-4fa4-a985-343440ca2eb8 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:55.936391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c7aae082-925b-459e-85c4-dfc3a755c9a4 req-e3d8e1b7-342e-4368-8256-4336d4f8d6d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122774 Aug 30 18:20:55.943915 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1099/2239] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:55.956610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:55.957481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:55.993791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:55.994299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:55.994795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:55.995555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:55.996023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:55.996470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:56.435275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c16059a2-b500-41f9-baad-0b76006d18de tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1859 microversion: 2.1 time: 0.635884 Aug 30 18:20:56.436688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1141/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:55 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1859 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:56.448461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1245777369"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:56.451414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:56.465718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:56.469226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:56.471019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:56.473064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:56.474989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:56.476037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:56.919250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28faaf62-2d31-47a1-bf12-94e5a1141c94 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "POST /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8/action" status: 202 len: 0 microversion: 2.1 time: 0.480437 Aug 30 18:20:56.921211 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1142/2241] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:20:56 2022] POST /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:20:56.931457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:56.932500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:56.948520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:56.949137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:56.950409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:56.952308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:56.954830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:56.955641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:57.105158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.131342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.136428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.141400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db5409c2-9ba5-4563-aea3-ddbe6cbf038e tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1372 microversion: 2.47 time: 0.214204 Aug 30 18:20:57.154225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1143/2242] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:56 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:57.159655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:57.163130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:57.266309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.275403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.276899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.278097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-141698ab-07d7-4a2b-993b-cd7e98309758 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1285 microversion: 2.42 time: 0.122533 Aug 30 18:20:57.281038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1144/2243] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:57 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:57.286882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854119-10", "block_migration": true, "disk_over_commit": false}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:57.290075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:57.308377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:57.311983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:57.314878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:57.316158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:57.317282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:57.322186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:57.382522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lazy-loading 'flavor' on Instance uuid c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:20:57.411685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Going to try to live migrate instance to n-h1-854119-10 {{(pid=122589) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:20:57.631070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.665150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.675918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:57.684851 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ce4ad881-4b4b-48c6-ad1f-885f5c00c783 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1891 microversion: 2.32 time: 1.737739 Aug 30 18:20:57.690279 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1100/2244] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:55 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1891 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:57.714095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:57.718204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:57.752206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:57.759810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:57.772385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:57.779473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:57.784839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:57.785819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:58.476368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:58.485707 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9ccdc1c-250c-48d8-8527-0b07a2a8e7df tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1523 microversion: 2.1 time: 0.791937 Aug 30 18:20:58.486319 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1101/2245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:57 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1523 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:58.495755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36950179-d6eb-4534-aa46-780d9f4e64d0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e570d8160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:58.613332 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36950179-d6eb-4534-aa46-780d9f4e64d0 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b" status: 200 len: 1412 microversion: 2.1 time: 0.125828 Aug 30 18:20:58.614277 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1102/2246] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:58 2022] GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:58.619762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "32fa0270-af32-48e8-a4c1-6a86a32f843d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:20:58.645538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:58.646267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:58.646468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:58.675738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] Creating event network-changed:32fa0270-af32-48e8-a4c1-6a86a32f843d for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:20:58.684186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-dbb985cc-c9d1-44aa-8db3-bdb6224f5123 req-b8c6632f-e79e-4033-ad2a-a7f10ac66900 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068614 Aug 30 18:20:58.684797 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1103/2247] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:20:58.698878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:58.701142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:58.719151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:58.719681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:58.728491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:58.730077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:58.731783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:58.732575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:58.881134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:58.895182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:58.896330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:58.900582 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b6ef4c8-7f51-48df-9c00-967d7d8cf0ab tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1372 microversion: 2.47 time: 0.214320 Aug 30 18:20:58.903122 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1104/2248] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:58 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:58.912620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:58.919328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:58.933535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:58.934526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:58.934865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:58.935583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:58.936032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:58.936447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:59.071610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.107820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.120878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.125820 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7971f072-1b15-4461-9063-8292ae023b11 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1527 microversion: 2.42 time: 0.221117 Aug 30 18:20:59.141078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1105/2249] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:58 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1527 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:59.152795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c764841-1561-4da1-94ed-22a783aab32c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566f3790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:59.226076 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c764841-1561-4da1-94ed-22a783aab32c tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b" status: 200 len: 1412 microversion: 2.1 time: 0.083205 Aug 30 18:20:59.239263 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1106/2250] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:20:59 2022] GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:20:59.245713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:20:59.246885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:20:59.255606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:59.256614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:59.257299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:59.260303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:20:59.261261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:20:59.262437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:20:59.896772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.933271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.946646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:20:59.953044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-958bec58-c307-4e74-8e34-55092224c195 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.711494 Aug 30 18:20:59.953776 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1107/2251] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:20:59 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:20:59.973308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b0423e2-c2de-43d1-b402-655478019324 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e566f3d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:00.297838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b0423e2-c2de-43d1-b402-655478019324 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b" status: 204 len: 0 microversion: 2.1 time: 0.339066 Aug 30 18:21:00.300751 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1108/2252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:20:59 2022] DELETE /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:00.310427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:00.312393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:00.322240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.323742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.326282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:00.328088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.330101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.333513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:00.869611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:00.879195 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44bc2ce7-56db-4715-8348-adfedd3e306f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1505 microversion: 2.1 time: 0.574553 Aug 30 18:21:00.890974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e70a7d5a-0761-47e2-a29d-d188fb4f7051 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/action" status: 202 len: 0 microversion: 2.1 time: 3.607630 Aug 30 18:21:00.892609 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1145/2253] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:20:57 2022] POST /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/action => generated 0 bytes in 3611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:21:00.895670 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1109/2254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:00 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:00.899500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:00.902578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:00.909141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:00.910001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:00.924970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.926336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.928209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:00.932869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.934945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.936414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:00.937911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.950512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.951405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:00.952312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:00.954762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:00.955376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.279138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.297295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.300021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.301686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2fc5bc9-86c2-43ce-af62-48e46be929bf tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1593 microversion: 2.42 time: 0.402214 Aug 30 18:21:01.303124 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1110/2255] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:00 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1593 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:01.308802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e6b74f9-696e-4ff9-bcec-526aaa141bcf tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56c3bca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:01.332710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0e6b74f9-696e-4ff9-bcec-526aaa141bcf tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Image not found. Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e6b74f9-696e-4ff9-bcec-526aaa141bcf tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b HTTP/1.1 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '481e3f20-eecc-42ce-aa10-f15ff8714a5b'} Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 481e3f20-eecc-42ce-aa10-f15ff8714a5b Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:21:01.335182 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 481e3f20-eecc-42ce-aa10-f15ff8714a5b could not be found. Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:21:01.338963 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:01.343656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e6b74f9-696e-4ff9-bcec-526aaa141bcf tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:01.345008 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e6b74f9-696e-4ff9-bcec-526aaa141bcf tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b" status: 404 len: 62 microversion: 2.1 time: 0.040485 Aug 30 18:21:01.346258 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1111/2256] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:21:01 2022] GET /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:21:01.353459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:01.354986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:01.365097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.365975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.366797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.368462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.369239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.370054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.423964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.468355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.470600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.474062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7e3cf43-92ef-45cb-b63f-8d94efcabf6a tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1357 microversion: 2.47 time: 0.580170 Aug 30 18:21:01.480335 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1146/2257] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:00 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1357 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:01.496580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:01.499384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:01.537995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.538851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.540252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.541437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.542420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.543746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.840762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.858200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.864459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.867515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48e26a7f-af6a-4188-a65a-3fbf959e28cc tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.384265 Aug 30 18:21:01.886843 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1147/2258] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:01 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:01.900415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:01.904492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:01.920667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.923522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.925819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.930569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.932707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.933562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.933735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.946529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1c58f13-3db6-40aa-a41b-6231dc30f36c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.598518 Aug 30 18:21:01.964525 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1112/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:01 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:01.978317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:01.984296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:01.986809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Searching by: {'deleted': False, 'project_id': '41b61486c14a4585bebfc770b2a688b4'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:21:01.996685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.997246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.997780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:01.998877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:01.999393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:01.999856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.219801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:02.228256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.265017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6260fe1f-feba-4fb2-b393-65e1f73e5896 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1488 microversion: 2.1 time: 0.376638 Aug 30 18:21:02.267307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1148/2260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:01 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:02.278064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:02.280773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:02.294459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.297741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.299823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.301765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.302947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.304014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.321088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:21:02.557085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.573578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.574428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.577920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.601699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.603285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.681135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88ddfba4-95ac-4113-a175-48f98ad5ac7d tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.715047 Aug 30 18:21:02.682054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1113/2261] 10.222.0.25 () {60 vars in 1187 bytes} [Tue Aug 30 18:21:01 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:02.687543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:02.688297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:02.701096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.704950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.708384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.711029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.712376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.713085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.713822 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3c700d7-8493-46df-b652-a58c1213a028 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1505 microversion: 2.1 time: 0.445140 Aug 30 18:21:02.715056 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1149/2262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:02 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:02.716514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.720779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:02.721622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:02.735836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.736745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.737334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.740187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:02.741428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:02.742431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:02.841882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:02.978014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.993942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:02.995797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.000079 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0c26365e-f5d8-47d8-9a54-0815e28d36ec tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1593 microversion: 2.42 time: 0.283607 Aug 30 18:21:03.019511 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1150/2263] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:02 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1593 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:03.030063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.031272 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7498c9d4-0fcb-43c2-9645-fb51e16c48b6 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 204 len: 0 microversion: 2.1 time: 0.346411 Aug 30 18:21:03.032359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:03.033126 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1114/2264] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:02 2022] DELETE /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:03.052003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.053733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:03.054760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.055970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.058180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.059202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.060346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.061510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.073674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.075268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.075733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.077558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.079459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.079925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.090890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:03.108075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:03.249528 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19bb6536-20cd-4a86-bd69-5d923b9a7983 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 204 len: 0 microversion: 2.47 time: 0.227597 Aug 30 18:21:03.250503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1151/2265] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:21:03 2022] DELETE /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:21:03.261800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.263159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:03.273292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.273995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.275143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.276894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.278424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.279142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.593540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.603558 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a406238e-07d2-439c-8d99-e260dc2fe680 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.351471 Aug 30 18:21:03.604142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1152/2266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:03 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:03.620975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fb67944-8a0f-4467-bb87-2ebfb6f492e4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e567fbb80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.667842 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4fb67944-8a0f-4467-bb87-2ebfb6f492e4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Image not found. Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fb67944-8a0f-4467-bb87-2ebfb6f492e4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b HTTP/1.1 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '481e3f20-eecc-42ce-aa10-f15ff8714a5b'} Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 481e3f20-eecc-42ce-aa10-f15ff8714a5b to delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 481e3f20-eecc-42ce-aa10-f15ff8714a5b could not be found. Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.671233 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fb67944-8a0f-4467-bb87-2ebfb6f492e4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:03.676698 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fb67944-8a0f-4467-bb87-2ebfb6f492e4 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b" status: 404 len: 62 microversion: 2.1 time: 0.061641 Aug 30 18:21:03.680756 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1153/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:03 2022] DELETE /compute/v2.1/images/481e3f20-eecc-42ce-aa10-f15ff8714a5b => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:21:03.691121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fa5066-6bfc-4719-b1cf-db750750e1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "462321ce-718b-4f9c-99e7-b5beb8bde24d"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:03.706827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.707990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.708424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.723781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] Creating event network-vif-unplugged:462321ce-718b-4f9c-99e7-b5beb8bde24d for instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 on n-h1-854119-10 Aug 30 18:21:03.726281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9bdcf79c-0f83-476a-88e9-19bdb0eef6fa req-5802cd87-90a5-46b0-b172-7bb873761a58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043808 Aug 30 18:21:03.727375 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1154/2268] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:03.732810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.733662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:03.741455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.742008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.742992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.743215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.743645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.744065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.799277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.827770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.835036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.835891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.837442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c69ffe3-20c0-49e5-a480-66f0e49a97ef tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.802476 Aug 30 18:21:03.839215 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1115/2269] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:03 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:03.846940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.851042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:03.854231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d6250a8-5f32-4bf7-bd10-1cc1bc6229ac tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 200 len: 1363 microversion: 2.47 time: 0.125421 Aug 30 18:21:03.876183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1155/2270] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:03 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:03.886665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:03.887354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:03.900236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.907790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.908578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:03.910093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:03.910854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:03.911008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:04.012319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:04.142922 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.compute.api [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Instance is already in deleting state, ignoring this request Aug 30 18:21:04.144088 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f704e50-fd54-4c31-9efc-afd1a011fbdc tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 204 len: 0 microversion: 2.1 time: 0.266608 Aug 30 18:21:04.156744 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1156/2271] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:03 2022] DELETE /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:04.162518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:04.163150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:04.165304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:04.191691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:04.192196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:04.192632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:04.193347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:04.193792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:04.194224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:04.225578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96f7c3ce-75b2-4906-b5d8-837aa8c253de tempest-ExtensionsTest-1632292607 tempest-ExtensionsTest-1632292607-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:04.243893 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96f7c3ce-75b2-4906-b5d8-837aa8c253de tempest-ExtensionsTest-1632292607 tempest-ExtensionsTest-1632292607-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.398751 Aug 30 18:21:04.244284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1116/2272] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:21:03 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:04.260222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:04.263844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:04.283646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:04.284512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:04.285893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:04.287334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:04.288031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:04.288650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:05.394681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:05.457183 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-185d4269-9732-4d83-b856-918875cd0ed7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 200 len: 1508 microversion: 2.1 time: 1.293787 Aug 30 18:21:05.484166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1157/2273] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:04 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 1508 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:05.523912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:05.528216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:05.553688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:05.554578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:05.559986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:05.563908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:05.564817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:05.565755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:05.648008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:05.681445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:05.683850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:05.689353 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1415b7b5-024e-4dba-a2aa-00d2daffc6d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1660 microversion: 2.42 time: 1.443214 Aug 30 18:21:05.693360 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1117/2274] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:04 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1660 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:05.700496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-028f38f2-8675-4c93-bc80-3c56cfa3e638 tempest-ExtensionsTest-1632292607 tempest-ExtensionsTest-1632292607-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:05.704064 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-028f38f2-8675-4c93-bc80-3c56cfa3e638 tempest-ExtensionsTest-1632292607 tempest-ExtensionsTest-1632292607-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009294 Aug 30 18:21:05.720117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1118/2275] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 18:21:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:21:05.733636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:05.734553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:05.746265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:05.746265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:05.746617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:05.747563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:05.748205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:05.748789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:06.584669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:06.598120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6220bda4-ecf4-4844-8df2-c951e9e888fe tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1494 microversion: 2.1 time: 1.096508 Aug 30 18:21:06.610382 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1158/2276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:05 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1494 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:06.610382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:06.610382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:06.636577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:06.637355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:06.637561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:06.641112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:06.647358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:06.648724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:06.912183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:06.931983 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d660f94-4524-41d9-b6f3-1f723f1d1f19 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 1.205015 Aug 30 18:21:06.934051 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1119/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:05 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:06.952342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:06.952989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: 36d26d0b-7012-4164-9dcc-b031e4ce0d82] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:06.960420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:06.971388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:06.972151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:06.973137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:06.973631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:06.974070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:06.999908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] HTTP exception thrown: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Request method failure captured: Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 HTTP/1.1 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlTcBuZBl9l0xq6XSH0aDavD5myq4pahmpq3YMlPyNEsX_o7vVGOyoZUn4E3lm3Xbg_zCAZp6PZmbZVb83ohjkFFov2P5-AmExsLJoxlZs3-agY62qw0r6qetT0aohdNHmEkzWSZyqsINGRwfE3EHrnTr3QZ7jjJqDpdueXoVU_5BQo Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 41b61486c14a4585bebfc770b2a688b4 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerShowV247Test-629692766 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerShowV247Test-629692766 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 41b61486c14a4585bebfc770b2a688b4 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerShowV247Test-629692766 Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerShowV247Test-629692766-project Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3f65e82186664f75adbf08084359652d Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerShowV247Test-629692766-project Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '36d26d0b-7012-4164-9dcc-b031e4ce0d82'} Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:07.011397 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Returning 404 to user: Instance 36d26d0b-7012-4164-9dcc-b031e4ce0d82 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16b53329-6605-4a86-8b27-defb577eaf47 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82" status: 404 len: 111 microversion: 2.47 time: 0.078146 Aug 30 18:21:07.016765 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1120/2278] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:06 2022] GET /compute/v2.1/servers/36d26d0b-7012-4164-9dcc-b031e4ce0d82 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:21:07.020389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:07.020914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:07.043289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:07.044179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:07.044488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:07.045359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:07.045823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:07.046252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:07.128112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:07.145863 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Working on deleting snapshot ef13cd66-4627-44c8-9551-ecc6bd307a2b from shelved instance... Aug 30 18:21:07.274482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:07.496420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:07.540477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:07.542705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:07.549313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5404cade-aadf-46e4-91af-86e7648cc305 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.947577 Aug 30 18:21:07.550549 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1159/2279] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:06 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:07.557802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:07.564710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:07.584667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:07.587067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:07.590403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:07.591721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:07.595174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:07.596044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:08.341699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:08.387956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:08.392442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:08.396567 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f368a359-e6f9-4e86-87c6-59721dfcc7a1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1660 microversion: 2.42 time: 0.842813 Aug 30 18:21:08.412804 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1160/2280] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:07 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1660 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:08.412804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:08.412804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:08.429132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:08.430675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:08.431717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:08.434203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:08.434721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:08.435694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:08.528162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:21:08.729902 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f31d1cdd-6c4b-4cf5-bab1-98dc15e0ccb4 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc" status: 204 len: 0 microversion: 2.47 time: 0.329830 Aug 30 18:21:08.730912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1161/2281] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:21:08 2022] DELETE /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:21:08.779098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Doing local delete in cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122590) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 18:21:08.786337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:08.792599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:08.793958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:08.795082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:08.800917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:08.801425 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 18:21:08.808159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] deallocate_for_instance() {{(pid=122590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 18:21:08.844365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:08.847193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:08.848886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:08.850610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:08.854685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:08.858146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:09.310228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc40f3a740645d1af38042ad00935b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f1b4b0a4db421c8a3e96a99cd78290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:09.324065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b08d3e7-4f0c-4b21-9ef3-f606b3357b1e tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 200 len: 1452 microversion: 2.1 time: 0.579231 Aug 30 18:21:09.338050 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1162/2282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:08 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 1452 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:09.339757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:09.340369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:09.361677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:09.378775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:09.382993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:09.385396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:09.385990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:09.388257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:09.764556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:09.777519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e928e3d-87e0-4b56-bbe3-d074a8da9b73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.440839 Aug 30 18:21:09.783688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1163/2283] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:09 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:09.812013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:09.812644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:09.830147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:09.833220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:09.834980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:09.835919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:09.839118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:09.839741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.324910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.337849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.339757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.341671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad0b4d32-59f2-432b-b030-234d82111d33 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.556575 Aug 30 18:21:10.342873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1164/2284] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:09 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:10.350886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.353065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:10.367713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.368613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.369265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.370278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.371143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.371779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.375361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:10.456787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.469728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.472151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.474398 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c07585cb-f432-400c-b8cb-1c7298787d51 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc" status: 200 len: 1363 microversion: 2.47 time: 0.130081 Aug 30 18:21:10.475646 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1165/2285] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc => generated 1363 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:10.480910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ab854-717b-4ef7-8c58-c1bfce0b2df8", "name": "network-vif-deleted", "tag": "dcac9f94-6e92-4d83-8dbf-41e6f66fcad4"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:10.493275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.494327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.495015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.509434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] Creating event network-vif-deleted:dcac9f94-6e92-4d83-8dbf-41e6f66fcad4 for instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 on n-h1-854119-10 Aug 30 18:21:10.515861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-008e8487-8e80-4988-8e32-233cd2ee8ec3 req-0a061eaa-4515-4ab1-bef0-43eeb9d16652 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038706 Aug 30 18:21:10.517159 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1166/2286] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:10.523006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.524124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:10.532055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.532947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.533649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.534897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.535626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.536259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.738507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.756416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.758189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:10.759782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1706 microversion: 2.42 time: 0.241205 Aug 30 18:21:10.761034 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1167/2287] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1706 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:10.762308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.763666 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad9f2d77-e042-4491-8c37-ea69948f7e1d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001493 Aug 30 18:21:10.765150 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1168/2288] 10.222.0.25 () {56 vars in 886 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 18:21:10.771715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.772929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: 756ab854-717b-4ef7-8c58-c1bfce0b2df8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:10.781405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.782278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.783340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.784894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.786246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.787360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.825792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 HTTP/1.1 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '756ab854-717b-4ef7-8c58-c1bfce0b2df8'} Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:10.829321 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance 756ab854-717b-4ef7-8c58-c1bfce0b2df8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8" status: 404 len: 111 microversion: 2.1 time: 0.065189 Aug 30 18:21:10.833913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1169/2289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/v2.1/servers/756ab854-717b-4ef7-8c58-c1bfce0b2df8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:10.835291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.835859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af6622b9-6ea5-402b-b057-83bf22c7f49f tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001472 Aug 30 18:21:10.842495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1170/2290] 10.222.0.25 () {54 vars in 1035 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 30 18:21:10.848438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:10.849066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:10.856326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.856901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.857341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:10.858114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:10.858691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:10.859169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.107473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:11.153499 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ad643a5-2cba-42ac-af9f-f4e8b2f89ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.307884 Aug 30 18:21:11.156561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1171/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:10 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:11.186212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56de9310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.233342 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Image not found. Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 HTTP/1.1 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ec89738b-00bf-49c8-8914-b0caa873ad47'} Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ec89738b-00bf-49c8-8914-b0caa873ad47 to delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec89738b-00bf-49c8-8914-b0caa873ad47 could not be found. Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.236582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:21:11.241245 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.244499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:11.244499 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47" status: 404 len: 62 microversion: 2.1 time: 0.083877 Aug 30 18:21:11.244742 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1172/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:11 2022] DELETE /compute/v2.1/images/ec89738b-00bf-49c8-8914-b0caa873ad47 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:21:11.245985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.247511 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b88ff4b-22ac-4177-af48-d58bb5292902 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 30 18:21:11.248031 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1173/2293] 10.222.0.25 () {54 vars in 1041 bytes} [Tue Aug 30 18:21:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:11.255797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.257495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:11.268528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.270050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.273083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.274717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.281935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.284020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.321187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 HTTP/1.1 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a6d26ffd-b054-4f05-a06f-246822e47992'} Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:11.322988 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.327147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:11.330754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 404 len: 111 microversion: 2.1 time: 0.081376 Aug 30 18:21:11.335429 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1174/2294] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:11 2022] DELETE /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:11.335429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.335429 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2721446e-b5a2-4950-82a7-9e5a88b6d9c1 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001636 Aug 30 18:21:11.335429 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1175/2295] 10.222.0.25 () {56 vars in 886 bytes} [Tue Aug 30 18:21:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 18:21:11.388772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.391774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: a6d26ffd-b054-4f05-a06f-246822e47992] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:11.414999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.416520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.417736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.420293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.422602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.424147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.512512 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 HTTP/1.1 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a6d26ffd-b054-4f05-a06f-246822e47992'} Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.532247 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:11.554235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance a6d26ffd-b054-4f05-a06f-246822e47992 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:11.558022 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da97007c-37df-412b-934d-ca2a4ae85116 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992" status: 404 len: 111 microversion: 2.1 time: 0.184050 Aug 30 18:21:11.563977 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1176/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:11 2022] GET /compute/v2.1/servers/a6d26ffd-b054-4f05-a06f-246822e47992 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:11.571438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:11.572367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:11.580621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.581529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.582208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.583836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:11.584542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:11.585180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:11.984844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:11.999732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:12.002314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:12.005144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca8ba552-a1fd-4c47-8a77-14baa4a11d85 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.442111 Aug 30 18:21:12.006294 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1177/2297] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:11 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:12.013642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:12.014620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:12.025363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:12.025946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:12.026468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:12.027302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:12.028790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:12.029548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:12.060580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:12.113170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:12.115439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:12.117535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:12.118470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lazy-loading 'fault' on Instance uuid d4680848-7887-40f5-853d-d201129ad9dc {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:21:12.242393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:12.261550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:12.266909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f65e82186664f75adbf08084359652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b61486c14a4585bebfc770b2a688b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:12.268821 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcfb4115-0554-4bc7-a9f6-51dca1ae74e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc" status: 200 len: 1368 microversion: 2.47 time: 0.260805 Aug 30 18:21:12.288746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1178/2298] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:12 2022] GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:12.315235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7abb858b-9315-4b65-9239-6b449c474518 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e572adaf0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:12.415390 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7abb858b-9315-4b65-9239-6b449c474518 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Image not found. Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7abb858b-9315-4b65-9239-6b449c474518 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb HTTP/1.1 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5c173a04-e920-4e01-90aa-38b4c8e68ffb'} Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c173a04-e920-4e01-90aa-38b4c8e68ffb to delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c173a04-e920-4e01-90aa-38b4c8e68ffb could not be found. Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.417852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7abb858b-9315-4b65-9239-6b449c474518 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7abb858b-9315-4b65-9239-6b449c474518 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb" status: 404 len: 62 microversion: 2.1 time: 0.129078 Aug 30 18:21:12.421481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1179/2299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:12 2022] DELETE /compute/v2.1/images/5c173a04-e920-4e01-90aa-38b4c8e68ffb => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:21:12.442868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:12.451002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:12.506305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:12.509198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:12.510154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:12.518686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:12.521786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:12.522605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:12.549996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:12.678050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Updating instance_info_cache with network_info: [] {{(pid=122590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:21:13.055688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:13.071020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:13.077987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:13.082471 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5eaf292d-133e-4163-a155-59a28016a91b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1752 microversion: 2.42 time: 0.657537 Aug 30 18:21:13.098969 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1180/2300] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:12 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1752 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:13.114638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:13.115498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:13.133852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.134581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.135111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.137956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.140462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.141042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.407911 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f51f5e1d-a1f3-42a3-9d82-652397c71e5f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 204 len: 0 microversion: 2.1 time: 6.387377 Aug 30 18:21:13.410729 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1121/2301] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:07 2022] DELETE /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 0 bytes in 6396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:21:13.417040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:13.417560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:13.426792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.427570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.428196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.429100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.429716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.430748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.451261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 HTTP/1.1 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1'} Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:13.454083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:13.458534 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.460986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:13.462057 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de5c304a-4458-445a-90e5-f0ceef119605 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 404 len: 111 microversion: 2.1 time: 0.050320 Aug 30 18:21:13.463357 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1122/2302] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:13 2022] DELETE /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:13.470456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89fa5066-6bfc-4719-b1cf-db750750e1c0", "name": "network-vif-deleted", "tag": "462321ce-718b-4f9c-99e7-b5beb8bde24d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:13.498030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.498882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.499407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.522464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_external_events [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] Unable to find a host for instance 89fa5066-6bfc-4719-b1cf-db750750e1c0. Dropping event network-vif-deleted {{(pid=122590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:21:13.523496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f7757250-2db6-4153-9d60-a15a509e2c16 req-5af3f2e3-f85a-487b-84f7-f1c447567e11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.058772 Aug 30 18:21:13.524332 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1123/2303] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:21:13.530694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:13.532128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:13.540746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.541553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.542413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.543383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.544092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.544716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.809315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:13.825736 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c709efa-f1b9-4f24-b2de-414c2928a917 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.723682 Aug 30 18:21:13.833466 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1181/2304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:13 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:13.845200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:13.845878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] [instance: d4680848-7887-40f5-853d-d201129ad9dc] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:13.858744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.859299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.860820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.862453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.863266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.863723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.896039 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] HTTP exception thrown: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Request method failure captured: Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc HTTP/1.1 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlTcBuZBl9l0xq6XSH0aDavD5myq4pahmpq3YMlPyNEsX_o7vVGOyoZUn4E3lm3Xbg_zCAZp6PZmbZVb83ohjkFFov2P5-AmExsLJoxlZs3-agY62qw0r6qetT0aohdNHmEkzWSZyqsINGRwfE3EHrnTr3QZ7jjJqDpdueXoVU_5BQo Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 41b61486c14a4585bebfc770b2a688b4 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerShowV247Test-629692766 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41b61486c14a4585bebfc770b2a688b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerShowV247Test-629692766 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 41b61486c14a4585bebfc770b2a688b4 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerShowV247Test-629692766 Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerShowV247Test-629692766-project Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3f65e82186664f75adbf08084359652d Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerShowV247Test-629692766-project Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd4680848-7887-40f5-853d-d201129ad9dc'} Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:13.898656 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. Aug 30 18:21:13.902402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:13.905359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] Returning 404 to user: Instance d4680848-7887-40f5-853d-d201129ad9dc could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:13.906893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2afe374-a640-4c80-b0a0-cf44e80dc4e1 tempest-ServerShowV247Test-629692766 tempest-ServerShowV247Test-629692766-project] 10.222.0.25 "GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc" status: 404 len: 111 microversion: 2.47 time: 0.070819 Aug 30 18:21:13.907702 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1182/2305] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:13 2022] GET /compute/v2.1/servers/d4680848-7887-40f5-853d-d201129ad9dc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:21:13.928909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:13.932707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:13.944508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.951938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.952842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:13.956951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:13.958225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:13.958943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:14.018085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 HTTP/1.1 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '89fa5066-6bfc-4719-b1cf-db750750e1c0'} Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.020940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:21:14.025927 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.028278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:14.030478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47d02e3c-68ee-4b57-a6ad-8f7a4bdba08f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 404 len: 111 microversion: 2.1 time: 0.119950 Aug 30 18:21:14.031098 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1183/2306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:13 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:14.050802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:14.053298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:14.075452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:14.076089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:14.076462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:14.079771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:14.081882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:14.084018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:14.125547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 HTTP/1.1 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1'} Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.128195 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. Aug 30 18:21:14.131859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.138973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:14.139919 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d369a80e-aaee-4df2-a2b1-ec3afa5227a5 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1" status: 404 len: 111 microversion: 2.1 time: 0.102152 Aug 30 18:21:14.142147 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1184/2307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:14 2022] GET /compute/v2.1/servers/dc54aa33-2fc5-4d84-9b16-8aead0a6dbf1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:14.155387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:14.158577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:14.168549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:14.183128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:14.186264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:14.186938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:14.188015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:14.189754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:14.191267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:14.559968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:14.582565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:14.584965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:14.602460 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd49bae6-01aa-45b3-aee7-9fe4c65f3b0c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1752 microversion: 2.42 time: 0.458282 Aug 30 18:21:14.604580 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1185/2308] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:14 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1752 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:14.621802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5944413f-5bd1-444c-96a3-f426688e8150 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '.version_select at 0x7f4e56e66160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:14.651235 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-5944413f-5bd1-444c-96a3-f426688e8150 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Image not found. Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5944413f-5bd1-444c-96a3-f426688e8150 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 HTTP/1.1 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '86aed2ef-262d-4390-9e42-9796995badc7'} Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 86aed2ef-262d-4390-9e42-9796995badc7 to delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 86aed2ef-262d-4390-9e42-9796995badc7 could not be found. Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.653007 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5944413f-5bd1-444c-96a3-f426688e8150 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5944413f-5bd1-444c-96a3-f426688e8150 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7" status: 404 len: 62 microversion: 2.1 time: 0.048000 Aug 30 18:21:14.656934 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1186/2309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:14 2022] DELETE /compute/v2.1/images/86aed2ef-262d-4390-9e42-9796995badc7 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:21:14.672525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-392483489", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:15.010278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:15.022802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:15.028524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:15.032652 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbfb391b-7376-489a-ad8d-31c7cf8de43c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.507025 Aug 30 18:21:15.035648 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1124/2310] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:13 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:15.048163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:15.051553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:15.068779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.069652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.072841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.073928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.074629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.075307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.112374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:15.119759 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 HTTP/1.1 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e77a6f7d-848a-4117-a0d6-c364e5635ee7'} Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:15.124895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.130291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.137397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:15.142211 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb2ba9fd-9b14-40b4-8a63-e5d9bcb0fbc9 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 404 len: 111 microversion: 2.1 time: 0.104071 Aug 30 18:21:15.154975 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1125/2311] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:21:15 2022] DELETE /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:15.163136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:15.163968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:15.180565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.181749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.183888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.187562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.188288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.188925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.286657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:21:15.743736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:15.760363 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0486e03a-d2ad-4793-8cfa-c69166398ad1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.603768 Aug 30 18:21:15.766323 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1126/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:15 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:15.772579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:15.780952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] [instance: e77a6f7d-848a-4117-a0d6-c364e5635ee7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:15.795865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.800500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.808753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.809896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.810632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.811281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.839232 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] HTTP exception thrown: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Request method failure captured: Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 HTTP/1.1 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlP5RoWx5w0Bt3ZqRp61D4dz5AKuwFDUAMSE83g-bOgtOHga3drLH_W5RYjo4ymkKJBwPkYMKH7kmCMa6pLIOqZrG-8cpTvyicrVB-O2SaXx6pH-w10RCvEKlWJMCiFTG6XMo3XJQpdK7hDt1T8a7tX6UpSgLxsp0ozCe_5d-aBAJzk Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60f1b4b0a4db421c8a3e96a99cd78290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 60f1b4b0a4db421c8a3e96a99cd78290 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesTestJSON-621768589 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1cc40f3a740645d1af38042ad00935b1 Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesTestJSON-621768589-project Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e77a6f7d-848a-4117-a0d6-c364e5635ee7'} Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.842921 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. Aug 30 18:21:15.850681 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:21:15.851576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] Returning 404 to user: Instance e77a6f7d-848a-4117-a0d6-c364e5635ee7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:21:15.857372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8febbf92-87b0-4f66-bac6-7a69f09d3c31 tempest-ImagesTestJSON-621768589 tempest-ImagesTestJSON-621768589-project] 10.222.0.25 "GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7" status: 404 len: 111 microversion: 2.1 time: 0.088266 Aug 30 18:21:15.863724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1127/2313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:15 2022] GET /compute/v2.1/servers/e77a6f7d-848a-4117-a0d6-c364e5635ee7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:21:15.867546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:15.870385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:15.896115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.896936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.897503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:15.898274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:15.898863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:15.899402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.289830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:21:16.290992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:21:16.291690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:21:16.292313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:21:16.293003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:21:16.306506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.307514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.308166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.309205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.310000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.310680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.359941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:21:16.377527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:21:16.416136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:21:16.426132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:21:16.481056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:16.508502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:16.512163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:16.520886 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3293d596-a272-4e06-b2c6-f903ae0d874c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1752 microversion: 2.42 time: 0.660864 Aug 30 18:21:16.522253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1128/2314] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:15 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1752 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:16.551695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:16.552673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:16.579196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.579982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.581704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.583373 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3952c9fd-ff44-4a67-917a-f3601f915907 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923409 Aug 30 18:21:16.584823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.585441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.586508 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1187/2315] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:21:16.587470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.601239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22a8d699-4c18-4980-bd69-4147d13be9c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:16.603918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22a8d699-4c18-4980-bd69-4147d13be9c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:16.789815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22a8d699-4c18-4980-bd69-4147d13be9c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:16.827270 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22a8d699-4c18-4980-bd69-4147d13be9c8 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1214 microversion: 2.1 time: 0.231957 Aug 30 18:21:16.832999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1188/2316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:16 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:21:16.850631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:16.851248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:16.869572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.879434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.879916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:16.881624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:16.882183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:16.882648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:17.195928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:17.214195 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c477b838-e430-446e-8a25-62bd93d0d02a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.376520 Aug 30 18:21:17.215177 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1189/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:16 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:17.323381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:17.332191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:17.333676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:17.347965 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-780e10a7-37d9-4f42-96d6-73983193c302 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.824227 Aug 30 18:21:17.348600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1129/2318] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:16 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:17.548517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:17.549381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:17.560901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:17.561454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:17.561897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:17.562810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:17.563275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:17.563707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:17.856554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:17.858911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:17.861879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:17.899423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:17.900661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:17.901717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:17.903382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:17.909983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:17.911040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.118421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:18.141847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:18.144692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:18.147392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a16ffe66-551a-4524-b8fc-c2b9d04e868f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1798 microversion: 2.42 time: 0.602708 Aug 30 18:21:18.164084 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1190/2319] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:17 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1798 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:18.174001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:18.192986 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc376d53-9337-4fc2-b1c5-bcdfcc877a75 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1210 microversion: 2.1 time: 0.334724 Aug 30 18:21:18.193816 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1130/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:17 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1210 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:18.258375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:18.259385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:18.277033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.278977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.281100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.284455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.288795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.290240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.415818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-382836798", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:18.487033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:21:18.487652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:21:18.488289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:21:18.488849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:21:18.489414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:21:18.500624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.501386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.501992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.503430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.504252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.504827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.541602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Getting quotas for project e7a1e1e4b6ae498ab303c7ace47531bc. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:21:18.551116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Getting quotas for user 62db45530a6b46fda9a1a7579d95544c and project e7a1e1e4b6ae498ab303c7ace47531bc. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:21:18.579950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:21:18.583234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:21:18.651182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b62b8127-7d09-416d-acb9-46ed475cb85e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.485173 Aug 30 18:21:18.652916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1191/2321] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:21:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:21:18.660265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:18.661371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:18.674284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.676017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.677227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.679741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:18.681322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:18.682445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:18.764193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:18.778424 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f59f2d74-e45c-4fb0-83b6-627056beab79 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.524269 Aug 30 18:21:18.784240 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1131/2322] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:18 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:21:18.789747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:18.790415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:19.001556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.021676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.023238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.035783 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d429f326-f80e-4227-a2de-effc8a024bc0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1277 microversion: 2.57 time: 0.250210 Aug 30 18:21:19.044898 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1132/2323] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:18 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:19.175555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:19.176666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:19.192907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:19.193418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:19.193863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:19.194666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:19.195138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:19.195566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:19.694384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.704913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.718979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.721285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac4bb962-d14d-4ab2-9f54-66ada1302921 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.066852 Aug 30 18:21:19.724499 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1192/2324] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:18 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:19.732928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:19.734625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:19.748431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:19.749236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:19.749924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:19.752173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:19.754227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:19.755204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:19.977157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:19.993968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55628561-d2f6-45c9-a44f-752f277b4500 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1272 microversion: 2.1 time: 0.264906 Aug 30 18:21:19.995095 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1193/2325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:19 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:20.008764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:20.009724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:20.026908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.027441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.028037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.029347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.029347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.040991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.132073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.172188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.188841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.204873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ec2db80-64bf-457a-a50f-6b67cf7a5114 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1798 microversion: 2.42 time: 1.023321 Aug 30 18:21:20.206084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1133/2326] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:19 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1798 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:21:20.226499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:20.234530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:20.275628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.276521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.277370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.278814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.279713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.285507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.543830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.584046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.607836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4be7eeb6-808f-413b-8aea-e0fc7f4e5cd7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.597108 Aug 30 18:21:20.608905 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1194/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:19 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:20.617508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.635468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:20.637352 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3c3fe75-5bcf-4d3a-9622-756b536693a1 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1329 microversion: 2.57 time: 0.422670 Aug 30 18:21:20.638494 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1134/2328] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:20 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1329 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:20.756066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:20.756701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:20.775475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.775977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.779518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.780307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:20.780785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:20.781212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:20.813550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:21.018120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:21.019435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:21.037723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.041506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.042672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.044510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.046074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.048293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.217096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.232956 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8938a43f-76ca-46ca-9060-95cd6631b298 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1272 microversion: 2.1 time: 0.220268 Aug 30 18:21:21.241995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1135/2329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:21 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:21.254686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:21.256343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:21.280814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.283129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.284983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.287357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.287836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.288264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.827184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.844015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.849463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.852194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.853609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e700a7b4-4241-47e1-8d79-21ce79c0956a tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.103976 Aug 30 18:21:21.859771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1195/2330] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:20 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:21.868764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:21.870774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.872284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:21.873181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:21.873366 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e690fcb8-a57c-4536-bfc1-a040d2df38b4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1844 microversion: 2.42 time: 0.630062 Aug 30 18:21:21.885543 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1136/2331] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:21 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1844 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:21.892432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.896303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.897125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:21.897755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:21.899601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.902668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.903542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.905276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.928017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.929919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.932067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:21.936445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:21.936965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:21.938789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.235652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:22.250107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:22.256318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:22.261313 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e1dc80e3-283a-48c5-a1f2-c8d67fc93d6d tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1335 microversion: 2.57 time: 0.372219 Aug 30 18:21:22.264193 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1137/2332] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:21 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:22.275665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:22.276636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:22.294980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.297498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.298126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.299101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.302833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.303708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.537908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:22.549166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31af8fe9-e5c2-472f-ad1c-c6a635404729 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.687684 Aug 30 18:21:22.549828 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1196/2333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:21 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:22.650751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:22.662817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7060a010-0990-42c3-b87a-e48ba94af319 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1272 microversion: 2.1 time: 0.392233 Aug 30 18:21:22.663813 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1138/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:22 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:22.882783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:22.884296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:22.896785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.899878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.900656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.903146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.905083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.907572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.914273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:22.915324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:22.930434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.934043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.934882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:22.937102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:22.946421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:22.947236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:23.656328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.681026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.686019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.689364 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bcd561b9-081d-4d6c-8ead-2087d54e5d8c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1844 microversion: 2.42 time: 0.779861 Aug 30 18:21:23.697473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1139/2335] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:22 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1844 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:23.717946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:23.718966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:23.728730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:23.729570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:23.730953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:23.740112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:23.740919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:23.741546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:23.843310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.859839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.867178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:23.868846 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9e3d51cd-ced2-4ff1-b4f6-fdc3b61501aa tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.991287 Aug 30 18:21:23.889029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1197/2336] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:22 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:23.901860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:23.905408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:23.926020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:23.926803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:23.927423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:23.928362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:23.929276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:23.930534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:24.144373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:24.157205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:24.163201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:24.167051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e45eafbf-c707-4d7f-8e12-b2bcd803a65a tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1356 microversion: 2.57 time: 0.466756 Aug 30 18:21:24.167744 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1140/2337] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:23 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1356 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:24.182386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:24.187185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:24.204724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:24.206512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:24.207600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:24.208601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:24.209236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:24.209885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:24.833721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:24.864391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d4b926d-388b-4915-933b-e1c1ce593e4c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.970340 Aug 30 18:21:24.870762 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1198/2338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:23 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:24.889262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "f44263b0-4a1b-4c47-ae87-11c454d595aa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:24.932744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:24.933645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:24.935253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:24.966606 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] Creating event network-changed:f44263b0-4a1b-4c47-ae87-11c454d595aa for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:24.982413 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-61f95800-85cc-48a9-9f8e-784f7e01abd2 req-f7174529-1a80-43d1-b5e0-e1b6df40d4ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108437 Aug 30 18:21:24.983879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1199/2339] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:24.993746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:24.996854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:25.020907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.021431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.023018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.024204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.025442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.026434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.078213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:25.163427 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dee9605e-3162-41e0-8ee0-9d430d38e3db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.988223 Aug 30 18:21:25.185591 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1141/2340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:24 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:25.231486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:25.243282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:25.243550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:21:25.244065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:21:25.244581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:21:25.244996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:21:25.245423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:21:25.277678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.285025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.290845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.295864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.299259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.301668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.426006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:25.445615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.448655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.449175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.453051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.454025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.454742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.623055 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf7d7e8b-0b37-4702-8e5c-6eb4445bff0f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "POST /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed/action" status: 202 len: 1137 microversion: 2.57 time: 0.613501 Aug 30 18:21:25.623055 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1200/2341] 10.222.0.25 () {62 vars in 1320 bytes} [Tue Aug 30 18:21:24 2022] POST /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed/action => generated 1137 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 18:21:25.623969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:25.627171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:25.645827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.649352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.650400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:25.651994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:25.653218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:25.654316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:26.977221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:26.992813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:26.996058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.000569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74222fd6-50a7-4aee-aa2a-836ef86bb56f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.388429 Aug 30 18:21:27.001816 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1201/2342] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:25 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:27.029269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:27.030002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:27.044072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.044894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.045495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:27.046418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.049039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.050019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:27.185205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.202843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.209727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.215654 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b284c836-12d4-4ffc-b7eb-1515a7a86c35 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.197371 Aug 30 18:21:27.221840 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1202/2343] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:27 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:27.239206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:27.240549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:27.248483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.262026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.262851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:27.263771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.264655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.265438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:27.319635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.342890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.347523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:27.353837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9eb3c31f-bd41-431c-a4ce-615ae24b34a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1844 microversion: 2.42 time: 2.160653 Aug 30 18:21:27.378954 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1142/2344] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:25 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1844 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:27.388930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:27.390718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:27.405954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.407838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.409071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:27.410424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:27.412009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:27.412951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:28.515638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:28.523655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:28.533500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18c66492-06b9-4407-a106-39cce8b914c2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 1.309603 Aug 30 18:21:28.547029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1203/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:27 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:28.559242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542726f6-d659-4063-922f-955036c45de2", "tag": "3346d604-66c3-4a84-89c0-02d0abef5cea"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:28.573204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:28.573698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:28.574181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:28.589437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:28.595181 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] Creating event network-changed:3346d604-66c3-4a84-89c0-02d0abef5cea for instance 542726f6-d659-4063-922f-955036c45de2 on n-h2-854119-10 Aug 30 18:21:28.602515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6d3020a4-3a92-428f-a398-4003d66b4fe5 req-a92e790d-7ae9-43ed-8ded-93385c00c4e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053874 Aug 30 18:21:28.604976 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1204/2346] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:28.620135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9bb040ce-b145-471c-a8a6-1fb84118b424 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e567e34c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:28.695330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:28.720881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8497dc16-c08c-4e6f-8c34-83c446124a34 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 1.338161 Aug 30 18:21:28.724290 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1143/2347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:27 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:28.736005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:28.736718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:28.754910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:28.755765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:28.756705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:28.763131 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9bb040ce-b145-471c-a8a6-1fb84118b424 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e624feca-e341-48c8-91d8-00f58774e1a3" status: 200 len: 350 microversion: 2.1 time: 0.154375 Aug 30 18:21:28.764191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1205/2348] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:21:28 2022] GET /compute/v2.1/os-volumes/e624feca-e341-48c8-91d8-00f58774e1a3 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:28.771554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:28.772455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:28.773132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:28.775919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:28.781427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:28.795044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:28.821437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:28.822219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:28.830250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:28.836512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:28.838024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:28.841764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.017685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:29.061455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.071644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.078187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.084080 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b139c14-ba45-410a-91cc-0ffe6d01b56e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.316371 Aug 30 18:21:29.102387 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1206/2349] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:28 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:29.103961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:29.104840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:29.125365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:29.126196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:29.127114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.129054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:29.129837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:29.130518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.800473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.811144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.823664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.829637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.831451 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-435eba8d-bd6c-4078-a739-e829b66d889b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1865 microversion: 2.42 time: 0.742362 Aug 30 18:21:29.837701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1207/2350] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:29 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1865 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:29.846695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.855190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:29.856247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "5a150048-908c-4d8d-a180-1280d4dcfa98"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:29.857487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9768113c-1f07-4e94-a453-e6545aa3153e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.131790 Aug 30 18:21:29.861298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1144/2351] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:28 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:29.877925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:29.885024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:29.893515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:29.894445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:29.895148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.896158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:29.896862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:29.897522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.912473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:29.913634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:29.915008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:29.950239 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] Creating event network-changed:5a150048-908c-4d8d-a180-1280d4dcfa98 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:29.985617 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b247aa58-0bfa-40b8-a67b-c451f02c36d7 req-1cdf88aa-24ec-452f-af29-3feb9c197f37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145691 Aug 30 18:21:29.991896 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1208/2352] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:30.004358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:30.006194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:30.020039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.021437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.022829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.024632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.025897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.027100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.508416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:30.551863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93320344-3ff3-41a6-9097-909a66978ecb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.549745 Aug 30 18:21:30.553271 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1209/2353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:29 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:30.575464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:30.580042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:30.625554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.632308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.634930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.641085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:30.642257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:30.643417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:30.910906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:30.942520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:30.974216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:30.976985 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee5ef7e2-d5b1-44ff-960b-f456aac4be56 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.419785 Aug 30 18:21:30.980790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1210/2354] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:30 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:31.011826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:31.019749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:31.038424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.039338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.040009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.040963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.041627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.043408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.378777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:31.395510 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fcce5fe8-81f5-44ba-bdd7-6fffbbe7af7c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 1.532675 Aug 30 18:21:31.396159 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1145/2355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:29 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:31.407911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:31.408561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:31.440819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.441682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.442171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.443003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.443491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.443914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.787345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:31.803920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:31.818555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:31.824225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-315a5c43-9b09-44aa-931d-11b0cc418432 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1886 microversion: 2.42 time: 0.838672 Aug 30 18:21:31.825420 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1211/2356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:30 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1886 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:31.831223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:31.832628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:31.841212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.842637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.843455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:31.844547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:31.845264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:31.846245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:32.299775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.310551 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b67e6f12-b67f-4a6a-911e-363e6ed02bd3 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.483509 Aug 30 18:21:32.316787 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1212/2357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:31 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:32.327087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:32.327787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:32.365771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:32.370848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:32.373319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:32.376172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:32.377609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:32.379222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:32.404064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:32.536613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.557055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.558862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.562120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-efb7da38-d882-494b-8a12-fb59fe409983 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.244085 Aug 30 18:21:32.563066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1213/2358] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:32 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:32.818747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2028777103", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:32.969045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.981183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.982690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:32.988238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:21:33.001312 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8de72ab-0a59-48cc-a3b7-1dbb2b98b3f6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.603880 Aug 30 18:21:33.004222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1146/2359] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:31 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:33.354951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:33.356046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:33.383249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.384348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.385045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.386167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.387548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.388407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.548081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:21:33.548638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:21:33.548998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:21:33.549653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:21:33.550226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:21:33.563945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.564804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.565453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.566481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.567121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.567714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.593233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Getting quotas for project ae317cc03c76466188ada89e03fa9e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:21:33.602599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Getting quotas for user 7224d5edb940414686664ef036761d33 and project ae317cc03c76466188ada89e03fa9e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:21:33.619498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:21:33.622891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:21:33.636878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:33.693158 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ed68b0e-9269-468d-a514-564f32e9616c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128671 Aug 30 18:21:33.695325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1214/2360] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:21:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:21:33.701548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:33.702468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:33.712252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.714008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.714936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:33.715939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:33.717742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:33.718870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:34.217841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:34.235839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:34.238819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:34.243643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22afa44b-9641-48fb-b87c-ebbfd36f29cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1886 microversion: 2.42 time: 0.546691 Aug 30 18:21:34.258908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1215/2361] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:33 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1886 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:34.265644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b50a4b63-4ac2-4509-ba0b-0c75d755d8a8 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5af70820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:34.329709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b50a4b63-4ac2-4509-ba0b-0c75d755d8a8 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/48adf35f-4564-47fa-b258-7463b7cd94e6" status: 200 len: 350 microversion: 2.1 time: 0.069609 Aug 30 18:21:34.330871 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1216/2362] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:21:34 2022] GET /compute/v2.1/os-volumes/48adf35f-4564-47fa-b258-7463b7cd94e6 => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:34.337985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "c7b9917f-c612-494f-bb46-629acf69b6c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:34.369942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:34.370978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:34.375690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:34.438169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] Creating event network-changed:c7b9917f-c612-494f-bb46-629acf69b6c1 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:34.451434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-efea61d3-8695-44b3-b753-8d5785a713fc req-ebc0d410-552c-4945-8321-32397ae396e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118624 Aug 30 18:21:34.470379 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1217/2363] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:34.500453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:34.502008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:34.518660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:34.523528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:34.524701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:34.527255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:34.531488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:34.532661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.020728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.052425 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87bf7ffa-63e7-46fa-ba40-1c64e23b3a94 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.577124 Aug 30 18:21:35.055923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1218/2364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:34 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:35.066022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:35.075542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:35.100640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.102114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.114832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.116640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.118363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.119379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.370924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.396321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.431051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08886bee-506f-431e-b9b7-cce153893c77 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 2.419627 Aug 30 18:21:35.432613 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1147/2365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:33 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:35.442399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.457572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.459579 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c0bf371-7d4f-46bd-af58-7e3f2b6a6d23 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.400887 Aug 30 18:21:35.461782 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1219/2366] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:35 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:35.473376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:35.475118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:35.485363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:35.491480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.492781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.494098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.495959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.497381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.498653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.499070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:35.514385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.515547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.516489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.522561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:35.523697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:35.524669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:35.896398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.918449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.920242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:35.928754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-739d2dd9-169b-463b-896a-8ca895d3ec67 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.464397 Aug 30 18:21:35.945922 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1220/2367] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:35 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:35.986470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:35.989569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:36.007486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.008249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.008912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.010517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.011231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.012360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.342993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:36.357300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:36.360764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:36.363120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90e77645-dbbd-455b-86c0-83c746373b87 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1886 microversion: 2.42 time: 0.415497 Aug 30 18:21:36.364312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1221/2368] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:35 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1886 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:36.370968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542726f6-d659-4063-922f-955036c45de2", "name": "network-vif-plugged", "status": "completed", "tag": "3346d604-66c3-4a84-89c0-02d0abef5cea"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:36.388499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.393475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.394221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.423945 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] Creating event network-vif-plugged:3346d604-66c3-4a84-89c0-02d0abef5cea for instance 542726f6-d659-4063-922f-955036c45de2 on n-h2-854119-10 Aug 30 18:21:36.435109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4b33c48f-5f4e-4c29-9e7d-a53570d5c181 req-95ef4fa4-54e4-4e6d-a5fe-0de163ffe9af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068856 Aug 30 18:21:36.444246 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1222/2369] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:36.450715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:36.451734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:36.469787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.470285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.470763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.471617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:36.472071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:36.477729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:36.914125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:36.951137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1ffdca2-23f1-4a60-ab76-3ffc2d935f0d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.503908 Aug 30 18:21:36.968462 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1223/2370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:36 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:37.000626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:37.005494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:37.027892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.028740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.034898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.048736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.050244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.054490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.144388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.159250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-729029fb-4225-4073-bfd8-d5fecb4a8d4e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1221 microversion: 2.1 time: 1.719891 Aug 30 18:21:37.160284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1148/2371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:35 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1221 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:37.178388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:37.182202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:37.203533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.207145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.208305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.210937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.216994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.217745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.482867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.496420 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5fe1dfef-75c9-4b6d-b34a-b4a5b9f0c3cc tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.522852 Aug 30 18:21:37.497649 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1224/2372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:36 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:37.503189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:37.540922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.561684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.573518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:37.575776 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5bff7a03-a89a-4693-a506-b60c8e4a76b5 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.409520 Aug 30 18:21:37.579794 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1149/2373] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:37 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:37.588721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.589272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.591025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.610965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:37.611984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:37.643497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.644007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.644452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.645178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.645647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.653656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.666273 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] Creating event network-vif-unplugged:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h2-854119-10 Aug 30 18:21:37.693086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e905d493-1e2c-4c4e-b055-3db8294517f7 req-dbbf6e04-3401-4bfc-81ff-d4cfa0074dd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192882 Aug 30 18:21:37.696189 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1225/2374] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:37.710523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:37.712323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:37.732624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.733745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.735172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:37.739210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:37.740623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:37.741645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.245766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.284425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.286389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.288374 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5478d85-43a5-4965-8709-677c40bc9aad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1886 microversion: 2.42 time: 0.587965 Aug 30 18:21:38.289610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1226/2375] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:37 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1886 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:38.326793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.327732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:38.335480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.336609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.337348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.337980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.338520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.339087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.340312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.348678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.350254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.358147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b177795-928c-424b-82ad-dd5b9a6e57a0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.772263 Aug 30 18:21:38.382400 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1150/2376] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:37 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:38.388082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.388698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:38.399668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.400169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.400611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.408046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.408890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.409541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.530981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.550063 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-320f913e-bc33-4867-aa29-8fe22a818c36 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1275 microversion: 2.1 time: 0.157137 Aug 30 18:21:38.551531 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1151/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:38.566927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.567877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:38.580815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.583048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.586529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.587667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.588361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.591020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.741327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.750561 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1b6a528-145e-4664-9962-f23fe3e0347c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1314 microversion: 2.1 time: 0.428862 Aug 30 18:21:38.751118 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1227/2378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:38.759547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.760493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:38.779178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.779926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.780599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.787944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:38.790122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:38.792409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:38.925743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.943538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.947850 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64da35ec-c83c-42ec-aa92-a7b888f3af16 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.394855 Aug 30 18:21:38.948477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1152/2379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:38.954163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9036bc6-65bb-4821-9b8e-90a1a37743b1 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e567e9c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:38.976959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.984479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:38.993539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bccd7966-2a24-4746-9160-6346281a542c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.231161 Aug 30 18:21:38.994381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1228/2380] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:39.042560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9036bc6-65bb-4821-9b8e-90a1a37743b1 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/14883377-5483-4d53-bc92-9f85af6e1483" status: 200 len: 349 microversion: 2.1 time: 0.092865 Aug 30 18:21:39.051863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1153/2381] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:21:38 2022] GET /compute/v2.1/os-volumes/14883377-5483-4d53-bc92-9f85af6e1483 => generated 349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:39.061236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b09d6a7-f827-44df-8931-fa1af70a6afe tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5af70430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:39.264577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b09d6a7-f827-44df-8931-fa1af70a6afe tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.210200 Aug 30 18:21:39.274048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1229/2382] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 18:21:39 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:21:39.281520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97cd5bb2-f5eb-4912-b5b1-d169f3aa60b5 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e56936670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:39.318750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:39.320031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:39.329983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:39.332238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:39.333038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:39.334020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:39.334772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:39.335512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:39.472210 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97cd5bb2-f5eb-4912-b5b1-d169f3aa60b5 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.195848 Aug 30 18:21:39.476611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1154/2383] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:21:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:39.484215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:39.487505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:39.507593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:39.508140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:39.508597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:39.509355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:39.509822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:39.510255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.164721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.175649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.185601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.195052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ded64077-5cc2-4857-b19f-0ea1ec673a71 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1886 microversion: 2.42 time: 0.877123 Aug 30 18:21:40.211388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1230/2384] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:39 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1886 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:40.220209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-970182ae-9133-43ab-849d-c7c0e9ced5aa tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5af703a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:40.258203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.274920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.283365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.285085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-039f7788-9062-453f-8367-d0c51f305980 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.807128 Aug 30 18:21:40.286328 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1155/2385] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:39 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:40.296060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:40.302330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:40.345825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.350490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.354584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.360112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.364099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.366917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.377909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-970182ae-9133-43ab-849d-c7c0e9ced5aa tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.163776 Aug 30 18:21:40.379678 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1231/2386] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 18:21:40 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:40.391871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}, {"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "fd88dabe-1e40-497a-a17d-cef59e4a5d84"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:40.417346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.418845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.421445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.471852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Creating event network-changed:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h2-854119-10 Aug 30 18:21:40.473134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] Creating event network-changed:fd88dabe-1e40-497a-a17d-cef59e4a5d84 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:40.487042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-67429bba-8d5f-4141-a775-b1dada616ad9 req-ebbcc998-11c8-4a58-a90d-5d7b88435f16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105134 Aug 30 18:21:40.488594 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1232/2387] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:40.500526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:40.502153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:40.515953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.516840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.517559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.520185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.521238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.522056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.918119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:40.932348 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13afbb9a-cb49-4d4a-8be1-f58d270ee787 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1502 microversion: 2.1 time: 0.441460 Aug 30 18:21:40.934007 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1233/2388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:40 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1502 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:40.940155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:40.941277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:40.954428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.955762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.957228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:40.959150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:40.960598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:40.962738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.127649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:41.145573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88354487-64bc-4f4b-83f3-c7927c88f700 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.857231 Aug 30 18:21:41.147694 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1156/2389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:40 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:41.153787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:41.154934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:41.164309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.164916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.165636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.167229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.168094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.168737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.270733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:41.281153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d2fe1f40-9306-4c54-8280-7dbb41d3582d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.345769 Aug 30 18:21:41.282867 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1234/2390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:40 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:41.288178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43d31ae9-faa9-4eaa-8a4b-32c2d3e7ffa5 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5af878b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:41.404035 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43d31ae9-faa9-4eaa-8a4b-32c2d3e7ffa5 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119661 Aug 30 18:21:41.405305 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1235/2391] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 18:21:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:41.479736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:41.503513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.504588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.505745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.525498 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] Creating event network-changed:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:21:41.531275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-72496a9f-296c-45f8-a291-43b6838b63ea req-52a2d0fe-23bc-4de6-b5ff-5786dc8fb101 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124514 Aug 30 18:21:41.532974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1236/2392] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:41.540164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:41.549048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.550237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.551113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.585175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:21:41.636806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:41.678251 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c34a634-8194-49f5-bc2d-1e51f87f7e7b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2/action" status: 202 len: 0 microversion: 2.1 time: 0.142997 Aug 30 18:21:41.678821 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1237/2393] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:21:41 2022] POST /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:21:41.693076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:41.694087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:41.719762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.720581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.721677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.722774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.723824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.724638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.841210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:41.854482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:41.856484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:41.858098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f40493b-97bf-4d8f-a204-cf1c5a3cb005 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.709085 Aug 30 18:21:41.897412 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1157/2394] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:41 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:41.909555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:41.910306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:41.917828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.918493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.919004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:41.919835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:41.920401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:41.920897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.073204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.083925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.085991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.087329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a01628d-1e80-4b95-8ab6-2b8f2248d2cd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.407144 Aug 30 18:21:42.087953 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1238/2395] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:41 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:42.100780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d6ed12c-0e75-4acd-b442-4f1e33efadb8 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5afb8dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.197554 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d6ed12c-0e75-4acd-b442-4f1e33efadb8 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.105214 Aug 30 18:21:42.205809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1239/2396] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:42.212292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.213232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:42.221226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.221809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.222288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.223729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.224211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.224689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.412949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.424485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.428410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-abe909cf-d33c-4ce8-8cbe-3c0c143e9469 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.228474 Aug 30 18:21:42.438456 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1240/2397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:42.443416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.445918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.448882 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a4ce9c6-0a91-47a9-8f3f-d3e39d8eac91 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.549625 Aug 30 18:21:42.450030 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1158/2398] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:41 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:42.451340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.452327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:42.472089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.472603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.473059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.474838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.475324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.475769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.477481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cc25581-7ba1-4085-a22b-964f986309d0 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e56738430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.595791 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cc25581-7ba1-4085-a22b-964f986309d0 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.127876 Aug 30 18:21:42.596945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1159/2399] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:42.604772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.606175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:42.616317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.616837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.617345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.618855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.619510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.619980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.684949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.701124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d597f57-5ab6-45f3-9acf-2813696a3f68 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.261216 Aug 30 18:21:42.701815 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1241/2400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:42.716623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "7e6900a7-e5fc-4080-bc85-941d55b2029a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:42.730983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.731929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.732603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.745569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] Creating event network-changed:7e6900a7-e5fc-4080-bc85-941d55b2029a for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:42.751603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a6521b07-466a-4049-b928-1cab9dbefb31 req-1ca8db95-b2b7-42ce-8c49-4cc46cd3760e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047762 Aug 30 18:21:42.752457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1242/2401] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:42.758811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-897633b4-b220-4e6d-9194-bfee97e394d4 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e5af70b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.893414 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-897633b4-b220-4e6d-9194-bfee97e394d4 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.138498 Aug 30 18:21:42.895147 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1243/2402] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:42.911700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:42.913133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:42.924558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.925544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.926230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.927566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:42.937641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:42.939254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:42.947226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:42.962536 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53902d95-73c0-4772-9341-c2d40dce62fd tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.364172 Aug 30 18:21:42.965897 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1160/2403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:42.982464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4933c4e-baf4-4d44-986d-eea5d5ae37b6 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] Calling method '.version_select at 0x7f4e567859d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:43.132562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.155815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.163509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.169053 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2352776f-930f-47fe-9184-03dfa4706c87 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.263977 Aug 30 18:21:43.169800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1244/2404] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:43.183213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:43.184616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:43.192581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.193625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.195163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:43.196498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.197401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.197551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4933c4e-baf4-4d44-986d-eea5d5ae37b6 tempest-VolumesTestJSON-154901093 tempest-VolumesTestJSON-154901093-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.225401 Aug 30 18:21:43.198127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:43.198678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1161/2405] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:21:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:43.452653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:43.456227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:43.470830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.472605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.475003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:43.478089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.478775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.479850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:43.582780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:43.614257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:43.747687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.775555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.777474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:43.778862 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-365221cd-2040-49f6-814b-8e028569ef81 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.607204 Aug 30 18:21:43.782065 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1245/2406] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:43 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:43.801479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:43.802405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:43.822018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.823064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.823738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:43.824733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:43.825458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:43.826062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.246046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:44.262692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60b3530d-eb36-4110-965e-1a756e4fbb71 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.810638 Aug 30 18:21:44.264119 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1162/2407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:43 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:44.288240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "42940854-ee1d-4fa4-a985-343440ca2eb8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:44.313264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.314502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.315189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.347352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:44.369361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] Creating event network-vif-plugged:42940854-ee1d-4fa4-a985-343440ca2eb8 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:44.370306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:44.372349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:44.377627 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04271504-3951-45c8-b4dc-bc5df5f6fe8e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.590361 Aug 30 18:21:44.382200 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1246/2408] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:43 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:44.387884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:44.395353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:44.406039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.409623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.412710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.416178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.425213 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-504ba305-0ade-4d48-a5da-5938fffcd9fd req-a8d8de53-44be-4d96-a972-526dee7766d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160343 Aug 30 18:21:44.426652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.426797 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1163/2409] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:44.427443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.434955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:44.436003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:44.449240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.449967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.454637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:44.456441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:44.457379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:44.457994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.022660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.060072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d63cc5a-e009-41f5-9b59-ff690bc4e444 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.632044 Aug 30 18:21:45.063438 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1164/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:44 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:45.080660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:45.092300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:45.113297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.113800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.114242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.114994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.116389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.117194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.181541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:45.292529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.302882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9fe3cf9f-4205-49b3-83b7-8f0f173227d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.919007 Aug 30 18:21:45.308481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1247/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:44 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:45.322853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:45.323957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:45.354800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.355706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.359840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.370124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.373159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.374210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.377402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.378050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.385446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.399974 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af3eaa2a-d5f3-4402-b2f4-283d36d325a9 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.334868 Aug 30 18:21:45.400580 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1165/2412] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:45 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:45.423261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:45.424610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:45.447332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.454836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.456281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.457226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.457873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.458540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.833384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:45.850793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d93cfc9-27f1-44da-a85d-7d2b19846853 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.449091 Aug 30 18:21:45.851635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1166/2413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:45 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:45.856776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:45.863290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:45.877861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.878607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.879202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:45.880091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:45.880697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:45.881302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.243961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.252311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.275935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.277925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.279378 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f00f119-97c3-42c4-9d1c-78a9606083e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.426466 Aug 30 18:21:46.279729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.280340 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1167/2414] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:45 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:46.294679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.294679 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-79c11da3-31c0-4a98-9292-daec298a66c0 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.982289 Aug 30 18:21:46.294679 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1248/2415] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:45 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:46.317232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:46.319094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:46.338118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:46.338760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:46.341734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.342908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.344158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.345810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.347541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.348553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.356400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.356997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.357436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.358157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.358666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.359146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.647112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.668703 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9ce4687-2c48-4ead-8a85-10a1f6b9bf43 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.334630 Aug 30 18:21:46.669561 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1168/2416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:46 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:46.674852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:46.682495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:46.691717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.694064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.694745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.701050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.701969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.702842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.857834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.887936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.897828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.900396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:46.901834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d71b69de-94cb-48f1-8596-be29a4ca2b6f tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.231180 Aug 30 18:21:46.911320 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1169/2417] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:46 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:46.921880 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96be5868-1bbe-439b-8c6c-0a71dcbdf930 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.619128 Aug 30 18:21:46.921880 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1249/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:46 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:46.925201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "a642fd74-5a94-4293-9322-bf021b5f9e5b"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "a94e2401-6899-4923-9211-c9fb86eac7ef"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:46.928604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:46.930388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:46.937077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.937807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.938428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.944653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.945700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.946460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.947685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:46.948504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:46.949284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:46.954455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Creating event network-vif-plugged:a642fd74-5a94-4293-9322-bf021b5f9e5b for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:46.955870 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] Creating event network-vif-plugged:a94e2401-6899-4923-9211-c9fb86eac7ef for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:46.968822 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-89c1c12e-52b0-413e-afbd-ed0f2ce076ba req-4b4dfa80-2937-4007-b656-de294559444d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055616 Aug 30 18:21:46.969674 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1170/2419] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:47.007269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "07686b3e-76c6-440a-bf29-7d62ba1c4f20"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:47.024885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.025712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.026330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.041614 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] Creating event network-changed:07686b3e-76c6-440a-bf29-7d62ba1c4f20 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:47.049466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-65f2ec09-84ff-4a81-80aa-1f1f4669dda8 req-6dfc5d0f-a7b1-4b2a-a4da-63611be22175 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049125 Aug 30 18:21:47.051115 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1171/2420] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:21:47.314564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:47.327327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:47.347280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.348484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.349450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.350995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.352065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.353014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.709113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:47.733870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:47.735660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:47.737608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4fbf310e-d201-46b0-bad9-31960d43298f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 0.430747 Aug 30 18:21:47.740304 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1172/2421] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:47 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:47.754757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:47.754757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:47.761739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.762427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.766847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:47.767843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:47.768659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:47.769834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.244537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.302963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44e5c467-6193-4061-9e0d-2a3087e98d26 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 1.383901 Aug 30 18:21:48.324679 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1250/2422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:46 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:48.350623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.358683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:48.360582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:48.366285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.374304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.381792 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5556eb64-ae23-43eb-bde8-f8494184c676 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.639962 Aug 30 18:21:48.382721 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1173/2423] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:47 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:48.392454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:48.396055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:48.400399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.400981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.401361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.402125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.403097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.403097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.410699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=82 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:48.413528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.414037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.414502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.415240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.415699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.416119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.540302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.554003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.561670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:48.563976 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-40478a36-7d07-4ca3-8427-fa54119a0966 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.180012 Aug 30 18:21:48.567630 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1174/2424] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:48 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:48.583663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:48.584640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:48.600536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.602615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.603438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:48.607118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:48.613368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:48.614264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.134334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:49.147018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2335c257-8f9a-4fce-834a-e498a01b9236 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.820719 Aug 30 18:21:49.148215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1251/2425] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:48 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:49.160921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:49.161914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:49.175138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.176663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.182257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.183319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.183952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.184544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.252193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:49.300922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48ea9a67-0b29-4afd-a4f8-82bfcbeee528 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.731287 Aug 30 18:21:49.309081 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1175/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:48 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:49.339086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "3012161b-7ba2-4442-9060-f57a7f5ad3fe"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "457819b0-f0ad-4289-9a70-e3e8e269c9c1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:49.372174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.372666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.373115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.397920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Creating event network-vif-plugged:3012161b-7ba2-4442-9060-f57a7f5ad3fe for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:49.403441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] Creating event network-vif-plugged:457819b0-f0ad-4289-9a70-e3e8e269c9c1 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:49.410456 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3bbfec35-95cd-4bb4-91bf-30349173449a req-3fdb2fa8-74a1-4fa3-bd57-b8c7f9eceabd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095678 Aug 30 18:21:49.411590 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1176/2427] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:49.423869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:49.426595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:49.442261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.443097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.445920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.446938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.447611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.448208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.722768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:49.734750 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e7c9907-fc89-44ed-89f0-d325ea02acb9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.319879 Aug 30 18:21:49.735361 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1177/2428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:49 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:49.746789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:49.747817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:49.771339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.771841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.772280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:49.776318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:49.776814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:49.777258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.217045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.257236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.264896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.267168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-610a734b-0be0-496e-8c77-d637eae53a1e tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.114218 Aug 30 18:21:50.274177 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1252/2429] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:49 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:50.290035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:50.291175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:50.304313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.304822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.305609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.311209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.312071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.312762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.482426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.501377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.509228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.511805 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9915061b-1847-4069-a185-941cbfa6ab81 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.235622 Aug 30 18:21:50.517161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1253/2430] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:50 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:50.526713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:50.527356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:50.550361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.550893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.551349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.552121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:50.554473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:50.555325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:50.948853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.979831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.985510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:50.991843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-daac2050-622b-45e1-b7b6-7ab05ab0b7c5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.251089 Aug 30 18:21:50.993228 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1178/2431] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:49 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:51.006816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:51.017323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:51.028303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.033015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.033887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.035052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.036503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.040345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.306206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:51.333262 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62b76b55-a74e-4f9b-82e0-6446b48e00d2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.814731 Aug 30 18:21:51.339099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1254/2432] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:50 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:51.352155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:51.353043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:51.362542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.363493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.364052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.365001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.365572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.366105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.459210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:51.490221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e8b0690-f565-497e-9e1a-101b2bebd862 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.491894 Aug 30 18:21:51.512756 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1179/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:50 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:51.531195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "f7d4c69b-23a6-45aa-8df6-3532cb2bdd55"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:51.556426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.557258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.557861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.583517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] Creating event network-changed:f7d4c69b-23a6-45aa-8df6-3532cb2bdd55 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:21:51.619283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4d81714b-33b9-4dcb-8531-e021925289a3 req-8d9f3bad-d115-4262-a1d6-2b042efbaa71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104419 Aug 30 18:21:51.620012 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1180/2434] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:51.640057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:51.641413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:51.661657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.662522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.663259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.675606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:51.676613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:51.677408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:51.956251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:51.988634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a6fceb8-270a-4e4d-bb49-19693e3bb41a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.647918 Aug 30 18:21:51.989248 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1255/2435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:51 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:52.003208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "fdf7ba45-d5a0-471a-829e-43218c97999f"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-plugged", "status": "completed", "tag": "32fa0270-af32-48e8-a4c1-6a86a32f843d"}, {"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-plugged", "status": "completed", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:52.037267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.037765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.038196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.044210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:52.063493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Creating event network-vif-plugged:fdf7ba45-d5a0-471a-829e-43218c97999f for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:52.064292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Creating event network-vif-plugged:32fa0270-af32-48e8-a4c1-6a86a32f843d for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:21:52.065709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] Creating event network-vif-plugged:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:21:52.089546 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bf9ff9eb-087c-43a3-8ae9-bf200db20eeb req-63227fde-3e93-4e39-8e36-5aa8c9155556 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.094148 Aug 30 18:21:52.090550 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1256/2436] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:21:52.098122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:52.099321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:52.109828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.115947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.116618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.117569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.120026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.120670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.301498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:52.312514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:52.315757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:52.317471 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67bcebcf-dd1a-49a3-92c8-25e6d5bebc03 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.225429 Aug 30 18:21:52.340219 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1257/2437] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:52 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:52.345641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:52.346676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:52.353989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.354850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.355492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:52.357098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:52.357831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:52.358513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:53.046667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.067881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.069423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.080809 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-857b43ce-ad63-441c-8ff4-1922faae3f90 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1879 microversion: 2.32 time: 1.458755 Aug 30 18:21:53.084381 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1181/2438] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:51 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1879 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:53.100249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:53.102089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:53.117215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:53.118932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:53.120250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:53.122312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:53.125030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:53.126311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:53.525158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.542461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.546548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.550774 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f2c25aa-44ae-422a-877f-4efb7693234f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.209246 Aug 30 18:21:53.557146 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1258/2439] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:52 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:53.570631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:53.574059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:53.587383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:53.587812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:53.588248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:53.588959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:53.599844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:53.600492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:53.956962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:53.977683 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e911aaf9-c9ed-48cd-99b2-b37ce91fa90c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1317 microversion: 2.1 time: 0.891239 Aug 30 18:21:53.993772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1182/2440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:53 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:53.999408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:54.000392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:54.012816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.014939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.015739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.017253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.018077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.018896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.261883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:54.288271 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8352420e-9a57-4580-84cf-9b6a4378e2f5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1716 microversion: 2.1 time: 0.728910 Aug 30 18:21:54.291063 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1259/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:53 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1716 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:54.304321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:54.307225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:54.323094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.325319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.325925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.328332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.332040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.332585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.527107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:54.541750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:54.545912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:54.554757 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b950fdb2-f8e3-40f3-88c2-7a730723a0d0 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.259228 Aug 30 18:21:54.556055 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1260/2442] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:54 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:54.570435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:54.571669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:54.591116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.592011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.592699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.596974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.600293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.601246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.747018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:54.764500 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d977043-68b6-4166-986e-4279da33e8b4 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.762172 Aug 30 18:21:54.765743 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1183/2443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:53 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:54.787401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:54.787892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:54.806141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.811094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.811618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:54.812444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:54.812934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:54.813366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:55.280850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.326088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:55.358183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.378764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.389385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9a42c7b-f311-4e7f-8fe7-593e909a1b94 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.617011 Aug 30 18:21:55.391541 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1184/2444] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:54 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:55.403155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:55.406580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:55.430511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:55.442022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:55.444386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:55.446540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:55.448291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:55.449305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:55.788956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.803976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.809503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:55.813818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8e14ef58-7cb0-4bb2-9ec5-495b050dafa6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2833 microversion: 2.32 time: 1.256382 Aug 30 18:21:55.815545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1261/2445] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:54 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2833 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:55.825375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:55.826775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:55.852302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:55.857150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:55.857620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:55.858477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:55.865042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:55.866474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.242469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.274676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5da5cd74-14ee-4b79-a9af-663d28684f35 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1466 microversion: 2.1 time: 0.880052 Aug 30 18:21:56.277713 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1185/2446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:55 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1466 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:56.290067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:56.292463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:56.312923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.314205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.315348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.317431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.319757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.321023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.386923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.419054 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1b2487e-fcd7-49c4-a25b-2342c4425646 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1706 microversion: 2.1 time: 0.597415 Aug 30 18:21:56.420932 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1262/2447] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:55 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1706 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:56.430519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:56.431934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:56.444031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.445291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.447844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.449541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.451329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.452553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.532583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.553554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.565427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.576649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e2696806-c53d-4238-9222-b70db8968b8c tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1365 microversion: 2.57 time: 0.295363 Aug 30 18:21:56.580941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1186/2448] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:56 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:56.606190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:56.607064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:56.638469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.639228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.640002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.641377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.642243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.643232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.869288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:56.882709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4b81411-376f-4ee4-b8bf-847d8b373628 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.458726 Aug 30 18:21:56.884398 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1263/2449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:56 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:56.894192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2026167184", "metadata": {"image_type": "test"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:21:56.903562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:56.917075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.920078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.920529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:56.922337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:56.924164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:56.925051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:57.027948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Getting quotas for project ae317cc03c76466188ada89e03fa9e2e. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:21:57.038572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Getting quotas for user 7224d5edb940414686664ef036761d33 and project ae317cc03c76466188ada89e03fa9e2e. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:21:57.480284 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3314cb6c-a60e-4968-b56d-f84da135a35e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "POST /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b/action" status: 202 len: 0 microversion: 2.1 time: 0.592402 Aug 30 18:21:57.492878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1264/2450] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:21:56 2022] POST /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:21:57.520897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:57.524018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:57.580978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:21:57.604483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:57.605562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:57.606401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:57.607722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:57.642081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:57.647166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:57.707761 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ef54524-d5dc-4c4f-b172-7ff65a52d93d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4/os-interface" status: 200 len: 1833 microversion: 2.32 time: 1.124905 Aug 30 18:21:57.708607 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1187/2451] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:21:56 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4/os-interface => generated 1833 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:57.725322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e155d404-6972-4a6f-aaf6-b7c0ed7100ad tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '.version_select at 0x7f4e5632f0d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:57.732886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e155d404-6972-4a6f-aaf6-b7c0ed7100ad tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:57.741151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e155d404-6972-4a6f-aaf6-b7c0ed7100ad tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:57.742377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e155d404-6972-4a6f-aaf6-b7c0ed7100ad tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:57.761885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e155d404-6972-4a6f-aaf6-b7c0ed7100ad tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.040219 Aug 30 18:21:57.770991 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1188/2452] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:21:57 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:57.776540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87128303-ca09-425e-81b0-778f0c9c78b9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56902dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:57.939905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87128303-ca09-425e-81b0-778f0c9c78b9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.167003 Aug 30 18:21:57.945992 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1189/2453] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:21:57 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:57.951291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:57.964800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:57.998962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:57.999362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:57.999815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.000558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.001026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.001461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.290506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.326163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.334633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.342623 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9c7bd9da-0fb5-44ee-a4ee-762fcdc45c70 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1383 microversion: 2.57 time: 0.394862 Aug 30 18:21:58.352062 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1190/2454] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:57 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1383 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:58.375109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:58.377568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:58.407497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.413034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.415061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.420261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.421178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.423361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.750279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.765927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.772818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:58.780408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7564f522-9ec3-40ce-bbdd-94c51df04e41 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.280604 Aug 30 18:21:58.795029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1265/2455] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:57 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:58.804544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:58.805979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:58.829538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.837630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.838946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.840284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.841158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.841939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.893968 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ad5e4367-b780-4fc8-8d4c-a2ea89b6ea30 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1859 microversion: 2.1 time: 0.537075 Aug 30 18:21:58.898680 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1191/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:58 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1859 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:58.942899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:58.943547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:58.960977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.961566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.965797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:58.966988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:58.967507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:58.969560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.454391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:59.464085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62d8df14-1853-42f3-a591-66cb810b32f1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.667051 Aug 30 18:21:59.464970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1266/2457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:58 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:59.469786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d127f431-bda2-447e-a9b2-a7c48a9735ef tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5afc9af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:59.528786 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d127f431-bda2-447e-a9b2-a7c48a9735ef tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.062562 Aug 30 18:21:59.529571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1267/2458] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:21:59 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:59.535435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:59.536288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:59.543763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.544688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.545501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.546569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.547172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.547890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.558517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09c6de2c-7e22-433b-8b9f-2e1623ce5a9f tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1859 microversion: 2.1 time: 0.620541 Aug 30 18:21:59.574155 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1192/2459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:21:58 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1859 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:21:59.657312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:59.658058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:59.667034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.667717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.668225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.669089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.669797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.670417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.719006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:59.730901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:59.733482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:21:59.735037 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87ebf7ae-eda5-43a1-a1bc-51f1afb29cdf tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1371 microversion: 2.57 time: 0.204359 Aug 30 18:21:59.747483 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1268/2460] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:59 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:21:59.782582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lazy-loading 'services' on Instance uuid c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:21:59.832568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:59.835443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:59.847139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.847653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.848098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.848838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.849294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.849719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.919797 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6dc306d-fe1e-4b5f-ae56-06d57a002a00 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments/f4c884ee-721c-4bf2-920b-e6932511e294" status: 202 len: 0 microversion: 2.1 time: 0.266408 Aug 30 18:21:59.920748 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1193/2461] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:21:59 2022] DELETE /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments/f4c884ee-721c-4bf2-920b-e6932511e294 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:21:59.931877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:21:59.936682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:21:59.945128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.945673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.946305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.947151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:21:59.947616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:21:59.948043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:21:59.999936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-683fcb46-8712-4d28-94c5-a46739f93de6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074112 Aug 30 18:22:00.000551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1194/2462] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:21:59 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:00.494167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:00.502250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:00.503387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:00.510587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:00.511443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:00.512101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:00.513059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:00.513778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:00.514504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:00.516853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:00.522494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:00.524780 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17339635-bdac-4883-9bca-419a406b84ff tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.699073 Aug 30 18:22:00.525762 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1269/2463] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:21:59 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:00.560272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a14174a-7028-4924-8eb7-fc81bd091cea tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af879d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:00.639666 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a14174a-7028-4924-8eb7-fc81bd091cea tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.086245 Aug 30 18:22:00.641141 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1270/2464] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:00 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:00.769574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:00.771207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:00.782322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:00.783747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:00.784419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:00.785324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:00.786172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:00.786783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:00.945495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:00.959682 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ef8ab7a7-e589-48fb-b70f-a36f4e41ca20 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.460686 Aug 30 18:22:00.962556 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1195/2465] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:00 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:01.025800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:01.031723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:01.056709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:01.061275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:01.062386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:01.065436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:01.066553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:01.067418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:01.122932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:01.137449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:01.145450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:01.147606 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41d4b688-5cc3-42d1-b1d7-306ee088d921 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1371 microversion: 2.57 time: 0.385713 Aug 30 18:22:01.148983 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1271/2466] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:00 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:01.189031 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ba2343b-2581-43a2-bd89-fb107f455b67 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178184 Aug 30 18:22:01.190809 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1196/2467] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:01 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:22:01.394802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "tag": "a94e2401-6899-4923-9211-c9fb86eac7ef"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:01.410313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:01.423174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:01.424715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:01.447900 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] Creating event network-changed:a94e2401-6899-4923-9211-c9fb86eac7ef for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:22:01.460370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-55c0f687-e05e-4b8b-8fed-1c0a49171579 req-fe0b753e-9462-4b45-9ea2-3961ac16ac9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069288 Aug 30 18:22:01.467663 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1272/2468] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:01.569602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:01.570220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:01.584285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:01.585047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:01.585489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:01.586261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:01.586751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:01.591153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:01.656720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b41ced5-bd83-45ee-8f56-9a3b433404d3 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56c66dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:01.723612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8b41ced5-bd83-45ee-8f56-9a3b433404d3 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.071508 Aug 30 18:22:01.744188 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1273/2469] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:01 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:01.993397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:01.994494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:02.022816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.029815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.031216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.035113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.036576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.039771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.465328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:02.492072 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-14b38a95-2d97-490d-87bf-e290fead3b4a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.502555 Aug 30 18:22:02.509133 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1274/2470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:01 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:02.553915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:02.563890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:02.578091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.578764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.579211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.580788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.581483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.582086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.656705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:02.693165 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f3153d3-e930-4198-b0da-86f4f75bd629 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154821 Aug 30 18:22:02.696633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1275/2471] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:02 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:02.701653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:02.702275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:02.731545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.732065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.732517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.737727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:02.738258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:02.740836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:02.896744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:02.910806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:02.913422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:02.914765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6e28e21-e766-407a-bb54-acec26d83646 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1356 microversion: 2.57 time: 0.217090 Aug 30 18:22:02.915680 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1276/2472] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:02 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:02.920725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eeef540e-aec0-43cb-b83d-9c8e2e0cb4d9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af46700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:03.005745 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eeef540e-aec0-43cb-b83d-9c8e2e0cb4d9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.088941 Aug 30 18:22:03.006846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1277/2473] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:02 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:03.014114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:03.017984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:03.037131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.038231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.039052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:03.040516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.041113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.041486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:03.074855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:22:03.213342 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5745b69f-4031-460f-87e2-26743ea500aa tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 204 len: 0 microversion: 2.57 time: 0.205001 Aug 30 18:22:03.214559 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1278/2474] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:22:03 2022] DELETE /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:22:03.226822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:03.228089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:03.246435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.247203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.248375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:03.249327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.250011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.250599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:03.420630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:03.454774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:03.457994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:03.477002 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9995e9ee-6a6e-48d6-a916-b42bffd38d95 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1362 microversion: 2.57 time: 0.248201 Aug 30 18:22:03.507622 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1279/2475] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:03 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:03.554747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:03.556194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:03.611269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.615947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.616801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:03.618073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:03.618871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:03.619585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:04.213072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:04.243029 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d767d31-04b4-49f6-802c-d783a8238148 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.708424 Aug 30 18:22:04.255011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1280/2476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:03 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:04.269413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:04.275450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:04.283749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:04.285733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:04.287047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:04.288386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:04.289168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:04.290040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:04.396868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:04.415737 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5075dc29-88a0-4305-821d-ca6f812f5be2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153502 Aug 30 18:22:04.417695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1281/2477] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:04 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:04.426288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:04.428861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:04.430804 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0323606b-0d17-473b-8cae-5b2f35a7f7f7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 2.865235 Aug 30 18:22:04.432650 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1197/2478] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:01 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 2868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:04.435662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c1163ab-1e7a-4ad5-b62e-82ab6bbf8e8c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56daa670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:04.509483 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c1163ab-1e7a-4ad5-b62e-82ab6bbf8e8c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.085350 Aug 30 18:22:04.519993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1282/2479] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:04 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:04.535442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:04.537199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:04.582690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:04.584118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:04.587537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:04.590540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:04.594133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:04.597963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.157526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:05.172360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:05.181498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:05.193971 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15ae8a7e-f129-4b0d-89ad-f96c9721659b tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1362 microversion: 2.57 time: 0.663767 Aug 30 18:22:05.195073 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1198/2480] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:04 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1362 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:05.268474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:05.269116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:05.297291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.301365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.305869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.306882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.307514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.308131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.432860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:05.435413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:05.448310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.451371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.453230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.454316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.455927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.458521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.558402 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-798ef65d-ee0b-4b10-8e20-649f6bcedff0 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129973 Aug 30 18:22:05.559471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1199/2481] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:05 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:05.564747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:05.580885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:05.591549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.608516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.610072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.610911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:05.611818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:05.612394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:05.668738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:05.690440 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17cdb1e1-5e8f-46c8-adc2-6422f502917d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.426010 Aug 30 18:22:05.704754 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1283/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:05 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:05.704754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9469a0e-189c-4750-91e2-f77d7ffbd2f9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af37160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:05.847273 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9469a0e-189c-4750-91e2-f77d7ffbd2f9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.154270 Aug 30 18:22:05.849282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1284/2483] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:05 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:06.229023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:06.231297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:06.261411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.263020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.265505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.266440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.270530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.271833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.517081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.579479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.587830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.592509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.593300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa1cce91-b0b3-4569-ac61-f19df52084fd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.031514 Aug 30 18:22:06.606104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1200/2484] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:05 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:06.619688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.621605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:06.623013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4116cfef-24ea-438f-8216-298e36e161db tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1362 microversion: 2.57 time: 0.402670 Aug 30 18:22:06.624951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:06.626141 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1285/2485] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:06 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:06.629030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:06.638055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.639262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.639877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.640805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.641514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.642219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.696900 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8d8f765-0ee8-448e-bb56-7e5749074a5b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084981 Aug 30 18:22:06.703346 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1201/2486] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:06 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:06.733941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:06.734708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:06.764415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.768887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.769600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.772733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:06.776106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:06.776931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:06.884432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-064b372a-031b-4eaa-bf88-60f39702c4e7 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56902550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:07.032331 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-064b372a-031b-4eaa-bf88-60f39702c4e7 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.170476 Aug 30 18:22:07.033959 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1202/2487] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:06 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:07.049393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-plugged", "status": "completed", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:07.135655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.136546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.139909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.198338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] Creating event network-vif-plugged:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:22:07.220544 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-37fba343-2196-4b2c-b37e-8887a4758d48 req-061a252e-d579-4792-906a-99ee7bae40ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184225 Aug 30 18:22:07.227352 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1203/2488] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:07.466205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:07.492294 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-218ea863-62e3-4ee0-9e47-d595012f2f18 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1512 microversion: 2.1 time: 0.766356 Aug 30 18:22:07.502658 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1286/2489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:06 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1512 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:07.626845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:07.628719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:07.644098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.645255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.647878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.654839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:07.655714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:07.663511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.667797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.672529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.682209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.687238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.693825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.700236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.701747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.704190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.767119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:07.838675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:07.844259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:07.845229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:07.869290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lazy-loading 'fault' on Instance uuid 31acdb40-7756-4423-9a4e-0373f4c039ed {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:22:08.085451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:08.137742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:08.143840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62db45530a6b46fda9a1a7579d95544c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7a1e1e4b6ae498ab303c7ace47531bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:08.147264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f64abf1e-6e6d-4971-aeec-47d069c6f17e tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 200 len: 1367 microversion: 2.57 time: 0.497007 Aug 30 18:22:08.150688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1287/2490] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:07 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:08.179762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:08.195361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:08.217624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:08.219938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:08.221268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:08.223369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:08.225717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:08.226791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:08.373637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-090155d1-6164-439c-afe2-d18928487b70 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209841 Aug 30 18:22:08.383836 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1288/2491] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:08 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:08.402321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b72da3cb-f734-4880-aa55-df94dcf0d091 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aee5280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:08.517793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b72da3cb-f734-4880-aa55-df94dcf0d091 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.130237 Aug 30 18:22:08.518568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1289/2492] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:08 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:08.533052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:08.533690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:08.574027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:08.574563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:08.575033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:08.575850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:08.576314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:08.587866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:08.989158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:09.011659 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a02bbdd7-8acd-4b04-a594-212805efae5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1489 microversion: 2.1 time: 0.491791 Aug 30 18:22:09.016979 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1290/2493] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:08 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:09.042006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:09.043236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:09.062944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.076479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.077861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.079610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.081179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.082338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.098972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:09.117868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:09.124301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:09.127679 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f8b97ef-63ea-4a85-a73f-a554b735e666 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.505164 Aug 30 18:22:09.131662 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1204/2494] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:07 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:09.194913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:09.195874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] [instance: 31acdb40-7756-4423-9a4e-0373f4c039ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:09.196044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:22:09.213607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.218387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.219140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.221684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.224650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.225409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.272743 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] HTTP exception thrown: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Request method failure captured: Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed HTTP/1.1 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlUdMVfiBN8G3LgpoSokKIZaj1ON3ztPDOo9PkSwiD9hU9eYg7Pe2h2G3-8J2NoUoVeomLfB2wTCCqDOyHefUxAnB_37V3uggbX8jWcVBV6v57LLnnmzks5c8tW6m6eJPUX1akLIgD1QV11kw_ch1u0NGkbSjh2VbEr_Ui205IHXyqA Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.57 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e7a1e1e4b6ae498ab303c7ace47531bc Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerShowV257Test-1352412382 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e7a1e1e4b6ae498ab303c7ace47531bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e7a1e1e4b6ae498ab303c7ace47531bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e7a1e1e4b6ae498ab303c7ace47531bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e7a1e1e4b6ae498ab303c7ace47531bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerShowV257Test-1352412382 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e7a1e1e4b6ae498ab303c7ace47531bc Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerShowV257Test-1352412382 Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerShowV257Test-1352412382-project Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 62db45530a6b46fda9a1a7579d95544c Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerShowV257Test-1352412382-project Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '31acdb40-7756-4423-9a4e-0373f4c039ed'} Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:09.282394 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. Aug 30 18:22:09.287912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:22:09.295575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] Returning 404 to user: Instance 31acdb40-7756-4423-9a4e-0373f4c039ed could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:09.305412 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-26a6084e-a1f3-4604-9529-c56bd2e3e2b6 tempest-ServerShowV257Test-1352412382 tempest-ServerShowV257Test-1352412382-project] 10.222.0.25 "GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed" status: 404 len: 111 microversion: 2.57 time: 0.108307 Aug 30 18:22:09.306698 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1205/2495] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:09 2022] GET /compute/v2.1/servers/31acdb40-7756-4423-9a4e-0373f4c039ed => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:22:09.369416 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dc543e36-c2af-4d74-a3f4-a05156ebc26c tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 204 len: 0 microversion: 2.1 time: 0.332843 Aug 30 18:22:09.373529 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1291/2496] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:22:09 2022] DELETE /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:22:09.386791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:09.388872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:09.395268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:09.405339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:09.411029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.414567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.415160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.417152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.418551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.420708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.421698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.422216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.422694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.423434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:09.435855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:09.436695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:09.453660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:09.666149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e331ab2-39eb-49a7-8ea1-c9dcd07b3d5c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.279132 Aug 30 18:22:09.667162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1292/2497] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:09 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:09.678595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fac73eac-c477-45c3-86b2-696ef412c7dd tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56cc8a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:09.804075 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fac73eac-c477-45c3-86b2-696ef412c7dd tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.135792 Aug 30 18:22:09.804935 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1293/2498] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:09 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:10.157344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:10.159400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:10.180387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:10.180962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:10.181529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:10.182553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:10.182805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:10.183236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:10.248328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:10.270540 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1053996f-443f-4e41-b6f4-5e8b38269204 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1495 microversion: 2.1 time: 0.888302 Aug 30 18:22:10.271526 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1206/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:09 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1495 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:10.664510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:10.676926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:10.682846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:10.685251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:10.701387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:10.702673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23766c16-f823-496d-b4ab-17a4f36d9ac6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.549424 Aug 30 18:22:10.705019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:10.705797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:10.708020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:10.708870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:10.709355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:10.709805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:10.710089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1294/2500] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:10 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:10.794050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-acd11f31-3a64-4ddd-baf2-07ee5b922b1b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114658 Aug 30 18:22:10.796717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1207/2501] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:10 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:10.820525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9cae275a-e47f-4c25-a5f1-5703507431a2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aee58b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:10.987530 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9cae275a-e47f-4c25-a5f1-5703507431a2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.171411 Aug 30 18:22:10.998062 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1295/2502] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:10 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:11.295026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:11.296319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:11.320327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:11.322237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:11.323415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:11.327648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:11.331065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:11.331854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:11.732232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:11.733958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:11.769136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:11.770189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:11.771257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:11.772758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:11.777980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:11.778952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:12.177050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:12.195486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:12.215389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:12.216909 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bba80f8d-7d44-4245-94be-42f5dde2f6f2 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.490884 Aug 30 18:22:12.217587 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1296/2503] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:11 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:12.252893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:12.264544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:12.290211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:12.299414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:12.300596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:12.302177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:12.303364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:12.304556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:12.392684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:12.393730 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66943637-4af5-4b3f-82ac-d10f3abff79c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167640 Aug 30 18:22:12.395285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1297/2504] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:12 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:12.407320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-876e10f9-3b0c-476b-81f2-d5bb9712433d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af46d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:12.437740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d5be6af2-dad6-4615-b3df-31a079e2da29 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1495 microversion: 2.1 time: 1.147978 Aug 30 18:22:12.440643 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1208/2505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:11 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1495 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:12.521129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-876e10f9-3b0c-476b-81f2-d5bb9712433d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.121015 Aug 30 18:22:12.527993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1298/2506] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:12 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:13.243875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:13.245586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:13.259780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.264525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.265501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.266545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.267268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.267872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.796487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:13.834033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:13.837789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:13.842066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-314056e2-44b8-46e9-b1f4-57b34d55f414 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.603498 Aug 30 18:22:13.847027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1299/2507] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:13 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:13.868349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:13.873731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:13.919091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.922128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.923629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.928222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:13.938736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:13.942242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:13.971879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cce1e783-56da-4bd2-9039-c174d1a84c8c tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] Calling method '.version_select at 0x7f4e5af0a280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.043441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b956dbd-66dc-46a2-84ca-34cb48363ac8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195177 Aug 30 18:22:14.054149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1300/2508] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:22:13 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:22:14.066884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.067674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:14.084579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.085573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.086209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.087409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.089327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.090644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.128201 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cce1e783-56da-4bd2-9039-c174d1a84c8c tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486/defaults" status: 200 len: 371 microversion: 2.1 time: 0.916311 Aug 30 18:22:14.128786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1209/2509] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:22:13 2022] GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486/defaults => generated 371 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:14.136089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-729d6944-12a1-499a-9820-d07f5545e11e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af0a700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.148912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.149811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.150550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.151390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lazy-loading 'fault' on Instance uuid 542726f6-d659-4063-922f-955036c45de2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:22:14.244260 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-729d6944-12a1-499a-9820-d07f5545e11e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.112450 Aug 30 18:22:14.246918 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1210/2510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:14 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:14.254307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542726f6-d659-4063-922f-955036c45de2", "name": "network-vif-deleted", "tag": "3346d604-66c3-4a84-89c0-02d0abef5cea"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:14.287940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.289233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.292884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.342885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] Creating event network-vif-deleted:3346d604-66c3-4a84-89c0-02d0abef5cea for instance 542726f6-d659-4063-922f-955036c45de2 on n-h2-854119-10 Aug 30 18:22:14.358389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:14.359741 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1edae44a-3b77-446d-a572-229d4b5423d0 req-95e722f7-2bae-40b2-9d1f-bc945e122aa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109143 Aug 30 18:22:14.366606 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1211/2511] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:14.394250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-432b688e-7968-441d-aa2b-a8e8b8680580 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 200 len: 1304 microversion: 2.1 time: 0.334086 Aug 30 18:22:14.395871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ba55e0c-68e2-41fb-b412-e8da30ab1681 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] Calling method '.version_select at 0x7f4e5af0aee0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.416643 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1301/2512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:14 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 1304 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:14.887908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:14.888929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:14.932616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.933361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.939745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:14.943194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:14.947715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:14.948176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:15.129849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ba55e0c-68e2-41fb-b412-e8da30ab1681 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486" status: 200 len: 371 microversion: 2.1 time: 0.761145 Aug 30 18:22:15.130856 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1212/2513] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:22:14 2022] GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486 => generated 371 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:15.157196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-442e2452-b1e1-4386-8449-46f73fd7dca0 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] Calling method '.version_select at 0x7f4e569021f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:15.520640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:15.543963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:15.546594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:15.549043 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00594218-a386-434d-bd62-6d3e27e7f7db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.669383 Aug 30 18:22:15.549655 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1302/2514] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:14 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:15.574649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-729b5e22-9c7a-4799-a3c1-f82d35871bf5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af0f5e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:15.740278 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-729b5e22-9c7a-4799-a3c1-f82d35871bf5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1422 microversion: 2.1 time: 0.187765 Aug 30 18:22:15.741544 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1303/2515] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:15 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1422 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:15.743383 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-442e2452-b1e1-4386-8449-46f73fd7dca0 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486/defaults" status: 200 len: 371 microversion: 2.1 time: 0.594125 Aug 30 18:22:15.750418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1213/2516] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:22:15 2022] GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486/defaults => generated 371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:15.757930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:15.758616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:15.774008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d45b363-02b1-4c0a-8b74-9ca4ae990071 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] Calling method '.version_select at 0x7f4e56408040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:15.784623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:15.785146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:15.789003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:15.792269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:15.792812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:15.793221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:15.850194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 HTTP/1.1 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '542726f6-d659-4063-922f-955036c45de2'} Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:15.855433 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:15.859901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f04cc72-be88-45b7-8ed8-5f71b3087723 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 404 len: 111 microversion: 2.1 time: 0.115364 Aug 30 18:22:15.863181 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1304/2517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:15 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:22:16.389918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-429628336", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b902639-0e62-4f52-91d9-d52d5b52e60b"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:16.528897 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d45b363-02b1-4c0a-8b74-9ca4ae990071 tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486" status: 200 len: 371 microversion: 2.1 time: 0.766058 Aug 30 18:22:16.534411 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1214/2518] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:22:15 2022] GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486 => generated 371 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:16.549411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3b504df-9305-472d-8df1-9fad566d86bd tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] Calling method '.version_select at 0x7f4e567faa60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:17.211322 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3b504df-9305-472d-8df1-9fad566d86bd tempest-QuotasTestJSON-1055324507 tempest-QuotasTestJSON-1055324507-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486?user_id=a3f6bc3900b34457a6756b81fb65c143" status: 200 len: 371 microversion: 2.1 time: 0.665633 Aug 30 18:22:17.212231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1215/2519] 10.222.0.25 () {58 vars in 1323 bytes} [Tue Aug 30 18:22:16 2022] GET /compute/v2.1/os-quota-sets/c55f6161ddfd4ca1ad43f3cf4f3bc486?user_id=a3f6bc3900b34457a6756b81fb65c143 => generated 371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:17.236770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:17.238133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:17.250450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:17.251312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:17.252124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:17.253095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:17.253916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:17.255607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:17.946956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:18.012561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:18.022393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:18.027508 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-917e2361-355a-4b95-9ec6-664487366b99 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.800399 Aug 30 18:22:18.031990 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1216/2520] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:17 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:18.044775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b8aed04-6dab-41a9-8c1b-55dbf7363d46 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5679f550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:25.807002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=51 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:26.419639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:26.581005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] validate_networks() for [('5b902639-0e62-4f52-91d9-d52d5b52e60b', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:22:26.719241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4b8aed04-6dab-41a9-8c1b-55dbf7363d46 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1431 microversion: 2.1 time: 8.679710 Aug 30 18:22:26.729089 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1217/2521] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:18 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1431 bytes in 8696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:26.736721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:26.737270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:26.746743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=86 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:26.759542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:26.760546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:26.761411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:26.763027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:26.764007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:26.764887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:27.183106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:27.483754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:27.513639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:27.517366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:27.522230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9cfbf603-24e9-4ab1-8048-e2a50d568ef1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.791438 Aug 30 18:22:27.523690 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1218/2522] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:26 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:28.375150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:22:28.376971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:22:28.378560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:22:28.378985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:22:28.379472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:22:28.389049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1622578639", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:28.400331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:28.401078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:28.401663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:28.402834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:28.403490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:28.404104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:28.427863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:28.434773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Getting quotas for user 6168ec13101341179054854df2758adf and project 0d739a2c84ad4367be699400b15d37b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:28.452294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:22:28.455975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:22:28.555503 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48978fe3-989c-460a-9e37-4b35543be6cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.170089 Aug 30 18:22:28.557207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1305/2523] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 12173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:22:28.588233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:22:28.895019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3fa5add-da31-4fff-8e7c-8f11d7297a8d tempest-ComputeTenantNetworksTest-1583209664 tempest-ComputeTenantNetworksTest-1583209664-project] Calling method '.version_select at 0x7f4e5aee5a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:29.560580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3fa5add-da31-4fff-8e7c-8f11d7297a8d tempest-ComputeTenantNetworksTest-1583209664 tempest-ComputeTenantNetworksTest-1583209664-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.000662 Aug 30 18:22:29.562539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1306/2524] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:22:28 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:29.567571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0085e5a-9b6f-45ba-819d-f921fa21a83f tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af8ad30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:29.583328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:22:29.584196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:22:29.584364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:22:29.584879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:22:29.585384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:22:29.602175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:29.603040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:29.603691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:29.605158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:29.608388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:29.609471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:29.637039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:22:29.644025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:22:29.663205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:22:29.666073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:22:29.689194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0085e5a-9b6f-45ba-819d-f921fa21a83f tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 200 len: 1431 microversion: 2.1 time: 0.120989 Aug 30 18:22:29.693020 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1307/2525] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:29 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 1431 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:29.715217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f1f600c-a806-4661-aede-1473fb0351b0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:29.715878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f1f600c-a806-4661-aede-1473fb0351b0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:29.744936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a555969b-6f55-4f94-8d20-5cb6f9cdb4f6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.200455 Aug 30 18:22:29.751646 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1219/2526] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:22:29.772515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:29.774025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:29.815179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:29.816419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:29.821529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:29.823113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:29.824277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:29.827711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:29.947422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f1f600c-a806-4661-aede-1473fb0351b0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:29.968457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f1f600c-a806-4661-aede-1473fb0351b0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1214 microversion: 2.1 time: 0.273835 Aug 30 18:22:29.969057 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1308/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:29 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:29.974018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-749c0a7e-139b-4017-a4cb-5eaf8d356568 tempest-ComputeTenantNetworksTest-1583209664 tempest-ComputeTenantNetworksTest-1583209664-project] Calling method '.version_select at 0x7f4e5aeb68b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:30.176330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-749c0a7e-139b-4017-a4cb-5eaf8d356568 tempest-ComputeTenantNetworksTest-1583209664 tempest-ComputeTenantNetworksTest-1583209664-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/602c3323-0284-43a2-9b2a-b9c15f5c5bd6" status: 200 len: 140 microversion: 2.1 time: 0.205166 Aug 30 18:22:30.177431 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1309/2528] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 18:22:29 2022] GET /compute/v2.1/os-tenant-networks/602c3323-0284-43a2-9b2a-b9c15f5c5bd6 => generated 140 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:30.187261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:30.188167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:30.222298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:30.225032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:30.226725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:30.229949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:30.230686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:30.232288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:30.388338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:30.419852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:30.432654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:30.438754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7cb1ef8b-da0d-46ad-8093-6eb4c5d184e3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.676886 Aug 30 18:22:30.447504 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1220/2529] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:29 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:30.469804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2f8e8d9-c1ac-429d-91b1-1e55ea900cf0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:30.470721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2f8e8d9-c1ac-429d-91b1-1e55ea900cf0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:30.673398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2f8e8d9-c1ac-429d-91b1-1e55ea900cf0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:30.697903 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2f8e8d9-c1ac-429d-91b1-1e55ea900cf0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1213 microversion: 2.1 time: 0.233224 Aug 30 18:22:30.707341 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1221/2530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:30 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:31.002811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:31.008384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:31.054944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.058693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.060857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:31.065142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.066133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.070146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:31.322189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:31.382517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6082b7f-46ef-44d0-9c3b-f70117f9c7cd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1266 microversion: 2.1 time: 0.386313 Aug 30 18:22:31.384883 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1222/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:30 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:31.446799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:31.462559 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8e55a0cf-8221-44e8-a72e-8c45933d324d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1466 microversion: 2.1 time: 1.282485 Aug 30 18:22:31.463412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1310/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:30 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1466 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:31.473493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:31.474451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:31.509904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.510886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.519748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:31.521168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.527156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.527761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:31.530215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3c5a5a2-d219-41e1-8551-d62f53ab4e3c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af8a1f0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:31.739142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3c5a5a2-d219-41e1-8551-d62f53ab4e3c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292" status: 200 len: 784 microversion: 2.1 time: 0.207039 Aug 30 18:22:31.739142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1311/2533] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:31 2022] GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292 => generated 784 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:31.758263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:31.759316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:31.804679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.806702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.807865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:31.808798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:31.809497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:31.810097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:32.152104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:32.192789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-629c7b5c-cc84-4413-90f3-53cf82bb1e20 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1209 microversion: 2.1 time: 0.463772 Aug 30 18:22:32.201308 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1312/2534] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:31 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1209 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:32.235166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41e43ea7-0779-47b1-92fa-c9a71ee9c9e0 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:32.273597 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41e43ea7-0779-47b1-92fa-c9a71ee9c9e0 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.069898 Aug 30 18:22:32.285851 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1313/2535] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:22:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:32.304393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d52db88b-7c2c-4101-9368-20dfd1eca18d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec03a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:32.591713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:32.644564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:32.651152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:32.662273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc67f9b7-e977-46d3-a5d2-37f7ed29d8d8 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.187695 Aug 30 18:22:32.668564 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1223/2536] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:31 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:32.733995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:32.743343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:32.789304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:32.791897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:32.795942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:32.800436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:32.801132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:32.803812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:32.994177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:33.009341 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d833682a-99a8-4e88-b6d2-1d113df7f9bf tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1272 microversion: 2.1 time: 0.338798 Aug 30 18:22:33.010233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1224/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:32 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:33.023947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "f44263b0-4a1b-4c47-ae87-11c454d595aa"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:33.051720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:33.056515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:33.057365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:33.099868 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] Creating event network-vif-plugged:f44263b0-4a1b-4c47-ae87-11c454d595aa for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:33.114394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c5d73fde-0a2a-416a-b290-e80d4354879f req-e6aa0415-542a-42cc-9b2b-44420e454287 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098749 Aug 30 18:22:33.119111 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1225/2538] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:33.237526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:33.238975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:33.302113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:33.307142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:33.307142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:33.311818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:33.322788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:33.322788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:33.752289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:33.807635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2917672-a5dd-484f-94ba-2c8f75593aee tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1265 microversion: 2.1 time: 0.570907 Aug 30 18:22:33.813375 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1226/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:33 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1265 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:33.842709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:33.844279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:33.879922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:33.881663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:33.883686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:33.889673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:33.890932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:33.893736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.122797 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d52db88b-7c2c-4101-9368-20dfd1eca18d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "DELETE /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 204 len: 0 microversion: 2.1 time: 2.821982 Aug 30 18:22:35.123812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1314/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:32 2022] DELETE /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 0 bytes in 2824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:22:35.130432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:35.136509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:35.166089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.168382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.170500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.174245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.174845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.175292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.386863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.409537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.411554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.412800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e85edb4-f67b-448f-bcec-9f484e6ba4d1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.598027 Aug 30 18:22:35.417700 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1227/2541] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:33 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:35.435372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:35.440500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:35.455151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.456827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.457516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.458723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.459546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.460205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.725927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.742398 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fec2cbd0-fd4b-4ab5-b177-4d1ae60c5c5a tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.617238 Aug 30 18:22:35.743519 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1315/2542] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:35 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:35.761162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb0e925b-decd-4d77-bd78-c25b9464e233 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af878b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:35.810550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:35.813865 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fb0e925b-decd-4d77-bd78-c25b9464e233 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] HTTP exception thrown: Image not found. Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb0e925b-decd-4d77-bd78-c25b9464e233 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Request method failure captured: Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c HTTP/1.1 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlUsmvomcMusjdfR-NfSmk9kPEA73vyFjOy1S6lgT_gxNDbN_lwqENZpFMXwRx9Q0NinNu--FhwwjgqDXOZa_UfGDgNWTuaWi5fY4eCvw53wuBTxfw1oMMjuQz5_Dd0gLed3Xt9whqn-UZuKsXSBdaHiYo2YQZB5w8M_-8W0WOw6mgo Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7224d5edb940414686664ef036761d33 Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: exception: Image not found. Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '26c00767-5b7d-48b5-ab63-b60630ff885c'} Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 26c00767-5b7d-48b5-ab63-b60630ff885c Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 18:22:35.816841 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26c00767-5b7d-48b5-ab63-b60630ff885c could not be found. Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:35.823017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb0e925b-decd-4d77-bd78-c25b9464e233 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Returning 404 to user: Image not found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:35.844269 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb0e925b-decd-4d77-bd78-c25b9464e233 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 404 len: 62 microversion: 2.1 time: 0.077542 Aug 30 18:22:35.844269 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1316/2543] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:35 2022] GET /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:22:35.844556 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b3363d1f-db6a-4c02-90f5-f18cdc6871a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1271 microversion: 2.1 time: 0.415634 Aug 30 18:22:35.844858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "5a150048-908c-4d8d-a180-1280d4dcfa98"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "c7b9917f-c612-494f-bb46-629acf69b6c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:35.859902 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1228/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:35 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1271 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:35.888792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.889849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.891037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.898291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1452255209"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:35.903572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:35.932587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Creating event network-vif-plugged:5a150048-908c-4d8d-a180-1280d4dcfa98 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:35.938048 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] Creating event network-vif-plugged:c7b9917f-c612-494f-bb46-629acf69b6c1 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:35.955007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8a534441-8304-4c93-acef-f1a3574b336b req-77a0633c-9be6-4a3e-b150-f80541ec0e7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121072 Aug 30 18:22:35.956519 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1317/2545] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:35.965713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.966661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.975595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:35.976850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:35.984741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:35.985947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:36.477658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:36.478845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:36.515366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:36.522626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:36.523276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:36.525450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:36.528056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:36.528667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:36.716026 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f4e3b51f-6994-489e-ab4f-235bbb888a85 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "POST /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b/action" status: 202 len: 0 microversion: 2.1 time: 0.855334 Aug 30 18:22:36.720011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1229/2546] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:35 2022] POST /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:22:36.751828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5891da4f-0a6e-47f0-b66e-142566b9647e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56902f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:36.891555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5891da4f-0a6e-47f0-b66e-142566b9647e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.163116 Aug 30 18:22:36.907161 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1230/2547] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:36 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:36.919070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:36.920781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:36.937776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:36.939588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:36.940953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:36.942639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:36.943758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:36.945176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:36.990663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:37.398816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:37.420372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:37.425724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:37.426916 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e7ff3714-7e38-480c-be09-a0c3ae612647 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.977087 Aug 30 18:22:37.437125 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1318/2548] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:36 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:37.443505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:37.446294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:37.459731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:37.461383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:37.462909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:37.463956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:37.466717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:37.467514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:37.734865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:37.763409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a7333fd7-8f8a-47d0-b577-547a1cec9290 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.853577 Aug 30 18:22:37.783502 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1231/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:36 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:37.920792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c88cded-17ed-4d98-8be7-cf6b09a71bd2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56785040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:38.070387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c88cded-17ed-4d98-8be7-cf6b09a71bd2 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.159063 Aug 30 18:22:38.076035 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1232/2550] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:37 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:38.090100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "fd88dabe-1e40-497a-a17d-cef59e4a5d84"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "f7d4c69b-23a6-45aa-8df6-3532cb2bdd55"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:38.137209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.137651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.138159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:38.161657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Creating event network-vif-plugged:fd88dabe-1e40-497a-a17d-cef59e4a5d84 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:38.162181 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] Creating event network-vif-plugged:f7d4c69b-23a6-45aa-8df6-3532cb2bdd55 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:38.172159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-acab3a6d-924c-46cd-9ae6-69792b7e6133 req-f2f5654d-6648-4f6f-a4f3-bad7e7e5d13e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086361 Aug 30 18:22:38.178832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1233/2551] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:38.312943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:38.340859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58759beb-0bd7-4662-9d62-278af114d3f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.897256 Aug 30 18:22:38.343243 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1319/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:37 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:38.469845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:38.471027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:38.497262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.501677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.502421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:38.504343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.505051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.507071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:38.596415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c07cc5-284a-4301-b10e-91eb8d530aa7", "tag": "a39ca209-eee1-4526-bce2-c061e0b18ee3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:38.609899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:38.644828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.648281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.651095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:38.688987 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] Creating event network-changed:a39ca209-eee1-4526-bce2-c061e0b18ee3 for instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 on n-h2-854119-10 Aug 30 18:22:38.698914 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2b049242-5227-4695-bc19-cf04b9552fa5 req-1b140ce5-2ebd-4f68-a017-b877eb2a007d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104342 Aug 30 18:22:38.701811 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1320/2553] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:38.809970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:38.811300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:38.820351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.821275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.821930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:38.822921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:38.823597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:38.824611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:39.313184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.340668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.346907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.352737 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76e73fc3-f807-4bdf-b80c-4a6372586c6f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.888368 Aug 30 18:22:39.353842 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1234/2554] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:38 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:39.365518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9c15d261-15d2-41a6-bb62-8a40239ee7c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e568e6af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:39.435659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9c15d261-15d2-41a6-bb62-8a40239ee7c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.076694 Aug 30 18:22:39.437834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1235/2555] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:39 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:39.466992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:39.468250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:39.483537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:39.484475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:39.485063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:39.491653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:39.492993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:39.493938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:39.625480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:39.718074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.727404 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d57de0dd-0607-4202-a014-5824e6f8dabe tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.923462 Aug 30 18:22:39.738231 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1321/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:38 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:39.943427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:39.964386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:39.972738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:39.976838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66d7ec33-5c24-48a5-833a-22887b25a7bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.536808 Aug 30 18:22:39.994996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1236/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:39 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:40.001283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.003069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.003738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.028818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] Creating event network-changed:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h2-854119-10 Aug 30 18:22:40.065513 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9c353d1b-d9af-4b22-b6ef-fadaccca62c1 req-919e945b-7685-4523-8396-6f4e00b3e010 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125525 Aug 30 18:22:40.067655 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1322/2558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:40.211670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "7e6900a7-e5fc-4080-bc85-941d55b2029a"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-plugged", "status": "completed", "tag": "07686b3e-76c6-440a-bf29-7d62ba1c4f20"}, {"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-unplugged", "status": "completed", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:40.231156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.231951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.233040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.257241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Creating event network-vif-plugged:7e6900a7-e5fc-4080-bc85-941d55b2029a for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:40.257739 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Creating event network-vif-plugged:07686b3e-76c6-440a-bf29-7d62ba1c4f20 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:40.258601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] Creating event network-vif-unplugged:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:22:40.266679 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e772d76f-3b5c-46a2-bb9f-78f4dc0e9015 req-585a173d-20df-45c6-930b-0f69e71f49df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.062218 Aug 30 18:22:40.267451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1237/2559] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:40.421031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:40.422188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:40.433858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.434533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.435067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.435815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.436351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.436779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.459063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1ba3d0e-db66-4030-b915-34bfb8628a39 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56785550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:40.534905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1ba3d0e-db66-4030-b915-34bfb8628a39 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.085116 Aug 30 18:22:40.536611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1238/2560] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:40 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:40.757517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:40.759104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:40.762858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:40.774432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:40.784842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.786538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.787288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.789846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:40.791128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:40.792454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:40.792930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:40.793567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:40.795126 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80c3a8c1-3c7b-42b7-9ad3-b6f17d173643 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.380838 Aug 30 18:22:40.796025 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1323/2561] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:40 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:41.005543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:41.006563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:41.020795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.021290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.024592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.026461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.027175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.027569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.119090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:41.133410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95fcf4fb-f7b3-4140-bef5-754ce43ee974 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.380978 Aug 30 18:22:41.154810 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1239/2562] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:40 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:41.556039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-358dc136-186c-4cac-aef8-afea7b0d949c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aeb09d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:41.652841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:41.664546 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-069c9eeb-5dd0-4889-9553-ae832797917c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.665384 Aug 30 18:22:41.666892 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1324/2563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:40 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:41.684093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-358dc136-186c-4cac-aef8-afea7b0d949c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.136772 Aug 30 18:22:41.692483 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1240/2564] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:41 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:41.824225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:41.824942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:41.848458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.848814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.849252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:41.849992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:41.850855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:41.850980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.166740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:42.167861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:42.205922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.208077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.209161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.210755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.212705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.213885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.436063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:42.466611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:42.476270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:42.488147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd97b267-5cd3-4354-a6b3-d46333c28db7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 0.664046 Aug 30 18:22:42.489326 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1325/2565] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:41 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:22:42.689410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:42.690270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:42.694208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:42.710829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.714267 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d4a24cb-94ef-4685-801d-cc7c199ef7d0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.559472 Aug 30 18:22:42.715211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.730998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.732149 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1241/2566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:42 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:42.737767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4376fb2-ed89-4d1a-a07d-8bc179df243e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aeb08b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:42.739265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:42.740082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:42.740821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:42.926610 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4376fb2-ed89-4d1a-a07d-8bc179df243e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.192808 Aug 30 18:22:42.935196 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1242/2567] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:42 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:43.165874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:43.181786 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c22fd6e0-9c8a-4ee1-8193-3300e278bd0f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.496053 Aug 30 18:22:43.199016 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1326/2568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:42 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:43.533860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:43.534534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:43.546643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.547149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.547591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.548667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.564025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.567674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.624789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-plugged", "status": "completed", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:43.645134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.645638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.646080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.683204 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] Creating event network-vif-plugged:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:22:43.698568 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-10c33adb-8ee2-47a1-8f86-6591d3391ade req-2babff9c-b198-4b9a-b364-d71ea3eee919 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078339 Aug 30 18:22:43.700452 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1327/2569] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:43.742054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:43.743731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:43.755588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.756322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.757715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:43.758810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:43.759871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:43.760970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:44.122327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.153410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1345ccd5-065f-41f7-a106-06ff17549674 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.419823 Aug 30 18:22:44.156086 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1328/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:43 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:44.181068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9428831-ebc0-4574-ae76-75fbd833155d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af37430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:44.295553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9428831-ebc0-4574-ae76-75fbd833155d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.135110 Aug 30 18:22:44.296739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1329/2571] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:44 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:44.319713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:44.320968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:44.357738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:44.359569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:44.361079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:44.363938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:44.365380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:44.366678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:44.859966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.884769 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8e38c2e-8e7c-4fc4-9166-a5b4c9b05412 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.582890 Aug 30 18:22:44.888589 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1330/2572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:44 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:44.924841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:44.926579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:44.935870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.941683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:44.943248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:44.944291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:44.946335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:44.947964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:44.949065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:44.955447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.957571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:44.959136 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9fd4632b-5b48-499f-b823-3f47738aae32 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1874 microversion: 2.42 time: 1.429547 Aug 30 18:22:44.976617 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1243/2573] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:43 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1874 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:45.186782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:45.187788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:45.201442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.202589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.203390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.204857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.205715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.206376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.273960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:45.292145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:45.296311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:45.298128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbfe6c6f-97ff-452e-be0a-45af7e3d27d9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2951 microversion: 2.32 time: 0.381001 Aug 30 18:22:45.300469 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1331/2574] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:44 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2951 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:45.333431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a907b1ff-9ea7-49f1-9f8f-9c0ed9d0144d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af879d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:45.489603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a907b1ff-9ea7-49f1-9f8f-9c0ed9d0144d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.178420 Aug 30 18:22:45.491212 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1332/2575] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:45 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:45.503341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:45.505062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:45.518240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.520157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.521625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.523902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:45.525257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:45.526284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:45.864670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:45.951357 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-efc57e44-9365-47d9-9ab3-ea664b2f2df0 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.458259 Aug 30 18:22:45.954858 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1333/2576] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:22:45 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4/os-interface => generated 1833 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:45.969153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-accd5796-486a-4fa0-a459-5972a6d85494 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.789053 Aug 30 18:22:45.975858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:45.980596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:46.007127 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1244/2577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:45 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:46.009159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.010919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.011441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.016284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.016895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.017581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.049413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c07cc5-284a-4301-b10e-91eb8d530aa7", "name": "network-vif-plugged", "status": "completed", "tag": "a39ca209-eee1-4526-bce2-c061e0b18ee3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:46.117327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.118208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.121658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.146837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] Creating event network-vif-plugged:a39ca209-eee1-4526-bce2-c061e0b18ee3 for instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 on n-h2-854119-10 Aug 30 18:22:46.159706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1a80b9aa-eb09-47cc-b8ca-c08badbdf96d req-95f4ac90-00bc-489f-9193-6c25538b07cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148295 Aug 30 18:22:46.161768 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1245/2578] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:46.173719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:46.179469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:46.191876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.192765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.193393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.194424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.195077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.195681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.476361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:46.494749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce64de1a-792d-42a8-9d41-042e89806efa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.537655 Aug 30 18:22:46.495382 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1334/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:45 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:46.522826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af959c94-966d-4838-93db-f90badc70f0b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af46820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:46.694300 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af959c94-966d-4838-93db-f90badc70f0b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.185285 Aug 30 18:22:46.705298 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1335/2580] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:46 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:46.799426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:46.816200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:46.818644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:46.820615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b91b2b3-347c-454b-a8bb-d3862923da82 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2832 microversion: 2.42 time: 0.652466 Aug 30 18:22:46.822019 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1246/2581] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:22:46 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2832 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:46.856597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:46.857205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:46.875056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.875224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.876056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.877541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:46.878234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:46.880230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:46.889785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:47.050175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:47.050925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:47.084274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.084802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.085237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.085989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.086506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.101431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.293970 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c055a08-dd4e-4ee2-a208-f050348260b6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.441299 Aug 30 18:22:47.296151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1336/2582] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:22:46 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90/os-interface => generated 1831 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:22:47.543196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:47.544532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:47.577451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.578115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.580338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.581275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:47.583795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:47.592633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:47.688277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:47.700716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-645f214f-8551-4056-84c2-4d6ffc118cc0 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1314 microversion: 2.1 time: 0.665953 Aug 30 18:22:47.702094 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1247/2583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:47 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:47.718918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db2a4bfd-7755-450d-801e-7339d6a6c28e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aecad30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:47.855212 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db2a4bfd-7755-450d-801e-7339d6a6c28e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.140436 Aug 30 18:22:47.857155 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1248/2584] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:47 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:48.392391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:48.416173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c8586dd-1b4d-4ddf-b13c-1fbb7c25c3d6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.886260 Aug 30 18:22:48.422622 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1337/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:47 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:48.746742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:48.747907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:48.781176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:48.781716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:48.790021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:48.791209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:48.791851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:48.792641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:48.880265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-465146cc-c5b0-402a-a443-d69b27ef7b3f tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af46820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:49.032955 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-465146cc-c5b0-402a-a443-d69b27ef7b3f tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.148760 Aug 30 18:22:49.035917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1338/2586] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:48 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:49.260471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:49.281355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca903f3f-15c3-4c62-aa61-4bd29dfb2055 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1501 microversion: 2.1 time: 0.543625 Aug 30 18:22:49.307774 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1249/2587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:48 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1501 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:49.325244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:49.330131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:49.371041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.385358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.387987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.391589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.397119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.400513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.450081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:49.450953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:49.465322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.465842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.466287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.472136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.475785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.476588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.578192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lazy-loading 'flavor' on Instance uuid d6c07cc5-284a-4301-b10e-91eb8d530aa7 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:22:49.817571 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0dfa48b4-bea4-4927-9b0c-03b7beb36ee9 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "POST /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7/action" status: 202 len: 0 microversion: 2.1 time: 0.504672 Aug 30 18:22:49.818731 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1339/2588] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:49 2022] POST /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:49.838670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:49.839714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:49.852522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.853225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.859017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.860578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:49.861391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:49.862001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:49.926232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:49.961453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdc22af7-6693-41d3-8bf9-96a661951e6b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.515341 Aug 30 18:22:49.967165 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1250/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:49 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:50.050459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c3160c56-3139-476b-b912-32db57f4405c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aeb0c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:50.138948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c3160c56-3139-476b-b912-32db57f4405c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.093103 Aug 30 18:22:50.139897 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1251/2590] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:50 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:51.007408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:51.011170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:51.041888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:51.045945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:51.047879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:51.049484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:51.051843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:51.054507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:51.166552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:51.206025 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e41b8ccd-b88c-492a-a3d9-15acb1db5414 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1509 microversion: 2.1 time: 1.372537 Aug 30 18:22:51.207641 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1340/2591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:49 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1509 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:51.235722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2cb7fcfe-45c6-4d47-8ae5-e5c7a79a7481 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e567fbdc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:51.339641 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2cb7fcfe-45c6-4d47-8ae5-e5c7a79a7481 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.123006 Aug 30 18:22:51.348562 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1341/2592] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:51 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:51.605369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:51.624078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cec7f75b-2cb8-4fb8-99af-d1b80596eebb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.628335 Aug 30 18:22:51.636854 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1252/2593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:50 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:51.670242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "tag": "f44263b0-4a1b-4c47-ae87-11c454d595aa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:51.697114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:51.707749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:51.708644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:51.749744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] Creating event network-changed:f44263b0-4a1b-4c47-ae87-11c454d595aa for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:22:51.769591 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3c77453f-1dce-4b06-b976-c885e7d7b9e8 req-9b66bed0-b4a2-4cad-9d4b-10146f940af8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106573 Aug 30 18:22:51.776326 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1342/2594] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:22:52.145242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "name": "network-vif-plugged", "status": "completed", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:52.188195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.198511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.199608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.222470 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] Creating event network-vif-plugged:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h2-854119-10 Aug 30 18:22:52.254187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:52.257682 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-68077704-0810-42e0-a2c7-01bbba64593f req-0ac7a8cb-d8a9-4e30-a902-61b6734ce0de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117921 Aug 30 18:22:52.258440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:52.260596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1253/2595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:22:52.277539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.281240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.286062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.287721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.288458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.289116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.379404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d6c7ae8-b378-43b9-a05d-569f4db6e090 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e568e6280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:52.654560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d6c7ae8-b378-43b9-a05d-569f4db6e090 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.286426 Aug 30 18:22:52.673174 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1254/2596] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:52 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:52.686732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:52.689344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:52.706221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.707605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.708701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.710471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.711779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.714170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.939450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:52.951569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a6b8559-8098-431e-a82e-1b5d88a9e92d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1492 microversion: 2.1 time: 0.707263 Aug 30 18:22:52.952592 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1343/2597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:52 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1492 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:52.974180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:52.975172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:52.984322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.985351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.986249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:52.987282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:52.987990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:52.988639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:53.044159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:22:53.269447 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6abaa188-a07a-4439-bd03-b88cc5a9c502 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 204 len: 0 microversion: 2.1 time: 0.298769 Aug 30 18:22:53.274169 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1344/2598] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:22:52 2022] DELETE /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:22:53.290475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:53.290475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:53.307506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:53.312921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:53.313822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:53.314658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:53.315637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:53.316157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:53.598140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:53.629904 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6e3308d-e3a2-48e2-9892-bd85a81795e0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.954508 Aug 30 18:22:53.633254 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1255/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:52 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:53.690187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-706396c3-d5aa-4b25-99c6-cf87ea222ae5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af1edc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:53.824705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-706396c3-d5aa-4b25-99c6-cf87ea222ae5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.141044 Aug 30 18:22:53.825546 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1256/2600] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:53 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:54.214326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:54.270021 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4e38317-f581-4ccd-9526-11ca0dde060f tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1498 microversion: 2.1 time: 0.991907 Aug 30 18:22:54.291392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1345/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:53 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1498 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:54.683558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:54.685571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:54.723775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:54.725668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:54.728607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:54.732244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:54.733678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:54.738462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:54.863603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a33fe65-d0cb-4163-89a6-3e9927d98db5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec0790>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:55.073730 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a33fe65-d0cb-4163-89a6-3e9927d98db5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.227762 Aug 30 18:22:55.077759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1346/2602] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:54 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:55.208771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:55.267206 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc668634-573e-4e0a-b843-42c64e58ab72 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1313 microversion: 2.1 time: 0.611512 Aug 30 18:22:55.274708 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1257/2603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:54 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:55.335578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:55.342000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:55.408162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:55.413742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:55.414800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:55.417367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:55.419698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:55.420553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:56.105332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53276685-c81b-40ff-88b1-e84e785d6ddf tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56936af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:56.286662 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53276685-c81b-40ff-88b1-e84e785d6ddf tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.183214 Aug 30 18:22:56.287337 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1258/2604] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:56 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:56.321962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:56.323916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:56.356622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:56.357874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:56.366729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:56.369972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:56.376961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:56.380656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:56.463153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:56.477458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83a18670-9843-4076-a22f-28cbbc7a24db tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1498 microversion: 2.1 time: 1.160829 Aug 30 18:22:56.482767 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1347/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:55 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1498 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:56.683920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:56.696590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e07187f1-2e85-4e9b-a0c6-b06907cd550e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1463 microversion: 2.1 time: 0.391310 Aug 30 18:22:56.711677 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1259/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:56 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1463 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:57.311063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-590b4683-3228-418c-93fa-9eb8ab85cf0e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aeb08b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:57.324390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:57.325618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:57.328142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:57.334593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.335542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.336396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.337583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.338568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.339246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.543227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-590b4683-3228-418c-93fa-9eb8ab85cf0e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.241719 Aug 30 18:22:57.546156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1260/2607] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:57 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:57.569100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:57.569759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:57.573319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:57.616829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.619374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.621827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.632930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:57.641889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:57.642914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:57.878277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6168ec13101341179054854df2758adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d739a2c84ad4367be699400b15d37b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:57.887113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:22:57.890588 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8dd861ec-d719-4781-8717-175ca87b746e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 200 len: 1456 microversion: 2.1 time: 0.340934 Aug 30 18:22:57.892417 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1261/2608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:57 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 1456 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:58.008244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c07cc5-284a-4301-b10e-91eb8d530aa7", "name": "network-vif-deleted", "tag": "a39ca209-eee1-4526-bce2-c061e0b18ee3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:58.029229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:58.031217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:58.032681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:58.067663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] Creating event network-vif-deleted:a39ca209-eee1-4526-bce2-c061e0b18ee3 for instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 on n-h2-854119-10 Aug 30 18:22:58.075179 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5916f893-a3ab-455d-bc61-bd4762d6d66a req-5ef0a60f-75bc-431a-9bb8-6544957386d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071249 Aug 30 18:22:58.079786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1262/2609] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:22:58.313969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1763935590", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "52c8298b-12f8-4e95-8e3d-1e6d6e6336e2"}], "block_device_mapping_v2": [{"uuid": "deb89a90-a1c9-418f-8a86-a6aacfa5529a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:58.382100 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c75e26f9-1b2f-4cf1-b0cf-2bf5c3e4dcff tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1616 microversion: 2.1 time: 1.663893 Aug 30 18:22:58.397617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1348/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:56 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1616 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:22:58.407033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:22:58.412057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:58.423554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:58.424755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:58.424755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:58.425268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:58.425837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:58.426276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:58.530984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0aecddcc1cdc4f7db102acd0b9c21774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2dba7ca7934bf187b00f707d8581dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:22:58.532546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] flavor_id is None. Assuming migration. {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:22:58.533891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:22:58.580152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] validate_networks() for [('52c8298b-12f8-4e95-8e3d-1e6d6e6336e2', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:22:59.080145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-793e1e2e-c254-42ed-ae11-64eba31f57cb tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62/action" status: 202 len: 0 microversion: 2.1 time: 0.680264 Aug 30 18:22:59.086587 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1349/2611] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:22:58 2022] POST /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:22:59.097851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-955a05d7-5cdb-4c37-8952-e4577a917a7d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aea3c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:59.201761 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-955a05d7-5cdb-4c37-8952-e4577a917a7d tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.113419 Aug 30 18:22:59.203987 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1350/2612] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:22:59 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:22:59.211129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:59.212229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:59.220952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.221803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.222696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:59.223999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.224957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.225662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:59.341824 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 HTTP/1.1 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd6c07cc5-284a-4301-b10e-91eb8d530aa7'} Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:22:59.346236 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:22:59.357527 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:22:59.362421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:22:59.364640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3cfe0a94-4806-4902-a634-f10fa187e28b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 404 len: 111 microversion: 2.1 time: 0.158706 Aug 30 18:22:59.366474 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1351/2613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:59 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:22:59.385734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:22:59.392059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:22:59.420734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.421962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.423188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:22:59.424930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:22:59.431062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:22:59.433273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.161107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:00.184558 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01ac6283-65c4-4889-8528-21985f6f5355 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1472 microversion: 2.1 time: 0.814827 Aug 30 18:23:00.185953 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1352/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:22:59 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1472 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:00.193012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.193871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.224437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.225153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.225841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.228095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.229758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.231050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.270984 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 HTTP/1.1 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd6c07cc5-284a-4301-b10e-91eb8d530aa7'} Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.277079 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.286300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.293312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f40e72fb-e2a7-46ce-94f9-ce81db97fad1 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 404 len: 111 microversion: 2.1 time: 0.099733 Aug 30 18:23:00.294481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1353/2615] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:00 2022] DELETE /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.306145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-301b4ffb-6aa3-468f-9a34-596be15034c8 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec0160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.434879 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-301b4ffb-6aa3-468f-9a34-596be15034c8 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.133126 Aug 30 18:23:00.437970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1354/2616] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:00.446660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.448132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: d6c07cc5-284a-4301-b10e-91eb8d530aa7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.467222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.468598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.469763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.471598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.472910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.473999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.512380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:00.533055 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 HTTP/1.1 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd6c07cc5-284a-4301-b10e-91eb8d530aa7'} Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.535365 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance d6c07cc5-284a-4301-b10e-91eb8d530aa7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57609726-472c-4531-a52a-09beae939622 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7" status: 404 len: 111 microversion: 2.1 time: 0.100161 Aug 30 18:23:00.543627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1355/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/servers/d6c07cc5-284a-4301-b10e-91eb8d530aa7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.556800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.556800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.563718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.564393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.564953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.566051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.566878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.567737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.588826 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 HTTP/1.1 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '542726f6-d659-4063-922f-955036c45de2'} Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.590993 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acc46bd3-572f-42a6-8c38-34a704512ee2 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 404 len: 111 microversion: 2.1 time: 0.046381 Aug 30 18:23:00.599281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1356/2618] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:00 2022] DELETE /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.609136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.610612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 542726f6-d659-4063-922f-955036c45de2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.618647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.619653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.620363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.621254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.621853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.622433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.659284 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 HTTP/1.1 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '542726f6-d659-4063-922f-955036c45de2'} Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.677243 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 542726f6-d659-4063-922f-955036c45de2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.685716 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a420742-39c3-4b05-83ae-4e33f86be529 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2" status: 404 len: 111 microversion: 2.1 time: 0.080673 Aug 30 18:23:00.687557 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1357/2619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/servers/542726f6-d659-4063-922f-955036c45de2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.715033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.719898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.728130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.729720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.730563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.731882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.733050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.737500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.773990 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 HTTP/1.1 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '89fa5066-6bfc-4719-b1cf-db750750e1c0'} Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.782611 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.789361 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed7a585c-a521-4e5f-8c9d-ddebea367ca7 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 404 len: 111 microversion: 2.1 time: 0.093285 Aug 30 18:23:00.795567 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1358/2620] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:00 2022] DELETE /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:23:00.806733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.807461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 89fa5066-6bfc-4719-b1cf-db750750e1c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.824218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.824218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.824218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.830239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.830239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.830239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.857631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 HTTP/1.1 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '89fa5066-6bfc-4719-b1cf-db750750e1c0'} Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.860937 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 89fa5066-6bfc-4719-b1cf-db750750e1c0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a65661a-89dc-4205-845b-64e904ec3aea tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0" status: 404 len: 111 microversion: 2.1 time: 0.066720 Aug 30 18:23:00.872214 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1359/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/servers/89fa5066-6bfc-4719-b1cf-db750750e1c0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.882332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:00.884762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:00.913109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.918584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.920319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.925288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:23:00.926097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:23:00.926824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:23:00.927546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:23:00.928115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.928295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:23:00.929766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.932338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:00.974117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a HTTP/1.1 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a66cbf98-70c0-4e72-9138-8ded6d4c127a'} Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:00.976398 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:00.981304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:00.984458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:00.986640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c841216-26a1-474a-a281-79bfdcce2f67 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 404 len: 111 microversion: 2.1 time: 0.113610 Aug 30 18:23:00.991174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:00.991174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:00.992077 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1360/2622] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:00 2022] DELETE /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:00.998992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.000286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: a66cbf98-70c0-4e72-9138-8ded6d4c127a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.010260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.010922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.011433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.012048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.012374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.013268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.013458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.014113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.015311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.038803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.076091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a HTTP/1.1 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a66cbf98-70c0-4e72-9138-8ded6d4c127a'} Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.084397 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance a66cbf98-70c0-4e72-9138-8ded6d4c127a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:01.091466 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-099d90e7-a6e0-4f8a-ba42-9b9d24b8ef1b tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a" status: 404 len: 111 microversion: 2.1 time: 0.093870 Aug 30 18:23:01.096339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1361/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:00 2022] GET /compute/v2.1/servers/a66cbf98-70c0-4e72-9138-8ded6d4c127a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:01.104185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.104645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.117814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:01.125103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.125739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.130319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Getting quotas for user cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 and project d91f68afbea64466b5abc3357706730a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:01.132100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.133026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.133571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.134014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.175479 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 HTTP/1.1 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '66aea12a-c124-473d-a154-1b6a5a61cfe8'} Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:01.178667 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:01.184364 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ce99d00-450f-4cec-afe2-7625cd560b2d tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 404 len: 111 microversion: 2.1 time: 0.085080 Aug 30 18:23:01.191474 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1362/2624] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:01 2022] DELETE /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:01.204014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.205211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: 66aea12a-c124-473d-a154-1b6a5a61cfe8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.218845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.219541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.220062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.220992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.221723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.222363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.246717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 HTTP/1.1 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '66aea12a-c124-473d-a154-1b6a5a61cfe8'} Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:01.248770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance 66aea12a-c124-473d-a154-1b6a5a61cfe8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-591fea2c-5acd-4664-abd7-a3df73ae03eb tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8" status: 404 len: 111 microversion: 2.1 time: 0.056784 Aug 30 18:23:01.252600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1363/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:01 2022] GET /compute/v2.1/servers/66aea12a-c124-473d-a154-1b6a5a61cfe8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:23:01.260960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.260960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.269923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.271169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.272604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.274232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:01.275321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:01.276666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:01.337230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:23:01.341209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='deb89a90-a1c9-418f-8a86-a6aacfa5529a',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:23:01.711389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:01.732003 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47b4561c-226c-4024-a601-dd3ce443cf2f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1472 microversion: 2.1 time: 0.477188 Aug 30 18:23:01.735848 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1364/2626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:01 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:01.737172 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9db91505-a537-486b-9d58-8f9b22bce543 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428400 Aug 30 18:23:01.739603 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1263/2627] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:23:01.753748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e92d518d-1022-43f7-a62f-0d4da51cba25 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec0550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.756101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6ed6e52-268a-4afc-abca-1464ef480f80 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:01.759576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6ed6e52-268a-4afc-abca-1464ef480f80 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:01.892525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e6ed6e52-268a-4afc-abca-1464ef480f80 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:01.895025 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e92d518d-1022-43f7-a62f-0d4da51cba25 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.157983 Aug 30 18:23:01.896125 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1365/2628] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:01 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:01.913897 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6ed6e52-268a-4afc-abca-1464ef480f80 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1053 microversion: 2.1 time: 0.166236 Aug 30 18:23:01.916176 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1264/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:01 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1053 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:02.755148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:02.755829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:02.782622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:02.787887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:02.788684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:02.789698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:02.794048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:02.794838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:02.916476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-897c8da0-8bcb-4d70-aa1d-ad3009fd1860 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aea8790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:03.021351 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-897c8da0-8bcb-4d70-aa1d-ad3009fd1860 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.108811 Aug 30 18:23:03.030778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1265/2630] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:02 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:03.065418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:03.069214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:03.101299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:03.101875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:03.102334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:03.103123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:03.103719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:03.104185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:03.185455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:03.201018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7ed049c-13fc-475f-80e9-a4a67b12bf9d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1472 microversion: 2.1 time: 0.450952 Aug 30 18:23:03.222397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1366/2631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:02 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1472 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:03.364395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:03.381930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-764b6a41-b62d-44cd-bf36-60e7d76e497c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1103 microversion: 2.1 time: 0.349754 Aug 30 18:23:03.382782 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1266/2632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:03 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1103 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:04.062286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b99a5b08-025c-4438-be20-d33a3d01d557 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aea3700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:04.221054 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b99a5b08-025c-4438-be20-d33a3d01d557 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.178130 Aug 30 18:23:04.239607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:04.240525 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1367/2633] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:04 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:04.240706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:04.262473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.266702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.269458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.282176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.283589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.285838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.416767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:04.423570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:04.474467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.478830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.482827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.485454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:04.492876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:04.496421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:04.636430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:04.707861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-786f3767-44e8-45f7-9be0-1156f52dea5a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1151 microversion: 2.1 time: 0.300740 Aug 30 18:23:04.716364 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1368/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:04 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1151 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:05.200419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:05.227349 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-216ba347-2eb6-467c-b420-041884d25804 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1472 microversion: 2.1 time: 0.996109 Aug 30 18:23:05.253161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17a1c288-c764-4adb-ad37-069cf3773cac tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aee55e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:05.271972 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1267/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:04 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1472 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:05.376861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17a1c288-c764-4adb-ad37-069cf3773cac tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.128926 Aug 30 18:23:05.380669 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1369/2636] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:05 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:05.756544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:05.760056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:05.810549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:05.813251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:05.814089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:05.821685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:05.826375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:05.827971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:06.270839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:06.279231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:06.333309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:06.348342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbafee41-0e05-437c-8b31-cc937525e584 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1169 microversion: 2.1 time: 0.607709 Aug 30 18:23:06.354116 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1268/2637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:05 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1169 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:06.359968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:06.360974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:06.368564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:06.383657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:06.384617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:06.397184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:06.405638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15cc0902-b996-49bc-ab91-615d097a290e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e565d8ca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:07.013152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:07.030226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec564aa0-e643-4294-abde-b5f2cbe401d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1472 microversion: 2.1 time: 0.771914 Aug 30 18:23:07.042428 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15cc0902-b996-49bc-ab91-615d097a290e tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.649191 Aug 30 18:23:07.043606 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1269/2638] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:06 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:07.055914 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1370/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:06 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1472 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:07.377387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:07.384252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:07.408862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:07.411063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:07.412050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:07.416096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:07.423184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:07.426049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:08.107606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32d6d6ef-9e9f-475b-b459-775ffb4bef95 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aee5ee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:08.312119 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32d6d6ef-9e9f-475b-b459-775ffb4bef95 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.225481 Aug 30 18:23:08.322902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:08.341639 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1371/2640] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:08 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:08.355546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5617432-bf80-44ea-a796-5542bfbc93ba tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.979803 Aug 30 18:23:08.359899 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1270/2641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:07 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:08.379425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:08.381939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:08.417226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:08.418638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:08.421964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:08.425097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:08.431414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:08.432903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:09.346719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-073631e9-40e4-44b1-a7ec-cf125580839c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56785dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:09.357865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:09.370236 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e86163e9-27b9-4372-9bee-35f1448d8835 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 1.024006 Aug 30 18:23:09.371599 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1372/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:08 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:09.399374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:09.400329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:09.422248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:09.431299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:09.432013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:09.434780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:09.437734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:09.439170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:09.513839 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-073631e9-40e4-44b1-a7ec-cf125580839c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.178752 Aug 30 18:23:09.533848 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1271/2643] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:09 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:09.848381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:09.907313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-485ab9c9-187e-4794-8b27-c949f8753ee7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.499208 Aug 30 18:23:09.922384 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1373/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:09 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:10.398459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:10.399782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:10.416472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.424827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.425670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:10.426658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.427410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.428140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:10.531316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b902e3c6-22ff-42b1-a03d-00bf90a71966 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af8aaf0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:10.671695 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b902e3c6-22ff-42b1-a03d-00bf90a71966 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.144247 Aug 30 18:23:10.676198 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1374/2645] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:10 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:10.939423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:10.940547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:10.967127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.970028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.974687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:10.977483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:10.990956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:10.992120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.093011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:11.266810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:11.276545 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1bd52d5-a7a9-4054-8206-036662b9152d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.882169 Aug 30 18:23:11.281227 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1272/2646] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:10 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:11.291822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.295287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:11.312166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.314118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.317582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.319005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.321829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.324019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.388432 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 HTTP/1.1 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'dd03713e-44fd-497a-9cac-877b40926247'} Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:11.392098 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.396522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.398317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:11.399522 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd6b223f-4af2-47f8-b6a8-9b70fbf03283 tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 404 len: 111 microversion: 2.1 time: 0.116910 Aug 30 18:23:11.404870 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1273/2647] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:11 2022] DELETE /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:11.411147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0c6826-1924-4e10-935f-c6f6c5e409e9", "tag": "8c466c2b-4990-4d4e-9595-4c66c6ad6c44"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:11.424541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.425334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.425921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.447390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] Creating event network-changed:8c466c2b-4990-4d4e-9595-4c66c6ad6c44 for instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 on n-h1-854119-10 Aug 30 18:23:11.453604 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-926c0833-a898-4b8f-b15b-757982f4d987 req-7840ea47-3fc2-4eb0-894a-2373558f35b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046934 Aug 30 18:23:11.454521 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1274/2648] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:11.461401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.463652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: dd03713e-44fd-497a-9cac-877b40926247] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:11.472347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:11.474703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.475631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.476429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.477595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.478538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.479535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.481756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b0ed9b87-6ef0-4ae6-b177-4658c3d3d761 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.549286 Aug 30 18:23:11.482372 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1375/2649] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:10 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:11.641254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 HTTP/1.1 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'dd03713e-44fd-497a-9cac-877b40926247'} Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.652506 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. Aug 30 18:23:11.661587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.665451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance dd03713e-44fd-497a-9cac-877b40926247 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:11.670317 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7f27fc0-8447-45ad-9774-a686951ae22e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247" status: 404 len: 111 microversion: 2.1 time: 0.213987 Aug 30 18:23:11.680931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1275/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:11 2022] GET /compute/v2.1/servers/dd03713e-44fd-497a-9cac-877b40926247 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:11.687171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.688052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:11.702808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2edfd1e4-8d53-45f2-8ad4-1b31075b3c71 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e56408040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.723474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.723981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.724541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.725303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.725766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.726193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.774019 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 HTTP/1.1 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'e1142b38-f620-44f1-b92d-51c230b1a069'} Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:11.779290 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.787603 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.803080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:11.805439 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c298a9e9-9777-44cd-9ba8-38d71968780e tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 404 len: 111 microversion: 2.1 time: 0.122662 Aug 30 18:23:11.809024 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1376/2651] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:11 2022] DELETE /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:11.819511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:11.820670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] [instance: e1142b38-f620-44f1-b92d-51c230b1a069] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:11.829512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.830544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.831264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.832371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:11.832990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:11.844711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:11.848265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2edfd1e4-8d53-45f2-8ad4-1b31075b3c71 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.152403 Aug 30 18:23:11.858709 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1276/2652] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:11 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:11.903918 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] HTTP exception thrown: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Request method failure captured: Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 HTTP/1.1 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPu2xQCr4gAK_wnFEEJa4-6pkBEQ4TF0uL0_4pymn3loR8qClkBYoCxBtrmOvje_n5dg6D9kX_acXnY3p1chzN7AUbH9eSnx0oV1C_hPF9cxsYqN8g38seKhBeTcbBfCbYtgLRbfpT78BSUY8Jy7aSk41TbCyirCenS2Uy0vUdlXjo Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d739a2c84ad4367be699400b15d37b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0d739a2c84ad4367be699400b15d37b5 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1035737115 Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6168ec13101341179054854df2758adf Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-1035737115-project Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'e1142b38-f620-44f1-b92d-51c230b1a069'} Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:11.912197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] Returning 404 to user: Instance e1142b38-f620-44f1-b92d-51c230b1a069 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:11.916938 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dafe823b-c877-4e25-a13f-80bdbf56b6dd tempest-DeleteServersTestJSON-1035737115 tempest-DeleteServersTestJSON-1035737115-project] 10.222.0.25 "GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069" status: 404 len: 111 microversion: 2.1 time: 0.099936 Aug 30 18:23:11.920224 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1377/2653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:11 2022] GET /compute/v2.1/servers/e1142b38-f620-44f1-b92d-51c230b1a069 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:12.311172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:12.316139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:12.350474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:12.367488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.373383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.375283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.381758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.386202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.390048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.525096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:12.528756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:12.588716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.597539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.598331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.599358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:12.603971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:12.604763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:12.996332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:13.006259 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b5fbd51-a1ee-4794-b152-1d4c74fdfe6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.704282 Aug 30 18:23:13.019234 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1277/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:12 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:13.025413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b325c3f7-3023-4c34-996e-9b6754d57a55 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec8790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:13.170818 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b325c3f7-3023-4c34-996e-9b6754d57a55 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.149928 Aug 30 18:23:13.171589 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1278/2655] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:13 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:13.651826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:13.669547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e90d9a4a-9162-4d91-bc49-34e29e86ee86 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 1.153076 Aug 30 18:23:13.673245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1378/2656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:12 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:14.034090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:14.036698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:14.065284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.070139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.075352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.083691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.090138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.095960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.197465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c2d08e5b-10bf-4b7b-8100-d66895d64701 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af87d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:14.344818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c2d08e5b-10bf-4b7b-8100-d66895d64701 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.152132 Aug 30 18:23:14.346882 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1379/2657] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:14 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:14.698628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:14.699331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:14.720382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.721288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.723342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.726703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:14.727787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:14.729628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:14.832053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:14.845055 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-baa08c4f-6556-47d0-be2c-db3202b2f72d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.816086 Aug 30 18:23:14.846016 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1279/2658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:14 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:15.367822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14719750-8f91-44e6-920b-920e87ceba2b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec8790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:15.456843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14719750-8f91-44e6-920b-920e87ceba2b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.092769 Aug 30 18:23:15.457476 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1280/2659] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:15 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:15.659372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:15.678982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-12c3a9e5-3339-4b4d-83d4-0a845ce6dbc8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.984022 Aug 30 18:23:15.682183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1380/2660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:14 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:15.873192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:15.874155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:15.896943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:15.897873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:15.898618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:15.899628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:15.900341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:15.900995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:16.161522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:16.183521 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dfad94f1-7b59-450a-a83f-6281c5e28b1f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.312876 Aug 30 18:23:16.186054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1281/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:15 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:16.474690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e33d50f-3a5c-4e09-882e-19188400855c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aec03a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:16.578750 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e33d50f-3a5c-4e09-882e-19188400855c tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1427 microversion: 2.1 time: 0.109148 Aug 30 18:23:16.580946 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1381/2662] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:16 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:16.704300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:16.707203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:16.732415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:16.733335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:16.733935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:16.737005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:16.744378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:16.745677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.097094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:17.115394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7d60934a-0140-4c52-9334-b95062e4211c tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.416380 Aug 30 18:23:17.130378 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1282/2663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:16 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:17.214152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:17.215330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:17.235406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.238959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.242959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.244634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.245554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.248583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.611759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0791c2d-b504-4967-ba44-9dfc371137ce tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e567384c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:17.613799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:17.657113 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58053640-96e7-425e-95b9-fe1d24179d7c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.444912 Aug 30 18:23:17.659967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1382/2664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:17 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:17.715239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0791c2d-b504-4967-ba44-9dfc371137ce tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1436 microversion: 2.1 time: 0.107812 Aug 30 18:23:17.722409 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1283/2665] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:17 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1436 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:17.733774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-044b2172-25b7-4659-be16-761619f72775 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af37700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:17.810431 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-044b2172-25b7-4659-be16-761619f72775 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 200 len: 1436 microversion: 2.1 time: 0.080971 Aug 30 18:23:17.821162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1383/2666] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:17 2022] GET /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 1436 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:17.833013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:17.834134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:17.868368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.871539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.873330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:17.878795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:17.881856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:17.884768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.144111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:18.145162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:18.169049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.171059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.174791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.179551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.182472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.186364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.207766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:18.221352 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6852df8-f70b-4615-a342-d799273a1473 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1479 microversion: 2.1 time: 0.396185 Aug 30 18:23:18.234409 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1284/2667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:17 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1479 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:18.590774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:18.603109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3662f7c-e812-4385-a843-26c01aecba40 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1211 microversion: 2.1 time: 0.465781 Aug 30 18:23:18.603688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1384/2668] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:18 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1211 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:18.701118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:18.701896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:18.723911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.727550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.728581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:18.729564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:18.731003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:18.732198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.105172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:19.116515 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-90e349cb-d29e-4e9a-9da2-f1c08fb4c69b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.419550 Aug 30 18:23:19.117514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1285/2669] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:18 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:19.261287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:19.263898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:19.274430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.275349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.276363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.277275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.277874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.278484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.613266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:19.634580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a4a8aca-e0ab-448d-bd87-8a032bd72a4b tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1466 microversion: 2.1 time: 0.386909 Aug 30 18:23:19.641597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1385/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:19 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1466 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:19.641837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:19.671735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:19.687701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ed20e34-c717-4a91-aabd-f47e383bf017 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5af69d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:19.710005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.710574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.711235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:19.712971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:19.713469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:19.714064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:20.307812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:20.343639 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49a3b273-8500-4bc9-98fb-a06bc51dd6c9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.717497 Aug 30 18:23:20.363927 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1286/2671] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:19 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:20.394437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:20.396445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:20.409854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:20.410035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:20.413529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:20.414423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:20.417872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:20.423991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:20.823503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:20.840567 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1ec70ee-df34-4d4d-bee9-6c81e13f4f23 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.468188 Aug 30 18:23:20.856767 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1287/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:20 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:21.091680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-unplugged", "status": "completed", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:21.147181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.148340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.149209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.198849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] Creating event network-vif-unplugged:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:23:21.209708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4481b633-f6c6-46f4-bb6c-925280a61d10 req-dd82eb71-5a17-4a52-bde0-0ed8f554b353 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133638 Aug 30 18:23:21.218033 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1288/2673] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:21.244831 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ed20e34-c717-4a91-aabd-f47e383bf017 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "DELETE /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc" status: 204 len: 0 microversion: 2.1 time: 1.570041 Aug 30 18:23:21.245839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1386/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:19 2022] DELETE /compute/v2.1/images/5c120bad-1729-44e6-b948-e92febfffcdc => generated 0 bytes in 1573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:21.258139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec53ea71-5528-48f6-a2c1-378e961f1f03 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '.version_select at 0x7f4e5aeca700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.296573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ec53ea71-5528-48f6-a2c1-378e961f1f03 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] HTTP exception thrown: Image not found. Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec53ea71-5528-48f6-a2c1-378e961f1f03 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Request method failure captured: Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c HTTP/1.1 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlUsmvomcMusjdfR-NfSmk9kPEA73vyFjOy1S6lgT_gxNDbN_lwqENZpFMXwRx9Q0NinNu--FhwwjgqDXOZa_UfGDgNWTuaWi5fY4eCvw53wuBTxfw1oMMjuQz5_Dd0gLed3Xt9whqn-UZuKsXSBdaHiYo2YQZB5w8M_-8W0WOw6mgo Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7224d5edb940414686664ef036761d33 Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: exception: Image not found. Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '26c00767-5b7d-48b5-ab63-b60630ff885c'} Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 26c00767-5b7d-48b5-ab63-b60630ff885c to delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26c00767-5b7d-48b5-ab63-b60630ff885c could not be found. Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.298642 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec53ea71-5528-48f6-a2c1-378e961f1f03 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Returning 404 to user: Image not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:21.304504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec53ea71-5528-48f6-a2c1-378e961f1f03 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "DELETE /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c" status: 404 len: 62 microversion: 2.1 time: 0.048088 Aug 30 18:23:21.306715 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1289/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:21 2022] DELETE /compute/v2.1/images/26c00767-5b7d-48b5-ab63-b60630ff885c => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:23:21.313361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.314401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:21.326917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.327737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.328479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.329574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.330403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.331287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.386392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:23:21.416204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.420117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:21.422661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:21.441723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.442673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.444206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.445654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.447024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.447907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.606103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f51011ff-b956-43ae-9dd5-773d60fd92c4 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 204 len: 0 microversion: 2.1 time: 0.295853 Aug 30 18:23:21.608122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1387/2676] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:21 2022] DELETE /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:21.632804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.636888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:21.656686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.669113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.669883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.671237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.673207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.673957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.791445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:21.817511 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-934641c4-fb86-4411-bd4a-1e34feebf31b tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.433241 Aug 30 18:23:21.823450 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1290/2677] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:21 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:21.872600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:21.873668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:21.904768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.905515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.906922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.912152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:21.913186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:21.914393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:21.980605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:22.238595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:22.255124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7abb6569-14fa-4d6e-964f-c4ce4758b703 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.389733 Aug 30 18:23:22.256600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1291/2678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:21 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:22.280006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:22.297778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c8f117e-9e15-4429-bca3-f1a96be41912 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1472 microversion: 2.1 time: 0.682932 Aug 30 18:23:22.299511 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1388/2679] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:21 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1472 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:22.852558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:22.854780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:22.869701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:22.871002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:22.872043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:22.873600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:22.874868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:22.877374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:23.218265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:23.235562 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dd20d81-97fc-4573-be57-30ad6a70b6e8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.392790 Aug 30 18:23:23.237210 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1292/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:22 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:23.277463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:23.278084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:23.285948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:23.287020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:23.287020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:23.287607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:23.288056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:23.288477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:23.327183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:23.340060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:23.350593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:23.351903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:23.353199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:23.354740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:23.355825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:23.356852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:23.528831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:23.541387 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62360e8a-571c-42ed-8d89-92e2d220d17c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.267088 Aug 30 18:23:23.542411 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1389/2681] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:23 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:23.698863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:23.709058 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8a7c51b7-4509-4580-97ce-71510a0b250a tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1472 microversion: 2.1 time: 0.390222 Aug 30 18:23:23.710447 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1293/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:23 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:24.265782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:24.266743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:24.273378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.273876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.274316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.275053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.275506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.275929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.455726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:24.465604 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55d2d0e9-7a2e-416c-b150-2626ffde5005 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.203978 Aug 30 18:23:24.466787 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1390/2683] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:24 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:24.580453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:24.581966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:24.591066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.592037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.592725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.593757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.594553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.595221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.757545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:24.758966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:24.771635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.772179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.772649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:24.773370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:24.774016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:24.774505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.009716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:25.035505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7ec07f6-6754-4686-95fd-5a696aeb5938 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1477 microversion: 2.1 time: 0.458337 Aug 30 18:23:25.037198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1294/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:24 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:25.107427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:25.121221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-51588eb1-2edb-4854-bd2c-c7440544a314 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1472 microversion: 2.1 time: 0.366746 Aug 30 18:23:25.122527 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1391/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:24 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:25.494643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:25.496277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:25.517098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:25.519341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:25.521679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.525039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:25.525718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:25.529614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:25.886786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:25.901869 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f56d37ca-edd9-489a-a8e7-92025b6d32f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.414767 Aug 30 18:23:25.920236 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1295/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:25 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:26.074508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.082254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.134400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.141925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.147099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.153702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.154720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.156243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.159707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.162206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.165869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.168511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.169865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.172309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.173159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.177458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.795987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:26.808811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b61a7b9b-7526-4fe8-ad69-4337aa57f9a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1476 microversion: 2.1 time: 0.749475 Aug 30 18:23:26.809767 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1392/2687] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:26 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1476 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:26.930439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:26.930668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:26.932068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:26.944507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.946292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.947868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.952193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:26.953274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:26.954010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:26.981327 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a44f3e9e-2883-4860-9caf-baf0385c02c5 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1472 microversion: 2.1 time: 0.825050 Aug 30 18:23:26.982635 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1296/2688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:26 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1472 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:27.557285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "name": "network-vif-unplugged", "status": "completed", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:27.590327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:27.614232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:27.615029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:27.677093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Creating event network-vif-unplugged:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h1-854119-10 Aug 30 18:23:27.717916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:23:27.760963 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-73c8a07d-f92b-44c9-b643-6a4c0c8d444b req-27c98c74-75d1-4760-9253-f4a652e5271d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210952 Aug 30 18:23:27.762471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1297/2689] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:23:27.865095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:27.881484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:27.913028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:27.926396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:27.927596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:27.928551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:27.930609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:27.931626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:27.933674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:28.979179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:28.993625 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d65e71fb-c1da-41c1-90c5-1cc5978539e8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1476 microversion: 2.1 time: 1.144457 Aug 30 18:23:28.995078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1298/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:27 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1476 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:29.021125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:29.023531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:29.044192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:29.046252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:29.066429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:29.068335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:29.074875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:29.075567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:29.481278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7224d5edb940414686664ef036761d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae317cc03c76466188ada89e03fa9e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:29.501112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d12a7681-aaad-477e-9c04-d8943c2d7ec9 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 200 len: 1302 microversion: 2.1 time: 0.494743 Aug 30 18:23:29.522497 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1299/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:29 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 1302 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:29.540200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d34f1e6-9be7-4186-8c4f-0c702fd64c9b", "name": "network-vif-deleted", "tag": "82b0a38c-228b-4e39-aeac-a11b523d42da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:29.579875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:29.581238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:29.583043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:29.614563 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] Creating event network-vif-deleted:82b0a38c-228b-4e39-aeac-a11b523d42da for instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b on n-h2-854119-10 Aug 30 18:23:29.627344 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b6ad712c-1a00-4ce7-91fd-f5769f217dc4 req-3634ff42-355d-4e49-a805-47a238e4b9d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101483 Aug 30 18:23:29.630052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1300/2692] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:29.840190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:29.868306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:29.876736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:29.880438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:29.928408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Creating event network-changed:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h1-854119-10 Aug 30 18:23:29.954198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:23:29.987233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c3ff0af0-5d79-4158-913f-fe6d2243d3cc req-a1cde800-fe7c-4af3-a825-7e42c6f0536b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154152 Aug 30 18:23:29.988955 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1301/2693] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:30.028339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:30.034483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:30.036304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:30.039859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-febbcc05-e754-44db-84cd-ed7cbee36d28 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 3.114047 Aug 30 18:23:30.059017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:30.059823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:30.061856 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1393/2694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:26 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 3137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:30.066519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:30.072049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:30.072989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:30.074597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:30.537387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:30.543192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] [instance: 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:30.567058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:30.571076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:30.571796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:30.572416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:30.576108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:30.577899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:30.582097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:30.618090 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] HTTP exception thrown: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Request method failure captured: Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b HTTP/1.1 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlUsmvomcMusjdfR-NfSmk9kPEA73vyFjOy1S6lgT_gxNDbN_lwqENZpFMXwRx9Q0NinNu--FhwwjgqDXOZa_UfGDgNWTuaWi5fY4eCvw53wuBTxfw1oMMjuQz5_Dd0gLed3Xt9whqn-UZuKsXSBdaHiYo2YQZB5w8M_-8W0WOw6mgo Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae317cc03c76466188ada89e03fa9e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ae317cc03c76466188ada89e03fa9e2e Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-697822319 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7224d5edb940414686664ef036761d33 Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ImagesOneServerTestJSON-697822319-project Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7d34f1e6-9be7-4186-8c4f-0c702fd64c9b'} Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:30.621565 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] Returning 404 to user: Instance 7d34f1e6-9be7-4186-8c4f-0c702fd64c9b could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0c7101da-efd2-4629-9f6e-acb98aed7933 tempest-ImagesOneServerTestJSON-697822319 tempest-ImagesOneServerTestJSON-697822319-project] 10.222.0.25 "GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b" status: 404 len: 111 microversion: 2.1 time: 0.094939 Aug 30 18:23:30.625770 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1394/2695] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:30 2022] GET /compute/v2.1/servers/7d34f1e6-9be7-4186-8c4f-0c702fd64c9b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:31.069188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:31.069899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:31.086797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:31.087209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:31.087651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:31.088496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:31.088970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:31.089395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:31.260778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:31.272168 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-51a98912-0e2a-414f-95e7-53a29d50e060 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1476 microversion: 2.1 time: 1.255850 Aug 30 18:23:31.278488 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1302/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:30 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1476 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:31.623463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:31.631657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c6c9fc7-1251-401d-b72a-4b317216c372 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.567130 Aug 30 18:23:31.632263 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1395/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:31 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:31.849033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0c6826-1924-4e10-935f-c6f6c5e409e9", "name": "network-vif-plugged", "status": "completed", "tag": "8c466c2b-4990-4d4e-9595-4c66c6ad6c44"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:31.880105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:31.881112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:31.881683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:31.905829 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] Creating event network-vif-plugged:8c466c2b-4990-4d4e-9595-4c66c6ad6c44 for instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 on n-h1-854119-10 Aug 30 18:23:31.932209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f593adfc-a585-432c-88a8-6323a2c8e83c req-5d3f8955-c51d-48a5-9eb1-49f28590399e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087025 Aug 30 18:23:31.933123 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1303/2698] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:32.305791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:32.306929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:32.324637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:32.325759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:32.326756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:32.327888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:32.329168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:32.330111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:32.602517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:32.617933 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-219e2dc0-bcea-48a9-9c51-321a0b090a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1474 microversion: 2.1 time: 0.321959 Aug 30 18:23:32.619003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1396/2699] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:32 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:32.657405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:32.658262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:32.666033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:32.666942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:32.667658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:32.668678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:32.669393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:32.670786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:33.201171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:33.225660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9cf009ce-5092-4779-a3b5-fe4e90ab3dd8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.573087 Aug 30 18:23:33.229088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1304/2700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:32 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:33.667870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:33.670393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:33.702899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:33.702899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:33.702899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:33.711012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:33.712056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:33.712936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.000492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:34.030013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ecb288a-6754-47ad-9aea-21869915d087 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1471 microversion: 2.1 time: 0.373549 Aug 30 18:23:34.033840 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1397/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:33 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:34.073329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:34.085966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:34.101289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.112001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.113048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.114800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.115886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.116818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.255442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:34.256332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:34.272369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.274329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.289385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.291933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.298279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.301671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.335749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1aefbdf-2138-4beb-a323-4251b1b8411d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62/action" status: 204 len: 0 microversion: 2.1 time: 0.275658 Aug 30 18:23:34.340636 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1305/2702] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:23:34 2022] POST /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62/action => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:34.354778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:34.361772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:34.382727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.384240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.385923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.388872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:34.391294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:34.393555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:34.856679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:34.874710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eca22190-af0d-4d4b-9862-f114823995b8 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1199 microversion: 2.1 time: 0.625369 Aug 30 18:23:34.892514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:34.894082 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1398/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:34 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1199 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:34.898867 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8ae5547-3802-4cc2-a49c-9a9df9aa3c6c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1471 microversion: 2.1 time: 0.553081 Aug 30 18:23:34.915871 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1306/2704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:34 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:35.669195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-455ea37f-d426-4ae2-8740-cc628a719dc9 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] Calling method '.version_select at 0x7f4e5afe0f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:35.755918 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-455ea37f-d426-4ae2-8740-cc628a719dc9 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] 10.222.0.25 "GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292" status: 200 len: 784 microversion: 2.1 time: 0.859967 Aug 30 18:23:35.756807 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1399/2705] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:23:34 2022] GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292 => generated 784 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:35.773731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-172b5587-17b7-428c-bf90-e68b6f283f06 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] Calling method '.version_select at 0x7f4e568a03a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:35.892093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-172b5587-17b7-428c-bf90-e68b6f283f06 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.122831 Aug 30 18:23:35.893694 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1307/2706] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Aug 30 18:23:35 2022] GET /compute/v2.1/images => generated 445 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:35.911144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19770896-6db9-42f3-9659-9532a82aeb29 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] Calling method '.version_select at 0x7f4e5aec0820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:35.914584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:35.916218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:35.925416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:35.926296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:35.935918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:35.937404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:35.938465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:35.939307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:36.011814 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19770896-6db9-42f3-9659-9532a82aeb29 tempest-ListImagesTestJSON-755461615 tempest-ListImagesTestJSON-755461615-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.107300 Aug 30 18:23:36.022257 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1400/2707] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:23:35 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:36.048789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:36.052202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:36.068468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:36.069583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:36.072055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:36.073153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:36.074976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:36.075592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:36.326491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:36.354482 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-365b895a-f0d3-478f-8361-c3120e48aade tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1382 microversion: 2.1 time: 0.439401 Aug 30 18:23:36.375174 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1308/2708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:35 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1382 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:36.436957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:36.452866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4133a19e-07f5-4b58-b418-10a5968d2d84 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1471 microversion: 2.1 time: 0.418257 Aug 30 18:23:36.454236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1401/2709] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:36 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:36.989674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "name": "network-vif-plugged", "status": "completed", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:37.038631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.039818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.042786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.136413 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Creating event network-vif-plugged:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h1-854119-10 Aug 30 18:23:37.156479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:23:37.187423 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5dc6a863-f90b-4727-8398-d43b4205d314 req-d4bcd2ea-e8a1-4d10-857d-bce79ca0d1a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205084 Aug 30 18:23:37.190789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1402/2710] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:37.227093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:37.228062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:37.251013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.251598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.252059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.252842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.253316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.253821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.480165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:37.480899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:37.507824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.513675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.519939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.521840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.531459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.532866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.735407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2eb77847-7fdb-4921-b864-6e27ebed41b8 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1535 microversion: 2.1 time: 1.357982 Aug 30 18:23:37.736041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1309/2711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:36 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1535 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:37.760197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:37.760825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:37.783346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.784708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.785160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.785902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:37.786433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:37.786828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:37.807148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:38.100785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:38.114545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b271b47d-c402-4244-a5b1-cc65ae77b230 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1471 microversion: 2.1 time: 0.636420 Aug 30 18:23:38.115671 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1403/2712] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:37 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1471 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:38.184265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0119486-8bdb-406b-a828-f785d6d7facf tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1535 microversion: 2.1 time: 0.427853 Aug 30 18:23:38.199945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1310/2713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:37 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1535 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:38.209917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:38.214320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.214866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.215293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.216060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.216528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.216960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.273579 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96bddd8f-4fad-4643-a2e0-0e3e47937112 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.068222 Aug 30 18:23:38.274216 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1404/2714] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:23:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:38.287236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854119-10", "block_migration": false, "disk_over_commit": false}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:38.291148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:38.298471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.299367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.300051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.301041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:38.301780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:38.302475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:38.383393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lazy-loading 'flavor' on Instance uuid 2b0c6826-1924-4e10-935f-c6f6c5e409e9 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:23:38.414998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Going to try to live migrate instance to n-h2-854119-10 {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:23:39.083719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-638582855", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "74dbf0ae-6dca-430c-8e64-20c9c0b8103a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:39.213296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] validate_networks() for [('74dbf0ae-6dca-430c-8e64-20c9c0b8103a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:23:39.995938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:23:39.996404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:23:39.997643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:23:39.998607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:23:39.999679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:23:40.027251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.028529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.029933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.031844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.032673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.033359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.099627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Getting quotas for project 129c8fd3ab294833be1d5544574463d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:40.123537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Getting quotas for user 23dcd1fad93e4c6c8bde99ef05b8887c and project 129c8fd3ab294833be1d5544574463d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:40.177134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:23:40.186385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:23:40.326424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e15fbf1d-133b-4959-a632-8134a04bd0c9 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688500 Aug 30 18:23:40.330145 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1405/2715] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:23:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:23:40.335510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:40.336441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:40.361433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.362229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.363245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.365050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.365864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.368201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.633584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:40.648143 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f50c77d6-0f3e-43f9-b685-0fd7b9538c13 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1463 microversion: 2.1 time: 0.316627 Aug 30 18:23:40.665089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1406/2716] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:40 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:40.670220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3c0806b-153d-45f2-b720-dacd853d7a12 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:40.670889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3c0806b-153d-45f2-b720-dacd853d7a12 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:40.815698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3c0806b-153d-45f2-b720-dacd853d7a12 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:40.826123 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3c0806b-153d-45f2-b720-dacd853d7a12 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1215 microversion: 2.1 time: 0.159547 Aug 30 18:23:40.832443 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1407/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:40 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:40.838817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:40.839606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:40.847969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.848261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.848753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.849436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:40.850044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:40.850527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:40.887442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:41.128202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf9f6490-9709-4943-9880-606c2b44b2c7 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1616 microversion: 2.1 time: 0.294497 Aug 30 18:23:41.129240 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1408/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:40 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1616 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:41.136082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:41.138486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:41.166267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.167206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.168492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.170800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.174635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.175498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.582944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:41.614738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:41.617766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:41.622009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf993303-1fe5-458a-8717-a5728e518b1a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2951 microversion: 2.42 time: 0.489774 Aug 30 18:23:41.625192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1409/2719] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:23:41 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2951 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:23:41.633954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-326c03e0-fde9-4e5b-a935-68b8e7e831e1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '.version_select at 0x7f4e56a07280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:41.642165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326c03e0-fde9-4e5b-a935-68b8e7e831e1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.662614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326c03e0-fde9-4e5b-a935-68b8e7e831e1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.665852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326c03e0-fde9-4e5b-a935-68b8e7e831e1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.692777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-326c03e0-fde9-4e5b-a935-68b8e7e831e1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1916 microversion: 2.1 time: 0.066128 Aug 30 18:23:41.698858 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1410/2720] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:23:41 2022] GET /compute/v2.1/os-migrations => generated 1916 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:41.708237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:41.709082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:41.730921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.731884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.732533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.733630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.734660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.735310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.955001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6944898-318d-454a-89f5-897b21f2a3e6 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.253467 Aug 30 18:23:41.956417 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1411/2721] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:23:41 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90/os-interface => generated 1831 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:23:41.961933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:41.962579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:41.988569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.989118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.989684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:41.990786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:41.991393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:41.991895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:42.165148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bc72fb7-556f-4696-936d-e40cf9c08c40 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9/action" status: 202 len: 0 microversion: 2.1 time: 3.881285 Aug 30 18:23:42.175878 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1311/2722] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:23:38 2022] POST /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9/action => generated 0 bytes in 3892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:23:42.233374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:42.251083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d82792d6-24cc-40ea-8140-654a084c028b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1267 microversion: 2.1 time: 0.293418 Aug 30 18:23:42.252926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1412/2723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:41 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:42.264260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:42.265485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:42.294801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:42.295353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:42.295799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:42.301293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:42.302101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:42.302593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:42.832202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e7d169b-4d0e-40e5-9113-57b85bb05ef5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e5ae855e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAyAr5HN9myNBBLLyZNAWvPKD9H/EPv2lmHuZyZpA+wozQQqGWtJt8H6ZULI0VARPcSpvJ4gDdK7zck3HA0+xBoxpa2ZGt2BPGE1Xe7vSS7wqIudnQpkb6EuxCDsog/hQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e7d169b-4d0e-40e5-9113-57b85bb05ef5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 257 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAyAr5HN9myNBBLLyZNAWvPKD9H/EPv2lmHuZyZpA+wozQQqGWtJt8H6ZULI0VARPcSpvJ4gDdK7zck3HA0+xBoxpa2ZGt2BPGE1Xe7vSS7wqIudnQpkb6EuxCDsog/hQ=="}} Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAyAr5HN9myNBBLLyZNAWvPKD9H/EPv2lmHuZyZpA+wozQQqGWtJt8H6ZULI0VARPcSpvJ4gDdK7zck3HA0+xBoxpa2ZGt2BPGE1Xe7vSS7wqIudnQpkb6EuxCDsog/hQ=='}}} Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 30 18:23:42.841210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:42.847260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e7d169b-4d0e-40e5-9113-57b85bb05ef5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:42.849965 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e7d169b-4d0e-40e5-9113-57b85bb05ef5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.669102 Aug 30 18:23:42.849965 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1312/2724] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:42 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 672 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:23:42.855850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1731882586", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:42.986636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:23:43.000721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:43.012068 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55f11ad9-ef56-43e7-8185-0f798719550a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.755960 Aug 30 18:23:43.019191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1413/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:42 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:43.036242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e56a07ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1364766816", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:43.098995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:43.118791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for user d639d451a58845e49a6bc66dc9c7114b and project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:43.153953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 2167 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1364766816", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:23:43.181214 n-d-854119-10 devstack@n-api.service[122589]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1364766816', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:43.184811 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1fc3ec0-5837-4a91-9aa0-76003f8812b3 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.162585 Aug 30 18:23:43.191601 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1414/2726] 10.222.0.25 () {60 vars in 1160 bytes} [Tue Aug 30 18:23:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:23:43.200153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92476eb7-dea6-4eae-8199-a387c3c652b0 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e57573790>, body: {"keypair": {"name": "tempest-keypair-1674728318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXBXx8g7IjRsNenkqMmBDBMaUI0rIh8pP0MtS0R428PI7p1hctoA7pM2eKzgvN/mDgfxGp1e90h75DBqkM5VEkQfybM+xbTvQ5atmSfsMbZJ6iC2huS0sh2rToEYZoJ9Q=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:43.232394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-92476eb7-dea6-4eae-8199-a387c3c652b0 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:43.240783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-92476eb7-dea6-4eae-8199-a387c3c652b0 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for user d639d451a58845e49a6bc66dc9c7114b and project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:43.297540 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92476eb7-dea6-4eae-8199-a387c3c652b0 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102621 Aug 30 18:23:43.298747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1415/2727] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:23:43.319631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:43.322974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:43.344113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:43.346457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:43.347315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:43.349841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:43.352741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:43.354919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:43.638489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:43.671762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c9e058b-d590-47aa-8631-92024a425c71 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1273 microversion: 2.1 time: 0.362257 Aug 30 18:23:43.678883 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1416/2728] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:43 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1273 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:43.701999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e5afe05e0>, body: {"keypair": {"name": "tempest-keypair-1674728318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCqQG3GtQJYpvlGf2oGWOBOuPmaqYv9fXdOsO3+luszLeodPvfugzDGJL1Uke8Hy5Qw0UmU9kEEujXQcYujsONz9s5KKgl55YEkNx2tLPiPcHMpdRBz9WLQUbSnqRLF4Q=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:43.783051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:43.807508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for user d639d451a58845e49a6bc66dc9c7114b and project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:43.906683 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] HTTP exception thrown: Key pair 'tempest-keypair-1674728318' already exists. Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 273 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: {"keypair": {"name": "tempest-keypair-1674728318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCqQG3GtQJYpvlGf2oGWOBOuPmaqYv9fXdOsO3+luszLeodPvfugzDGJL1Uke8Hy5Qw0UmU9kEEujXQcYujsONz9s5KKgl55YEkNx2tLPiPcHMpdRBz9WLQUbSnqRLF4Q=="}} Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: exception: Key pair 'tempest-keypair-1674728318' already exists. Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1674728318', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCqQG3GtQJYpvlGf2oGWOBOuPmaqYv9fXdOsO3+luszLeodPvfugzDGJL1Uke8Hy5Qw0UmU9kEEujXQcYujsONz9s5KKgl55YEkNx2tLPiPcHMpdRBz9WLQUbSnqRLF4Q=='}}} Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd639d451a58845e49a6bc66dc9c7114b-tempest-keypair-1674728318' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 18:23:43.956291 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result.read() Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 18:23:43.960271 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd639d451a58845e49a6bc66dc9c7114b-tempest-keypair-1674728318' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 18, 23, 43, 892373), 'updated_at': None, 'name': 'tempest-keypair-1674728318', 'user_id': 'd639d451a58845e49a6bc66dc9c7114b', 'fingerprint': '1a:6e:94:b5:5f:ad:35:8f:e1:4e:38:23:5f:cf:b4:73', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCqQG3GtQJYpvlGf2oGWOBOuPmaqYv9fXdOsO3+luszLeodPvfugzDGJL1Uke8Hy5Qw0UmU9kEEujXQcYujsONz9s5KKgl55YEkNx2tLPiPcHMpdRBz9WLQUbSnqRLF4Q==', 'type': 'ssh'}] Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi keypair.create() Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._create() Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1674728318' already exists. Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 30 18:23:43.964416 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1674728318' already exists. Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1674728318' already exists. Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 409 to user: Key pair 'tempest-keypair-1674728318' already exists. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99b61d99-e9d2-476d-87b1-c2a76f2e8665 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.279041 Aug 30 18:23:43.975330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1417/2729] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:43 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 284 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:23:44.011669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d4bfddc-a62c-410b-b7f1-75103c835ce1 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Calling method '.version_select at 0x7f4e58280310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:44.066017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d4bfddc-a62c-410b-b7f1-75103c835ce1 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674728318" status: 202 len: 0 microversion: 2.1 time: 0.093975 Aug 30 18:23:44.067582 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1418/2730] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674728318 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:23:44.076362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:44.076904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:44.096078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.096591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.097044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.098137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.098637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.099156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.592067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:44.619701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-46d4b683-392a-45f4-af5f-8e7765e84262 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.550548 Aug 30 18:23:44.620798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1419/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:44 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:44.648928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5f96ea9b-9d5c-4dfb-b576-0aabda9267bc tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e56e66160>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvpvt3Kq+8hIbohIIBOe7xTYzSD6XmvfK/kA3wrkR7P1PoOFzuO9CGTaabwBjSHuVKWpxavjcl0AR+uc+kKk3oOh2FX9GNoUMB1OsnG3defNST0x3oz8aniR85n5C0FlA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5f96ea9b-9d5c-4dfb-b576-0aabda9267bc tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 247 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvpvt3Kq+8hIbohIIBOe7xTYzSD6XmvfK/kA3wrkR7P1PoOFzuO9CGTaabwBjSHuVKWpxavjcl0AR+uc+kKk3oOh2FX9GNoUMB1OsnG3defNST0x3oz8aniR85n5C0FlA=="}} Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvpvt3Kq+8hIbohIIBOe7xTYzSD6XmvfK/kA3wrkR7P1PoOFzuO9CGTaabwBjSHuVKWpxavjcl0AR+uc+kKk3oOh2FX9GNoUMB1OsnG3defNST0x3oz8aniR85n5C0FlA=='}}} Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '' Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:23:44.656883 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.663350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5f96ea9b-9d5c-4dfb-b576-0aabda9267bc tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:44.668770 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5f96ea9b-9d5c-4dfb-b576-0aabda9267bc tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.036589 Aug 30 18:23:44.677268 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1420/2732] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:44 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:23:44.689532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e5afe0040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1916855555", "public_key": " "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:44.736572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:23:44.737138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:23:44.737816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:23:44.738644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:23:44.739140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:23:44.746773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:44.762404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for user d639d451a58845e49a6bc66dc9c7114b and project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:44.766977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.770082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:44.771331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.771951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.772930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.776368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.777416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.851602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 95 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1916855555", "public_key": " "}} Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1916855555', 'public_key': ' '}}} Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:44.854740 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:44.869747 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f20feb69-7d19-4e83-924f-46747f852dd5 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.181118 Aug 30 18:23:44.878069 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1421/2733] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Aug 30 18:23:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:23:44.901602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:44.907533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:44.908717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:44.917576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:44.931002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.932207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.934077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.936652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:44.937438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:44.938923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:44.980830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:23:44.998918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:23:45.175471 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4df93a1-fb78-4f9b-b4c3-6a6233cbbb79 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.323419 Aug 30 18:23:45.177563 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1313/2734] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:23:45.184932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5d06492-0653-4394-9745-4f91a4ac8092 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e5aeca550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlbsYrljgA4Ps31tX5wQ13QA6jNOreQF8eY3w1I7SQ3cMuc7NdO/r98JR3brDZiWgOuwFBVD5gx3REPVBmSjsNDEw050TlN2jMPF1H0oU+A+cuCTnEkXlcfMeBBgkEKQw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5d06492-0653-4394-9745-4f91a4ac8092 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 507 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlbsYrljgA4Ps31tX5wQ13QA6jNOreQF8eY3w1I7SQ3cMuc7NdO/r98JR3brDZiWgOuwFBVD5gx3REPVBmSjsNDEw050TlN2jMPF1H0oU+A+cuCTnEkXlcfMeBBgkEKQw=="}} Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlbsYrljgA4Ps31tX5wQ13QA6jNOreQF8eY3w1I7SQ3cMuc7NdO/r98JR3brDZiWgOuwFBVD5gx3REPVBmSjsNDEw050TlN2jMPF1H0oU+A+cuCTnEkXlcfMeBBgkEKQw=='}}} Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 18:23:45.195258 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5d06492-0653-4394-9745-4f91a4ac8092 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:45.198251 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5d06492-0653-4394-9745-4f91a4ac8092 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018216 Aug 30 18:23:45.209255 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1314/2735] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:45 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:23:45.214240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-945a7182-5364-4703-b9ee-f01b4eff805b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:45.214894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-945a7182-5364-4703-b9ee-f01b4eff805b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:45.337693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-945a7182-5364-4703-b9ee-f01b4eff805b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:45.353749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-945a7182-5364-4703-b9ee-f01b4eff805b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1213 microversion: 2.1 time: 0.142866 Aug 30 18:23:45.368109 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1315/2736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:45 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:45.384754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Action: 'create', calling method: .version_select at 0x7f4e5aeca9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-721210713", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:45.433601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:23:45.445421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Getting quotas for user d639d451a58845e49a6bc66dc9c7114b and project 8f73a68b001a4c57861902bc99244dac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:23:45.480080 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] [05691806-9948-4b3e-b3f3-43567c822b5c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:23:46.191411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.234750 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-334c34f7-8ef7-4dd5-b9d4-9ed05b2bf80f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 1.356106 Aug 30 18:23:46.253653 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1422/2737] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:44 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.277876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.279325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.298877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.303163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.303972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.306654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.308479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.311724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.493934 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] [05691806-9948-4b3e-b3f3-43567c822b5c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39380. Aug 30 18:23:46.514235 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 117 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-721210713", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-721210713', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 18:23:46.520284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:46.524160 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c087c8d-6976-406e-8c5b-09f0e408d8cf tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 1.154433 Aug 30 18:23:46.532139 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1316/2738] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:23:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 1163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:23:46.551222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.552708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:46.600275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.604896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.606736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.611372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:46.612766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:46.616486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:46.754080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.775903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f428c733-97a3-4808-a545-9447633972de tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.520428 Aug 30 18:23:46.789059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1423/2739] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:46 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:46.795684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13757aca-bd76-4112-bfa7-16a63e6f87a6 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Calling method '.version_select at 0x7f4e571e0430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:46.830453 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-13757aca-bd76-4112-bfa7-16a63e6f87a6 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13757aca-bd76-4112-bfa7-16a63e6f87a6 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Request method failure captured: Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-445614723 HTTP/1.1 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWtkuIF3yOGEcIKywb9sd9yx_XUKyGG7YZ3l2uNYEftl9UYxSnNfKmZ1kxt8fvlFDDbmK1bfnjJfSjOVpt6Qtj-KkziuoLtDxbLCP4YNg-bI3ixLEaRzEUWYqhuqamHRsTmFkqTg84Cfh39OILBQEsWuehPpgVEz_LJBPCXS4DTQ3s Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f73a68b001a4c57861902bc99244dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f73a68b001a4c57861902bc99244dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8f73a68b001a4c57861902bc99244dac Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2013694033 Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2013694033-project Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: exception: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'tempest-keypair-non-existent-445614723'} Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.834400 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13757aca-bd76-4112-bfa7-16a63e6f87a6 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] Returning 404 to user: Keypair tempest-keypair-non-existent-445614723 not found for user d639d451a58845e49a6bc66dc9c7114b {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13757aca-bd76-4112-bfa7-16a63e6f87a6 tempest-KeyPairsNegativeTestJSON-2013694033 tempest-KeyPairsNegativeTestJSON-2013694033-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-445614723" status: 404 len: 144 microversion: 2.1 time: 0.049815 Aug 30 18:23:46.844266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1424/2740] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-445614723 => generated 144 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:23:46.885400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:46.904701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-646b717f-891f-4883-93c0-defea2d4bd1e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1217 microversion: 2.1 time: 0.369309 Aug 30 18:23:46.908052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1317/2741] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:46 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1217 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:47.232722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4ba296-a8cd-4044-bf7f-f2673fa3b030", "tag": "16c94e46-6bcf-4761-ba97-4001eadebe43"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:47.270896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:47.275102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:47.277344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:47.289515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:47.290551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:47.308867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:47.310920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:47.314979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:47.316879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:47.321399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:47.322281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:47.332438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] Creating event network-changed:16c94e46-6bcf-4761-ba97-4001eadebe43 for instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 on n-h2-854119-10 Aug 30 18:23:47.351544 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-626a54b4-ce87-4772-a15f-3b8b77bfff01 req-03cbdfed-8c30-477e-80b3-816a63ca122f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122760 Aug 30 18:23:47.355211 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1425/2742] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:47.816654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:47.823191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:47.852287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:47.856461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:47.857529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:47.862175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:47.864534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:47.884082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:48.072987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:48.114391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15f6d529-4a0d-4d15-bea6-4f57c1c5bfc8 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 0.829616 Aug 30 18:23:48.150415 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1318/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:47 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:48.160203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:48.161982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:48.174524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:48.175838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:48.176960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:48.178789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:48.180296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:48.182387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:48.669997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:48.700579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e441adae-1263-4223-8dcd-c8e2f3447801 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1283 microversion: 2.1 time: 0.547799 Aug 30 18:23:48.702559 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1319/2744] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:48 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1283 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:48.944699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:49.044114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da9e0f76-c547-4d7f-9186-0ffd63206b43 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 1.242790 Aug 30 18:23:49.058198 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1426/2745] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:47 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:49.161354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:49.172517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:49.198032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.204079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.205006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:49.211810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.213642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.214675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:49.579959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:49.622283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57437b1d-f62a-4331-8ded-70c3ca6e3de5 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 0.466664 Aug 30 18:23:49.625837 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1320/2746] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:49 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:49.746065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:49.747162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:49.810969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.817155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.821624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:49.823518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:49.840828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:49.841615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.048689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:50.104836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:50.105889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:50.132253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:50.145177 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ac22ee7-46bc-4151-aacf-94e9af6737c9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1271 microversion: 2.1 time: 0.407083 Aug 30 18:23:50.149888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.153273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.159315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.161227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.162715 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1427/2747] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:49 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1271 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:50.182882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.185494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.650812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:50.651761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:50.671751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.673550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.675326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.677819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:50.680509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:50.681623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:50.785976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:50.803434 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b66b5ec2-3981-4192-98a0-f34f3d6b20db tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.705106 Aug 30 18:23:50.811672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1321/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:50 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:51.168453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:51.169087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:51.184345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.188278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.191089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:51.192881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.193628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.195355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:51.518021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:51.537228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:51.570230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-287bd272-8b09-48f4-bbd2-0015f3556112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1271 microversion: 2.1 time: 0.405886 Aug 30 18:23:51.571335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1322/2749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:51 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:51.578593 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca575046-14cd-4818-873e-078c789c94de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 0.932367 Aug 30 18:23:51.586145 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1428/2750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:50 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:51.871817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:51.872946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:51.913152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.913973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.931013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:51.932481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:51.933322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:51.934203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.541481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:52.562820 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-38c3b7cc-d178-4357-a3a7-05cb491197e2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.702905 Aug 30 18:23:52.565891 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1323/2751] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:51 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:52.637396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:52.638746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:52.643867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:52.650742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:52.691017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.691942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.692901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.694217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.700544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.701151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.704849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.706734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:52.708611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.710687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:52.711562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:52.715715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:53.522784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:53.553214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d1f0325-eb7c-45cf-9107-71a92af97a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.941030 Aug 30 18:23:53.559320 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1429/2752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:52 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:53.592772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:53.594437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:53.626949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:53.630510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:53.634769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:53.641996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:53.654111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:53.657965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:53.660499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9cd547b-debf-430b-af25-3a248e4ba481 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 1.038557 Aug 30 18:23:53.661448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:53.670443 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1324/2753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:52 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:54.357899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:54.406022 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b88a1fdf-e71e-4635-8422-c5e87b1da525 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.814503 Aug 30 18:23:54.410370 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1430/2754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:53 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:54.581796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:54.582973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:54.600776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:54.601381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:54.601797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:54.603218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:54.603782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:54.604800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:54.694326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:54.697265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:54.716295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:54.716807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:54.717259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:54.725234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:54.725820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:54.726283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:54.834787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=24 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:54.839018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:55.177144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:55.193550 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b76c3104-f49b-4889-9cc6-af86250a43b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.617220 Aug 30 18:23:55.197413 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1325/2755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:54 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:55.435913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:55.439219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:55.478030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:55.490824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:55.491898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:55.493235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:55.501416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:55.505193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:55.506218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:55.527738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:55.546013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0db23213-00d3-408c-afd5-e43a6f8ab51f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 0.854248 Aug 30 18:23:55.546013 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1431/2756] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:54 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:55.618263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:55.670287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:55.687339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:55.687790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:55.712876 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] Creating event network-changed:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h1-854119-10 Aug 30 18:23:55.724787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cd359f86-101b-4d2a-8e48-47c34394f169 req-21e12b70-91df-443b-acb7-0053f35c0de2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110343 Aug 30 18:23:55.726780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1432/2757] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:23:56.238699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:56.240559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:56.248985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:56.254809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.256261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.257050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.258288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.259193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.260324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.263849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca16e030-e6a5-4e5c-8fe7-a66d3298f6f3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.837456 Aug 30 18:23:56.264521 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1326/2758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:55 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:56.454985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4ba296-a8cd-4044-bf7f-f2673fa3b030", "name": "network-vif-plugged", "status": "completed", "tag": "16c94e46-6bcf-4761-ba97-4001eadebe43"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:23:56.485851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.486755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.488192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.517670 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] Creating event network-vif-plugged:16c94e46-6bcf-4761-ba97-4001eadebe43 for instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 on n-h2-854119-10 Aug 30 18:23:56.528358 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a3cd5198-5fa0-4b42-84b8-06efe6e6cfa4 req-9395c634-b4c1-44d0-a94e-6ba2eedce126 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078339 Aug 30 18:23:56.532105 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1327/2759] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:23:56.570372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:56.571567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:56.591213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.594079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.594857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.595940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:56.596832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:56.597449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:56.662268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:56.677789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1767240a-2510-4845-8515-6199e2a2ab42 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.457902 Aug 30 18:23:56.681864 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1433/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:56 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:57.170434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:57.186012 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-54ec3764-f599-41da-94e3-b3f38b5b915b tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1315 microversion: 2.1 time: 0.620229 Aug 30 18:23:57.186724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1328/2761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:56 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:57.300073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:57.304269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:57.328871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.330267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.333629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.335520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.343541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.354145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.493047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:57.730452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:57.742082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:57.791908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.795949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:57.797114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.797299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.805202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:57.806010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:57.808944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:57.811708 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07eb5c5f-68d2-4151-97fd-0df2e9ddeca5 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.522245 Aug 30 18:23:57.812348 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1434/2762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:57 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:58.226671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:58.228129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:58.242135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.243811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.244336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.246011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.247125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.247991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.329339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:58.364676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ede8e460-2bb4-4cc6-b4f7-6de905a74840 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.651727 Aug 30 18:23:58.367041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1329/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:57 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:58.496266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:58.513315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4dd28b83-85e1-4ad4-8b3b-3e3f1a7fe457 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1504 microversion: 2.1 time: 0.295362 Aug 30 18:23:58.522865 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1435/2764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:58 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:23:58.569579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:58.570611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:58.578442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:58.588134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.589598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.590834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.593105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.594213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.595110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.608911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:23:58.850536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:58.857965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:58.913077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e28b60a-4ab4-4f8c-9d76-32eb6517fb9f tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.352980 Aug 30 18:23:58.924093 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1330/2765] 10.222.0.25 () {58 vars in 1296 bytes} [Tue Aug 30 18:23:58 2022] DELETE /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030/os-server-password => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:58.924397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.943892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.943892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.947124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:58.948422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.949901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:58.954289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:58.963485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:58.995063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:58.998804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.000286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.006402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.011851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.013261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.124180 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a20c4ba-0cc5-4afa-b3d8-f116c6895ff6 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.198829 Aug 30 18:23:59.126062 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1331/2766] 10.222.0.25 () {58 vars in 1293 bytes} [Tue Aug 30 18:23:58 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030/os-server-password => generated 16 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:23:59.157391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:59.158576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:59.172670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.173783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.176567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.178419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.179683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.181099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.305907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:23:59.653514 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7cba7e73-6995-4766-beae-66a8ab3ecda0 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 204 len: 0 microversion: 2.1 time: 0.513016 Aug 30 18:23:59.661165 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1332/2767] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:23:59 2022] DELETE /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:23:59.674452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:23:59.678203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:59.680715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:59.698431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.702250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.703003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.704242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.704876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.705802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.708568 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e72a366-188d-45e3-9c27-ab8e416c080a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.877716 Aug 30 18:23:59.710572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1436/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:58 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:23:59.757581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:23:59.761046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:23:59.778280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.779776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.780813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:23:59.782840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:23:59.784497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:23:59.786420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:00.199472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:00.210001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a55a4d05-66d5-42b0-9f1e-2463151ac189 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1510 microversion: 2.1 time: 0.473053 Aug 30 18:24:00.231462 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1437/2769] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:59 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:00.305409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:00.327659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-caba9bcd-cacf-403b-8189-7df5e560c112 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.663157 Aug 30 18:24:00.328912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1333/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:23:59 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:00.756531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:00.758311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:00.779772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:00.782633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:00.784657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:00.797093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:00.799885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:00.801722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.261607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:01.262772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:01.278724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:01.283456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:01.284677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.286839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:01.289200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:01.290548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:01.291975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.327804 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a669c01-ab5d-4cac-92b2-f7903d4219ea tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.572901 Aug 30 18:24:01.341388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1438/2771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:00 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:01.372566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:01.373825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:01.405552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:01.406474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:01.407380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.408704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:01.418620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:01.434843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:01.786418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:01.813683 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e4fe471-1686-48d7-8fde-6fc8ca04db01 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.451964 Aug 30 18:24:01.824116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1439/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:01 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:02.257982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:02.270373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aeabb76d-7ed2-442e-bf52-0362fec0168e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1510 microversion: 2.1 time: 1.019331 Aug 30 18:24:02.282485 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1334/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:01 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1510 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:02.377034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:02.378965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:02.392944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.394475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.395620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:02.397158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.398262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.399338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:02.838312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:02.840364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:02.857386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.857836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.860540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:02.861871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:02.864684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:02.865241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.161493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:03.184428 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d907a0fc-ab95-40d5-8d59-735657706063 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 0.350279 Aug 30 18:24:03.185071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1335/2774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:02 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:03.199382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4ba296-a8cd-4044-bf7f-f2673fa3b030", "name": "network-vif-deleted", "tag": "16c94e46-6bcf-4761-ba97-4001eadebe43"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:03.214630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.215650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.216382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.233032 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] Creating event network-vif-deleted:16c94e46-6bcf-4761-ba97-4001eadebe43 for instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 on n-h2-854119-10 Aug 30 18:24:03.241157 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4978b536-59ec-4e09-9840-130b934eb760 req-bf9c2aab-fa29-4bbd-b867-617177627060 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050794 Aug 30 18:24:03.242668 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1336/2775] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:03.249814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:03.262784 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aecd3885-77cc-4765-9754-4674ec74e489 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.893488 Aug 30 18:24:03.263822 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1440/2776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:02 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:03.307988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:03.311546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:03.330054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.332934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.334815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.338105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.340406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.341500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.496825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:03.498752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:03.501924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:03.505659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lazy-loading 'fault' on Instance uuid be4ba296-a8cd-4044-bf7f-f2673fa3b030 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:24:03.595611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:03.618797 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8012741-7ef3-4cd8-9ede-9fea7dca46de tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1305 microversion: 2.1 time: 0.323536 Aug 30 18:24:03.638818 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1337/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:03 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1305 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:04.228875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:04.230098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:04.243452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.244675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.245608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.248849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.250608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.251664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.300429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:04.303686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:04.334646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.337919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.339415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.342335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.343684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.344428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.601862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:04.612647 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cfab9110-a588-4f4c-8028-1aa9d8736ea6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.326174 Aug 30 18:24:04.626737 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1338/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:04 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:04.662729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:04.663598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:04.685499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.686020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.686573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.687598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.688080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.688611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.764710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.765540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.766171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.766679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lazy-loading 'fault' on Instance uuid be4ba296-a8cd-4044-bf7f-f2673fa3b030 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:24:04.845948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23dcd1fad93e4c6c8bde99ef05b8887c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129c8fd3ab294833be1d5544574463d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:04.854624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa1fccf7-a5a9-458b-84ad-b797e3228471 tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 200 len: 1305 microversion: 2.1 time: 0.205836 Aug 30 18:24:04.855221 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1339/2779] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:04 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 1305 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:04.885667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "name": "network-vif-plugged", "status": "completed", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:04.906408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:04.907299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:04.907720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:04.923185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] Creating event network-vif-plugged:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h1-854119-10 Aug 30 18:24:04.933243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-39fc879c-28b6-496b-9a53-d8296596b5bf req-9f538f61-7619-4b24-9f06-2235933aeba6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051162 Aug 30 18:24:04.935936 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1340/2780] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:05.471719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:05.493576 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4c9e054-7554-4bae-9ada-61678860b944 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1313 microversion: 2.1 time: 1.271603 Aug 30 18:24:05.498169 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1441/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:04 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1313 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:05.642810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:05.646207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:05.663829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.667161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.667970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.669215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.669951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.670893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.899072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:05.900525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] [instance: be4ba296-a8cd-4044-bf7f-f2673fa3b030] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:05.901114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:05.910714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.911799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.912363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.913106 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5fdc4bf-e66a-4b09-9dcf-494168d59286 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.278619 Aug 30 18:24:05.913483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:05.914318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1341/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:05 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:05.914974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:05.915642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:05.946792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] HTTP exception thrown: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Request method failure captured: Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 HTTP/1.1 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlWqy52JyRrGRSheYpZiA9ZLM7vTvd2hCaNbwCxeaQp4T0x5SoLH-JZUgCCx_E0IP_kYfsRekiWjR1RR4nMB4mxGwQLfDGdzAHIcKMPR0dMbTfE09OMVchVxa5H0TUrumgeHOsH4i1XbpqKFXovXH4qeAOR8m8WwnodufnAzlWrd1II Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 129c8fd3ab294833be1d5544574463d0 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerPasswordTestJSON-1325281810 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/129c8fd3ab294833be1d5544574463d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/129c8fd3ab294833be1d5544574463d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/129c8fd3ab294833be1d5544574463d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_129c8fd3ab294833be1d5544574463d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerPasswordTestJSON-1325281810 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 129c8fd3ab294833be1d5544574463d0 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1325281810 Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerPasswordTestJSON-1325281810-project Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 23dcd1fad93e4c6c8bde99ef05b8887c Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerPasswordTestJSON-1325281810-project Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'be4ba296-a8cd-4044-bf7f-f2673fa3b030'} Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:05.953350 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] Returning 404 to user: Instance be4ba296-a8cd-4044-bf7f-f2673fa3b030 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-415a57a2-794f-405b-a06a-49e308b2094e tempest-ServerPasswordTestJSON-1325281810 tempest-ServerPasswordTestJSON-1325281810-project] 10.222.0.25 "GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030" status: 404 len: 111 microversion: 2.1 time: 0.063149 Aug 30 18:24:05.961822 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1442/2783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:05 2022] GET /compute/v2.1/servers/be4ba296-a8cd-4044-bf7f-f2673fa3b030 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:24:06.299721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0c6826-1924-4e10-935f-c6f6c5e409e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8c466c2b-4990-4d4e-9595-4c66c6ad6c44"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:06.343099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:06.349134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:06.355339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:06.432297 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] Creating event network-vif-unplugged:8c466c2b-4990-4d4e-9595-4c66c6ad6c44 for instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 on n-h1-854119-10 Aug 30 18:24:06.462669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7d6dbcd5-1c57-41bb-845a-2cb8a3d50898 req-575ab9cd-7247-4f9b-aa23-81eecfbff88d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166905 Aug 30 18:24:06.473231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1342/2784] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:06.561885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:06.578884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:06.656308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:06.657831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:06.659310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:06.664758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:06.666295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:06.668382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:06.965818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:06.979548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:07.024476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:07.027502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:07.039476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:07.044676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:07.048122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:07.057226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:07.409677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:07.442944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d93fd32a-f58d-4134-a7ef-c1c6728f890e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1463 microversion: 2.1 time: 0.919374 Aug 30 18:24:07.448743 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1443/2785] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:06 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1463 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:07.491271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:07.506479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:07.534450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:07.536705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:07.537163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:07.538196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:07.548730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:07.549219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:07.776163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:07.800252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:24:07.826919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:24:07.828353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:24:07.829805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:24:07.830284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:24:07.830957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:24:08.221629 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d41e14e7-085c-4d45-8966-aacecebded87 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e/action" status: 202 len: 0 microversion: 2.1 time: 0.755853 Aug 30 18:24:08.233487 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1444/2786] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:24:07 2022] POST /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:24:08.253701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:08.259384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:08.303898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:08.310060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:08.310920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:08.312272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:08.313097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:08.313913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:08.517239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:08.541816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-383facba-c4df-4c4a-a66c-d050ff0d5d14 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 1.595416 Aug 30 18:24:08.543845 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1343/2787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:06 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:08.557559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0c6826-1924-4e10-935f-c6f6c5e409e9", "tag": "8c466c2b-4990-4d4e-9595-4c66c6ad6c44"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:08.584680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:08.586466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:08.587144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:08.625416 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] Creating event network-changed:8c466c2b-4990-4d4e-9595-4c66c6ad6c44 for instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 on n-h1-854119-10 Aug 30 18:24:08.636147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-49b6b002-c80c-40c6-9d55-944a1049d1a8 req-206eea28-358e-4bf8-8739-724d6c10f134 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086096 Aug 30 18:24:08.637537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1344/2788] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:09.413173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:09.427467 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff2a336d-1895-4f8e-8c19-b9eac37c0e25 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1472 microversion: 2.1 time: 1.192104 Aug 30 18:24:09.428066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1445/2789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:08 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1472 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:09.579187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:09.585386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:09.655349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:09.658184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:09.658803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:09.678522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:09.679106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:09.684962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:10.462334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:10.466893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:10.484211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:10.485100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:10.485813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:10.491222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:10.501346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:10.502331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:11.093888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:11.146973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f02ba0f-50c9-40f2-97c5-f85760fa91d6 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 1.578008 Aug 30 18:24:11.162790 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1345/2790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:09 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:11.535752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:11.556583 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3a18554-4cfe-4d86-9ee9-d48f5cddad08 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1472 microversion: 2.1 time: 1.097016 Aug 30 18:24:11.559879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1446/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:10 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1472 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:12.178483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:12.180392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:12.192873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.197818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.200341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:12.205583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.210917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.211770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:12.308677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:12.592117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:12.598131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:12.633874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.637873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.640241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:12.641965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:12.643260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:12.644360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:13.691059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:13.737136 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-601f0c7e-b3ab-4302-9565-e2babc96ce91 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 1.559253 Aug 30 18:24:13.754235 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1346/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:12 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:13.811782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:13.854296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-547159e2-d036-4ed9-8d38-7f78d1aeef65 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1472 microversion: 2.1 time: 1.267107 Aug 30 18:24:13.856627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1447/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:12 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1472 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:14.767780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:14.769116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:14.787275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:14.788235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:14.801637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:14.803902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:14.804839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:14.812504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:14.900352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:14.903205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:14.918314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:14.919623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:14.925636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:14.928641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:14.929754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:14.931063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:15.438579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:15.447579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-688724fa-4832-4ee6-bf3a-801f59dba74f tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.685993 Aug 30 18:24:15.448861 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1347/2794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:14 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:16.021518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:16.040624 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20830bb8-c9bb-4f4c-b6ab-a87eee93b8ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1472 microversion: 2.1 time: 1.157482 Aug 30 18:24:16.042499 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1448/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:14 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1472 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:16.491689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:16.495804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:16.523823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:16.525124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:16.526089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:16.527632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:16.528698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:16.529410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:16.965678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:16.998329 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2408f15a-cbb8-4241-9bfb-ba9925199741 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.514538 Aug 30 18:24:17.006521 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1348/2796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:16 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:17.076371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:17.077391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:17.092478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=62 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:17.101768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:17.107466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:17.108536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:17.111670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:17.112778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:17.114060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:17.907694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:17.940778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e1445ea-a5f4-4e0a-9149-24fe0c3bab5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.871637 Aug 30 18:24:17.954405 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1449/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:17 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:18.027103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:18.029389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:18.066706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.071331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.074265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.077229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:18.078494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:18.080683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:18.817349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:18.828413 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba1b00c3-0c34-437f-b76f-7798e05d4a6d tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 0.809650 Aug 30 18:24:18.829685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1349/2798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:18 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:19.011683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:19.023013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:19.042264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:19.043379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:19.044189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:19.046842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:19.048113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:19.050012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:19.139392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:19.734130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:19.750844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-355e40c0-41a4-4406-b1aa-6c813c053dc6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.762202 Aug 30 18:24:19.754197 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1450/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:18 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:19.867881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:19.868907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:19.909039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-54296424", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "57fd08f0-09fa-4a6f-826c-c3d1384dcc59"}, {"uuid": "c2c7308a-28c0-4672-a58f-0ad57c897c17"}, {"uuid": "57fd08f0-09fa-4a6f-826c-c3d1384dcc59"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:19.920691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:19.928270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:19.939467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:19.947921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:19.951050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:19.954782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:20.041397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] validate_networks() for [('57fd08f0-09fa-4a6f-826c-c3d1384dcc59', None, None, None, None, None), ('c2c7308a-28c0-4672-a58f-0ad57c897c17', None, None, None, None, None), ('57fd08f0-09fa-4a6f-826c-c3d1384dcc59', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:24:21.199308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:21.238433 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28297cfd-c7c6-470d-869e-116a536e891a tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1392 microversion: 2.1 time: 1.374608 Aug 30 18:24:21.243767 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1350/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:19 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1392 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:21.269878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:21.275662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:21.310877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:21.315160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:21.316164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:21.323911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:21.325719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:21.327339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.176303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:22.259315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ce011f7-8ec5-4f96-a7c9-1c36dfd3228b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 1.012653 Aug 30 18:24:22.265945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1351/2801] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:21 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:22.286729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:22.290583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:22.329469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.330251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.331332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.332233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.332795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.338483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.901446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:24:22.902168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:24:22.902603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:24:22.903607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:24:22.904108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:24:22.931384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.931886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.932335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:22.938126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:22.938674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:22.943456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.004797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Getting quotas for project 65cdf3112b234567bcff894747ab473b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:24:23.013743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Getting quotas for user c1f05e9577a24221b139025ca597ffa1 and project 65cdf3112b234567bcff894747ab473b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:24:23.048302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:24:23.051731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:24:23.225054 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d1de5da-8f22-4efb-8361-cd879ec84449 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317161 Aug 30 18:24:23.230541 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1451/2802] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:24:23.279632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3f83645-a74b-4f1a-963d-852dee306d3c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:23.280964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3f83645-a74b-4f1a-963d-852dee306d3c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:23.522518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:23.551248 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58d509b1-8878-4580-85e9-4e49e3952626 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1382 microversion: 2.1 time: 1.282418 Aug 30 18:24:23.555967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1352/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:22 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1382 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:23.609130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:23.614579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:23.633255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.640397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.644032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.651367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.652762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.655064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.679703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3f83645-a74b-4f1a-963d-852dee306d3c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:23.716890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3f83645-a74b-4f1a-963d-852dee306d3c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1211 microversion: 2.1 time: 0.465252 Aug 30 18:24:23.718065 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1452/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:23 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1211 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:23.767428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8d12f80-7112-4c00-8e92-384f28f44a0c tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '.version_select at 0x7f4e5694d790>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:23.778739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d12f80-7112-4c00-8e92-384f28f44a0c tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.786630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d12f80-7112-4c00-8e92-384f28f44a0c tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.790811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d12f80-7112-4c00-8e92-384f28f44a0c tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.840934 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8d12f80-7112-4c00-8e92-384f28f44a0c tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2363 microversion: 2.1 time: 0.092098 Aug 30 18:24:23.846757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1453/2805] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:24:23 2022] GET /compute/v2.1/os-migrations => generated 2363 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:23.893889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:23.896943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:23.935164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.944126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.947830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:23.949134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:23.949949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:23.950747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.314253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbac63c6-f764-4d02-85eb-395d05b52a75 tempest-LiveMigrationTest-2025295616 tempest-LiveMigrationTest-2025295616-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1535 microversion: 2.1 time: 0.429527 Aug 30 18:24:24.314914 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1454/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:23 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1535 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:24.371162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:24.371756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:24.387097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.388303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.388571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.390014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.393489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.394058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.447923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:24:24.609541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:24.637439 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-888fbf46-1649-445c-b380-38439a9de13b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 1.057147 Aug 30 18:24:24.638419 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1353/2807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:23 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:24.707916 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8a5f798-fc5a-4372-bf87-ca056ca2eced tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 204 len: 0 microversion: 2.1 time: 0.340810 Aug 30 18:24:24.719917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1455/2808] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:24:24 2022] DELETE /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:24:24.732885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:24.739022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:24.753633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.755093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.756476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.757869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:24.759037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:24.760065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:24.772769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed4ad9b7-169f-45fd-b5a8-e30cb159afc9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:24.773958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed4ad9b7-169f-45fd-b5a8-e30cb159afc9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:25.016863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed4ad9b7-169f-45fd-b5a8-e30cb159afc9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:25.052100 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed4ad9b7-169f-45fd-b5a8-e30cb159afc9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1211 microversion: 2.1 time: 0.287184 Aug 30 18:24:25.053802 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1456/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:24 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1211 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:25.272350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:25.286902 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62fceb91-bf5a-4686-923f-606413d69939 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1388 microversion: 2.1 time: 0.562128 Aug 30 18:24:25.289303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1354/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:24 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1388 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:25.663808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:25.664684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:25.680685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:25.681699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:25.682539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:25.683658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:25.684714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:25.685334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.086853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:26.089157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:26.112357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.113676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.114842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.116555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.117729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.118903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.263132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:26.287722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:26.298477 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c3ec1c3-de86-4d3f-8760-3e541fd83452 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1263 microversion: 2.1 time: 0.209016 Aug 30 18:24:26.300052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1355/2811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:26 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:26.322335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8184429-d820-41ee-a528-9c99009efd56 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.664917 Aug 30 18:24:26.324592 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1457/2812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:25 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:26.328563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:26.329290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:26.337348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.339960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.340841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.342492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.343279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.343823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.848051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:26.859085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9ba241d-c70d-4197-866a-a05447f9aeaa tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1388 microversion: 2.1 time: 0.546957 Aug 30 18:24:26.863462 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1356/2813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:26 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1388 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:26.926906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0c6826-1924-4e10-935f-c6f6c5e409e9", "name": "network-vif-deleted", "tag": "8c466c2b-4990-4d4e-9595-4c66c6ad6c44"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:26.960419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:26.960901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:26.964673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:26.997547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] Creating event network-vif-deleted:8c466c2b-4990-4d4e-9595-4c66c6ad6c44 for instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 on n-h2-854119-10 Aug 30 18:24:27.010734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c4ee01f4-e101-4a2b-8af7-070d5ca57919 req-78adc251-15dd-45f5-ab58-a228732307a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088799 Aug 30 18:24:27.018609 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1458/2814] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:27.324526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:27.325346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:27.338111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.343339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.343825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.344884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.348622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.349520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.353175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:27.354073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:27.417789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.424400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.427586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.433200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.436872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.444531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.517181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:27.529836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-387a95cf-b766-4c59-a869-18f37ae4063e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1269 microversion: 2.1 time: 0.209290 Aug 30 18:24:27.539812 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1357/2815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:27 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:27.850847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:27.870379 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e3bcfef-3183-4b1c-b24e-da737aeac16b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.525438 Aug 30 18:24:27.872679 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1459/2816] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:27 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:27.885845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:27.886888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:27.915564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.919546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.921414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:27.927470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:27.937935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:27.939038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:28.178633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:28.192549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30cc164e-b238-4afd-9141-70ea4d27af06 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1184 microversion: 2.1 time: 0.310308 Aug 30 18:24:28.192777 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1358/2817] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:27 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1184 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:28.569551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:28.570685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:28.617437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.618048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.619541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:28.620371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.623226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.627549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:28.897347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:28.899177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:28.909746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:28.916276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.917493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.919247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:28.923944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:28.925061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:28.927182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:29.373139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:29.386125 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8a2fe943-3b1e-4458-87a9-ce3f65a48414 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.492943 Aug 30 18:24:29.387695 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1359/2818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:28 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:29.394605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:29.396097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:29.404678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:29.405771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:29.407208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:29.408250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:29.408922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:29.409573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:29.651474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:29.682144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24db21e6-f85b-40a4-8563-83dea024703b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1311 microversion: 2.1 time: 1.119519 Aug 30 18:24:29.713221 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1460/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:28 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1311 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:29.753194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:29.772523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e823cdd4-3314-4dd7-b974-79d205989a84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1184 microversion: 2.1 time: 0.379563 Aug 30 18:24:29.773554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1360/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:29 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1184 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:30.434561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:30.435719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:30.460684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.461835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.462281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:30.467908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.468755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.469426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:30.905191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:30.936612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-46900cb2-b774-4ed4-9c19-b67047b331e6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.504994 Aug 30 18:24:30.937623 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1461/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:30 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:30.955506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:30.958268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:30.979000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.983019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.986527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:30.988089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:30.989060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:30.989724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.007711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Calling method '.version_select at 0x7f4e5ae854c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:31.014022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.016056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.017774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.066784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.068040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.069119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.093426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.094728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.096009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.108690 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56336ae6-745a-4e82-8e30-153d9f3c9038 tempest-PortsAdminExtendedAttrsTestJSON-1723568386 tempest-PortsAdminExtendedAttrsTestJSON-1723568386-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.548244 Aug 30 18:24:31.110104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1361/2822] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:24:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:24:31.120627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:31.122262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:31.131782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.133044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.134047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.135351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.136164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.136855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.316226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:31.319276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:31.328912 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2af1b6c-6015-447e-9a32-ec8c19f5e24e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1184 microversion: 2.1 time: 0.216969 Aug 30 18:24:31.335544 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1362/2823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:31 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1184 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:31.474246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:31.490762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-418fb24d-38a3-4e3f-99ba-effa4081c330 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1332 microversion: 2.1 time: 0.551235 Aug 30 18:24:31.496500 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1462/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:30 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1332 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:31.961088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:31.961932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:31.985527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.986209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.986975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:31.987912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:31.988569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:31.989181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.357485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:32.358534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.378436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.378935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.379386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.380141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.380608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.381037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.518110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:32.544281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c89b7310-2f25-42aa-968e-06603d65118e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1184 microversion: 2.1 time: 0.190404 Aug 30 18:24:32.551236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1463/2825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:32 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1184 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:32.557288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:32.558299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:32.565511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.566949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.567754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.569186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:32.569913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:32.570673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:32.980245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:33.131233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:33.170753 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73e9f0fb-9b9e-4227-8e95-9391e063f1b3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 1.213353 Aug 30 18:24:33.174047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1363/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:31 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:33.284736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:33.299608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a6f9c66-fcb8-4925-bfd4-954e90c9ad9b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.745617 Aug 30 18:24:33.300798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1464/2827] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:32 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:33.594228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:33.595300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:33.621655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:33.622558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:33.623430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:33.624805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:33.625652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:33.626467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:33.924591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:33.957619 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98428be2-a1da-4296-9aeb-94e66db9afd3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 200 len: 1184 microversion: 2.1 time: 0.371145 Aug 30 18:24:33.972121 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1364/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:33 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 1184 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:34.206207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:34.211220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:34.244761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.246296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.247633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.249334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.253824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.255055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.342653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:34.344469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:34.360467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.360934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.361390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.362197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:34.362695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:34.363451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:34.511790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:34.529244 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf073bf6-2034-46c2-b4e6-8c42e3c66b9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.332564 Aug 30 18:24:34.530916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1465/2829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:34 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:35.012985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:35.013728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 2b0c6826-1924-4e10-935f-c6f6c5e409e9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:35.025024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:35.032848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.033468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.034387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:35.035132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.038783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.039321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:35.085692 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] HTTP exception thrown: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Request method failure captured: Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 HTTP/1.1 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlPkN57RNe-hdOUKuaZ9_fIeWgEJ7P4PxNKER9iTEM5v3GGG1lvDDohxUJNEbCBD-KDNFv61mB2xbOXe-TMU3Jutjp2YTTgPSBmAofu9n5bU0uBPIOMWfpuaWj3aE38FfQUNowEDYNlJVfTpjAjdj8zTvOrjFa9VW1qLIefC9zjaBWs Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d91f68afbea64466b5abc3357706730a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d91f68afbea64466b5abc3357706730a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-LiveMigrationTest-755123638 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-LiveMigrationTest-755123638-project Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-LiveMigrationTest-755123638-project Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '2b0c6826-1924-4e10-935f-c6f6c5e409e9'} Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:35.087787 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. Aug 30 18:24:35.092107 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:24:35.097223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Returning 404 to user: Instance 2b0c6826-1924-4e10-935f-c6f6c5e409e9 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:24:35.105707 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b5a868e-9d8e-4d3f-b809-89c78cbe9c85 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9" status: 404 len: 111 microversion: 2.1 time: 0.095860 Aug 30 18:24:35.107190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1466/2830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:35 2022] GET /compute/v2.1/servers/2b0c6826-1924-4e10-935f-c6f6c5e409e9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:24:35.164198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:35.196550 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-455ede47-21cc-45c4-9f69-ede22c4185e7 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.854043 Aug 30 18:24:35.206552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1365/2831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:34 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:35.553045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:35.553890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:35.565444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.565948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.566442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:35.567182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:35.567695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:35.568072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.003375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:36.016319 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a32da39b-3b33-4211-b522-375f9663d324 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 0.467233 Aug 30 18:24:36.017137 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1467/2832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:35 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:36.202545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "tag": "9c807ad0-b557-4c33-b6ea-57b56b0ec935"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:36.220279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:36.220780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:36.221230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.234691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:36.235854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:36.249057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:36.253487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:36.262609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.281722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:36.282532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:36.283143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:36.340554 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] Creating event network-changed:9c807ad0-b557-4c33-b6ea-57b56b0ec935 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:24:36.346822 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2904752b-86db-4920-b65e-39a28456bfa8 req-b3545664-6cd5-4e3e-943d-449f8263628a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264360 Aug 30 18:24:36.347868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1366/2833] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:24:37.051683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:37.052595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:37.070301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:37.080996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:37.081722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:37.088398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:37.089634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:37.091051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:37.385561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:37.415616 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f02472a-956d-4242-9d26-f4c0ce14d211 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 1.185296 Aug 30 18:24:37.416421 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1468/2834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:36 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:38.074716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:38.107763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-815a073f-10c9-4022-b8e1-6a76f94f8fc2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1477 microversion: 2.1 time: 1.060730 Aug 30 18:24:38.129315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1367/2835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:37 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1477 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:38.442498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:38.456313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:38.503242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:38.504561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:38.507132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:38.511426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:38.515453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:38.516559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:39.137823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:39.140246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:39.171368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:39.177021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:39.177675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:39.178160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:39.184057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:39.190104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:39.190722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:39.198410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-def8cfdf-8a76-470f-94a1-acfca28924b5 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.763700 Aug 30 18:24:39.212463 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1469/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:38 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:40.230119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:40.236446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:40.272524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:40.277866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:40.280397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:40.284869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:40.286693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:40.290482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:40.408158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:40.790754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:40.805549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6e09faa-7f94-4c11-bf5b-f15843ec3d7e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1476 microversion: 2.1 time: 1.671168 Aug 30 18:24:40.806919 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1368/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:39 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1476 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:40.821722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "name": "network-vif-unplugged", "status": "completed", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:40.847508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:40.858221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:40.860508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:40.861607 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae36300b-083c-42ce-87f6-af3a5b6f658b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.640047 Aug 30 18:24:40.861974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1470/2838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:40 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:40.863379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:40.891528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Creating event network-vif-unplugged:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h2-854119-10 Aug 30 18:24:40.906235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] Instance cdb0077d-d700-47a5-88f0-567d2c8e527e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:24:40.939178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7b712e2c-514f-4619-a919-1c8c5b41b40f req-99cdf1d7-e3c8-42e1-bcd8-4be43dec0212 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124046 Aug 30 18:24:40.940552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1369/2839] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:41.184705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "tag": "cbd12e0f-5f51-4c75-b5d2-e40739055a68"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:41.204122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:41.209560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:41.210463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:41.234765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] Creating event network-changed:cbd12e0f-5f51-4c75-b5d2-e40739055a68 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:24:41.254145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-96754491-f566-4047-8d94-73a683ecf676 req-8680c561-399c-40c6-8d92-b67b5751202c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073062 Aug 30 18:24:41.255023 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1471/2840] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:24:41.877364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:41.879870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:41.954176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:41.956307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:41.993670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:41.999063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.002714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.004308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.013817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.021258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.030510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.036503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.040377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.042968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.048157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.053808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.869408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:42.885597 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a8ce477-aa9e-4f85-8d27-e164678ac2db tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1476 microversion: 2.1 time: 1.038402 Aug 30 18:24:42.886863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1370/2841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:41 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1476 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:42.921889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:42.924324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:42.941850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.956973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.961433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:42.962984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:42.964231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:42.965610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:43.061887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:24:43.271224 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e818ed1-f481-428c-b40d-67c697eabc73 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 204 len: 0 microversion: 2.1 time: 0.358873 Aug 30 18:24:43.271224 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1371/2842] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:24:42 2022] DELETE /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:24:43.287828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:43.293356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:43.307631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:43.309781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:43.312190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:43.313100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:43.316770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:43.316770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:43.876900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:43.888233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78d8c5a3-d917-4c13-b5ae-14464d96be37 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 1.990935 Aug 30 18:24:43.889797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1472/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:41 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:43.896022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:43.909878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:43.910876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:43.911805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:43.949890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Creating event network-changed:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h2-854119-10 Aug 30 18:24:43.980085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] Instance cdb0077d-d700-47a5-88f0-567d2c8e527e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:24:44.001807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0429705c-5ae1-4021-b816-2c99c62974bd req-d3db2ce6-031e-4491-8c24-acd135ddd0fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110142 Aug 30 18:24:44.003504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1473/2844] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:44.011094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "tag": "382085cf-42ca-424c-8bfe-a37d26606e56"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:44.044341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:44.045670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:44.046303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:44.064964 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] Creating event network-changed:382085cf-42ca-424c-8bfe-a37d26606e56 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:24:44.072059 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5106ab0f-f5d1-475b-9b6f-e1f55e4c8e9f req-3eac9a5e-dbc7-4285-9a45-d667715bcffa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066236 Aug 30 18:24:44.073015 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1474/2845] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:44.081235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:44.082420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:44.097086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:44.097922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:44.098783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:44.100325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:44.100963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:44.101572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:44.157079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:44.167210 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36e999d0-8e48-44f3-8b26-298e6db5af25 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1666 microversion: 2.1 time: 0.890280 Aug 30 18:24:44.183344 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1372/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:43 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1666 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:44.728684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:44.743208 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-329e1595-0310-4271-8bc5-bb4f68abadbd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1476 microversion: 2.1 time: 0.667036 Aug 30 18:24:44.744398 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1475/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:44 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:44.914331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:44.916783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:44.927350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:44.928269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:44.928966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:44.930621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:44.930796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:44.931248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:45.197960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:45.200371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:45.242174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:45.249258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:45.252234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:45.259405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:45.262923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:45.264099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:46.093362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:46.111147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7fd7cfad-7a63-492a-9d84-176214ef4a4b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 1.203389 Aug 30 18:24:46.112471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1373/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:44 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:46.116312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:46.125506 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c273e60f-98eb-4307-9033-f8a4727a5c84 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1666 microversion: 2.1 time: 0.938142 Aug 30 18:24:46.126836 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1476/2849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:45 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1666 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:46.135970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:46.137877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:46.151544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:46.152685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:46.153907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:46.155754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:46.157235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:46.158460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:46.827863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:46.844143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77782b3f-ce27-45f8-be89-8cf8768f3123 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1474 microversion: 2.1 time: 0.729257 Aug 30 18:24:46.859113 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1374/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:46 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1474 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:47.151915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:47.152915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:47.154624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:47.155210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:47.167127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.168374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.168555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:47.169616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.171187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.172484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.173371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.174686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.175757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.177095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.179057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.180758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.182079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.543239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:47.554171 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31f1eda2-7548-4b15-989f-d15659c615e7 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1599 microversion: 2.1 time: 0.409151 Aug 30 18:24:47.556514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1375/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:47 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1599 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:47.693013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:47.708145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ede81ef-3414-4479-b9d5-1792a9f57957 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.567738 Aug 30 18:24:47.711652 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1477/2852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:47 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:47.878274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:47.879112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:47.890953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.898510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.899302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:47.900379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:47.901144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:47.901840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.372709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ec2dff-1f3a-420f-92c0-13c63d54c6f6", "name": "network-vif-deleted", "tag": "b902dfb3-566f-4b5d-ab44-15f1adca1d82"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:48.396881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:48.402021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.403729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.405461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.433208 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] Creating event network-vif-deleted:b902dfb3-566f-4b5d-ab44-15f1adca1d82 for instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 on n-h1-854119-10 Aug 30 18:24:48.441185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7fc6749-2bcb-4b2c-a60d-63e03a3a5952 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.563572 Aug 30 18:24:48.443015 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1376/2853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:47 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:48.445459 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-67592081-886f-412f-aebc-43d3c0012ac4 req-986b69db-91b1-4032-bd3c-09302f02b3d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077360 Aug 30 18:24:48.448182 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1478/2854] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:24:48.497525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:48.499187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:48.511806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.512873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.514283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.516334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.518264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.518943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.581274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:48.583151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:48.598711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.602483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.603149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.608859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.609738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.610382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.679281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:48.702593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.703381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.704119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.704759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lazy-loading 'fault' on Instance uuid c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:24:48.735119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ce4b13e-c1cc-48fc-8e26-e9fceee4d0a2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e/action" status: 204 len: 0 microversion: 2.1 time: 0.257057 Aug 30 18:24:48.746157 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1377/2855] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:24:48 2022] POST /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e/action => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:24:48.752277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:48.753000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:48.802186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.802968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.803718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:48.805188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:48.805916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:48.815585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:49.449903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:49.468567 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0eb6c76e-ba8d-4de6-9056-1d0c659181f2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.720903 Aug 30 18:24:49.478452 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1378/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:48 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:49.484179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:49.487222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:49.496470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:49.507857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:49.508583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:49.509639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:49.510399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:49.511076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:49.837683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:49.849904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68884e6c-d9cf-4dc3-8e29-d9901c4c6172 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 200 len: 1324 microversion: 2.1 time: 1.274341 Aug 30 18:24:49.855030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1479/2857] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:48 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 1324 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:50.160740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:50.170648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-274e1da5-c656-40dd-b24d-78ef896665d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.690387 Aug 30 18:24:50.176738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1379/2858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:49 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:50.516687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:50.517563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:50.529056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.531318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.531995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:50.533173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.533832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.536061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:50.899445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:50.903968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: c0ec2dff-1f3a-420f-92c0-13c63d54c6f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:50.932636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.934550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.937214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:50.943265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:50.944649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:50.945482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:51.003473 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] HTTP exception thrown: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Request method failure captured: Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 HTTP/1.1 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPkN57RNe-hdOUKuaZ9_fIeWgEJ7P4PxNKER9iTEM5v3GGG1lvDDohxUJNEbCBD-KDNFv61mB2xbOXe-TMU3Jutjp2YTTgPSBmAofu9n5bU0uBPIOMWfpuaWj3aE38FfQUNowEDYNlJVfTpjAjdj8zTvOrjFa9VW1qLIefC9zjaBWs Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d91f68afbea64466b5abc3357706730a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d91f68afbea64466b5abc3357706730a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationTest-755123638 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationTest-755123638-project Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationTest-755123638-project Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'c0ec2dff-1f3a-420f-92c0-13c63d54c6f6'} Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:24:51.014857 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. Aug 30 18:24:51.021805 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:24:51.023651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:51.027341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Returning 404 to user: Instance c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:24:51.031007 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cad2a72d-d362-4d75-9825-98f6ce8875f9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6" status: 404 len: 111 microversion: 2.1 time: 0.154697 Aug 30 18:24:51.034315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1380/2859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:50 2022] GET /compute/v2.1/servers/c0ec2dff-1f3a-420f-92c0-13c63d54c6f6 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:24:51.048263 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c2797549-8f84-4376-8632-36a265e10589 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.538001 Aug 30 18:24:51.051095 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1480/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:50 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:51.055738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba20486f-3d44-4400-afd8-d04552f5a2a1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '.version_select at 0x7f4e55d175e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:51.115900 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba20486f-3d44-4400-afd8-d04552f5a2a1 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637583441" status: 202 len: 0 microversion: 2.1 time: 0.072518 Aug 30 18:24:51.118610 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1381/2861] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637583441 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:24:51.219827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:51.220450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:51.229927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:51.230460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:51.230905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:51.235536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:51.236048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:51.236468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:51.825356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:51.835715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21935b95-f124-48e8-b22d-7aebe2c78314 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.618888 Aug 30 18:24:51.837144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1481/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:51 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:52.078067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:52.080539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:52.118692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.119935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.123377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.125011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.128275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.131404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.557307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "name": "network-vif-plugged", "status": "completed", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:52.574988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.576333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.577377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.606848 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Creating event network-vif-plugged:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h2-854119-10 Aug 30 18:24:52.619430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] Instance cdb0077d-d700-47a5-88f0-567d2c8e527e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:24:52.648705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3c2ff795-d897-4212-85a0-017dcbc9b1e9 req-a560b514-9e23-4cda-9685-59687c7ae386 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.755008 Aug 30 18:24:52.652341 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1382/2863] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:52.897666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:52.907930 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34d1324f-bc4d-4b16-8ac1-4772f8910939 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.837960 Aug 30 18:24:52.911017 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1482/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:52 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:52.915958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:52.916589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:52.944112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.951446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.952038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:52.952858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:52.953445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:52.953926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.010620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:53.014608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:53.036693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.041293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.044144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.050843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.053849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.065302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.150240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:24:53.494493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b69edc4f-87d5-45f5-871c-6918deff461d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 204 len: 0 microversion: 2.32 time: 0.801236 Aug 30 18:24:53.499147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1383/2865] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:24:52 2022] DELETE /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 18:24:53.509948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:53.519115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:53.535927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.536480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.537025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:53.538061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:53.538658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:53.539331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:54.081787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:54.093564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-505d24d4-1ec3-409c-afa8-10bed7ca9f89 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 1.181352 Aug 30 18:24:54.100413 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1483/2866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:52 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:54.115257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:54.116135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:54.136506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:54.137374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:54.138005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:54.139016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:54.139684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:54.140283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:54.460501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:54.471893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f1a73fd-4dc0-4c73-a625-0cc443a34aa9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.367463 Aug 30 18:24:54.472844 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1484/2867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:54 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:55.136775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:55.137611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:55.138186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:55.149848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.150794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.151399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.153080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.154389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.155643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.159786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:55.162863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:55.165120 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b95894f0-b8c3-4497-9b5c-17eae450fa83 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2957 microversion: 2.32 time: 1.660278 Aug 30 18:24:55.166881 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1384/2868] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:24:53 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2957 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:24:55.517900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:55.518918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:55.526920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.528223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.528922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.530592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.531240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.531835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.722503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:55.732848 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b5f8f9ac-e96d-438d-9a68-2956f026f785 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.602915 Aug 30 18:24:55.734933 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1485/2869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:55 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:55.837940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:55.838526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:55.851257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.851765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.854911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.856730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:55.858651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:55.861311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:55.958179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:24:56.156252 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-35741923-6d4f-407b-b2dc-7e53d7a4b288 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 204 len: 0 microversion: 2.1 time: 0.321737 Aug 30 18:24:56.159111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1486/2870] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:24:55 2022] DELETE /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:24:56.176380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:56.178130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:56.199360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.200387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.201154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.202136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.202837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.203521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.273139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:56.373117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:56.386221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fde64e65-54d1-4227-92c2-3cb1a7077c8d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1471 microversion: 2.1 time: 0.872937 Aug 30 18:24:56.407784 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1385/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:55 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1471 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:56.426430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:56.427465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:56.446380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.450736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.451365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.452207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.452885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.453320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.624386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:56.635415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d8356d4-cb97-43b5-98ae-1e4a589f5967 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1483 microversion: 2.1 time: 0.470147 Aug 30 18:24:56.636448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1487/2872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:56 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1483 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:56.772522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:56.784027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:56.792881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.793774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.794512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:56.795690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:56.796406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:56.797320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:57.187594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:57.205644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:57.209344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:57.217368 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db45ddcd-2f85-469d-97e3-3eeda544c7e4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2957 microversion: 2.32 time: 0.805520 Aug 30 18:24:57.219317 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1386/2873] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:24:56 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2957 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:24:57.346194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:57.406496 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22aa6976-5060-4119-9f3d-970339f01f14 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.638927 Aug 30 18:24:57.407634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1488/2874] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:56 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:57.456494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:57.458855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:57.475948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:57.476705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:57.477378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:57.478468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:57.479206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:57.479827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:57.669972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:57.673206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:57.706380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:57.708980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:57.709814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:57.710984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:57.713939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:57.718294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:58.463804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:58.491099 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d9ea78a-b35d-44a9-9d8c-538b8880b5b4 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 200 len: 1483 microversion: 2.1 time: 0.830758 Aug 30 18:24:58.492446 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1489/2875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:57 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 1483 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:24:58.513447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:58.515585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:58.543287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:58.551580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:58.552831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:58.563856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:58.565094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:58.566231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.110082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.123476 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a09c5d42-6b9b-4918-852d-e834d22aee81 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1463 microversion: 2.1 time: 1.684634 Aug 30 18:24:59.139924 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1387/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:57 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1463 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:59.149376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e205299d-24e0-4590-8fc1-56049633da57", "name": "network-vif-deleted", "tag": "ec8c3812-2bf8-407d-8304-923f91c32b3b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:59.164526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:24:59.169243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.171462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.172576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.202903 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] Creating event network-vif-deleted:ec8c3812-2bf8-407d-8304-923f91c32b3b for instance e205299d-24e0-4590-8fc1-56049633da57 on n-h1-854119-10 Aug 30 18:24:59.210299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0bc98f58-59ab-4d41-a347-8a4ad73f91ff req-4149c5ba-9360-4ae4-8eb2-08f1f8b7b5c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068154 Aug 30 18:24:59.211649 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1388/2877] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:59.218239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:59.219264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:59.226507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.227316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.227923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.228834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.229479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.230105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.539721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.584994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.592179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.595977 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8886d18-6432-4f37-b766-d9473b0f2565 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2936 microversion: 2.32 time: 1.100108 Aug 30 18:24:59.597495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1490/2878] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:24:58 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2936 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:24:59.613784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "42940854-ee1d-4fa4-a985-343440ca2eb8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:24:59.637727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.639039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.640021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.665532 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] Creating event network-vif-unplugged:42940854-ee1d-4fa4-a985-343440ca2eb8 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:24:59.678569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c2115e39-da56-4345-8c69-439964ab34a2 req-e36d12f8-700f-4561-9d07-e754afe8db08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078443 Aug 30 18:24:59.681265 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1491/2879] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:24:59.702562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:59.704219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:24:59.722291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.723589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.724603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.727292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:24:59.729228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:24:59.730274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:24:59.956696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:24:59.988529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-978eb21f-3326-4a7a-a01e-2eb68185c46a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.774266 Aug 30 18:24:59.992574 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1389/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:59 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:24:59.998124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:24:59.999355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: e205299d-24e0-4590-8fc1-56049633da57] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:00.007958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.008648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.009951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.013298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.016143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.017220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.044640 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] HTTP exception thrown: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Request method failure captured: Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 HTTP/1.1 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPkN57RNe-hdOUKuaZ9_fIeWgEJ7P4PxNKER9iTEM5v3GGG1lvDDohxUJNEbCBD-KDNFv61mB2xbOXe-TMU3Jutjp2YTTgPSBmAofu9n5bU0uBPIOMWfpuaWj3aE38FfQUNowEDYNlJVfTpjAjdj8zTvOrjFa9VW1qLIefC9zjaBWs Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d91f68afbea64466b5abc3357706730a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d91f68afbea64466b5abc3357706730a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationTest-755123638 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationTest-755123638-project Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationTest-755123638-project Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e205299d-24e0-4590-8fc1-56049633da57'} Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:00.046587 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. Aug 30 18:25:00.051147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:00.052790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Returning 404 to user: Instance e205299d-24e0-4590-8fc1-56049633da57 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:00.053975 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1cee926-00e7-4f16-a26a-51ffed79e630 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57" status: 404 len: 111 microversion: 2.1 time: 0.060067 Aug 30 18:25:00.055455 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1390/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:59 2022] GET /compute/v2.1/servers/e205299d-24e0-4590-8fc1-56049633da57 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:00.071803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:00.074986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:00.076522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:00.084098 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9115b84-1796-4ca0-a92b-3dba9b2233bb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1463 microversion: 2.1 time: 0.390273 Aug 30 18:25:00.087885 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1492/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:24:59 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1463 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:00.091911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.092842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.093824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.094787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.095409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.096324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.118452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18a250d7-f2a0-44ab-9acf-b22e878e9a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'create', calling method: .version_select at 0x7f4e56d79550>, body: {"keypair": {"name": "tempest-keypair-1545758201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8X9FqN1erJ/xWK0fwTxYFz4TT/9WCe0ZE+571dGQWmQY/1hBQxIUDM/SBanMkHpuVYctdgR2UFu81e1/iHTNbuHXLof6DV5uuPYLak6yJBw6x0TaY06uf3gbqsL2d3kw=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:00.144859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:00.147593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-18a250d7-f2a0-44ab-9acf-b22e878e9a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:00.158825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-18a250d7-f2a0-44ab-9acf-b22e878e9a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:00.208824 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18a250d7-f2a0-44ab-9acf-b22e878e9a9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099227 Aug 30 18:25:00.210471 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1493/2883] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:25:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:00.336727 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-845ba8af-b93d-47b0-816d-6e78437546ed tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 204 len: 0 microversion: 2.1 time: 0.270315 Aug 30 18:25:00.346006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1391/2884] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:00 2022] DELETE /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:25:00.350389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:00.354645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:00.367351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.369213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.370606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.374094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.375679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.377428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.630535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:00.631482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:00.639695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.640231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.643718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:00.650061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:00.650732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:00.651053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.022041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.044189 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec283948-14ac-4267-a89f-0ac9b1dcc8b9 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1499 microversion: 2.1 time: 0.697968 Aug 30 18:25:01.073512 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1494/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:00 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1499 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:01.103507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:01.109831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:01.127083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:01.128012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:01.128825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.129856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:01.130330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:01.142775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.515395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.532917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.534767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.536178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7d66bc22-8eb2-4fca-8855-0478c64b9ac1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2936 microversion: 2.32 time: 0.910467 Aug 30 18:25:01.536740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1392/2886] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:00 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2936 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:01.736319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "a642fd74-5a94-4293-9322-bf021b5f9e5b"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "a94e2401-6899-4923-9211-c9fb86eac7ef"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "457819b0-f0ad-4289-9a70-e3e8e269c9c1"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "fdf7ba45-d5a0-471a-829e-43218c97999f"}, {"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "32fa0270-af32-48e8-a4c1-6a86a32f843d"}, {"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-plugged", "status": "completed", "tag": "9c807ad0-b557-4c33-b6ea-57b56b0ec935"}, {"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-plugged", "status": "completed", "tag": "382085cf-42ca-424c-8bfe-a37d26606e56"}, {"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-plugged", "status": "completed", "tag": "cbd12e0f-5f51-4c75-b5d2-e40739055a68"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:01.737895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:01.752307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b429906-653b-46a3-8c93-9e8df52ee220 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.677198 Aug 30 18:25:01.753255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1495/2887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:01 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:01.784104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:01.785193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:01.786280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:01.814123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-unplugged:a642fd74-5a94-4293-9322-bf021b5f9e5b for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:01.815184 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-unplugged:a94e2401-6899-4923-9211-c9fb86eac7ef for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:01.815912 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-unplugged:457819b0-f0ad-4289-9a70-e3e8e269c9c1 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:01.816749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-unplugged:fdf7ba45-d5a0-471a-829e-43218c97999f for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:01.817499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-unplugged:32fa0270-af32-48e8-a4c1-6a86a32f843d for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:01.818219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-plugged:9c807ad0-b557-4c33-b6ea-57b56b0ec935 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:01.818949 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-plugged:382085cf-42ca-424c-8bfe-a37d26606e56 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:01.819686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] Creating event network-vif-plugged:cbd12e0f-5f51-4c75-b5d2-e40739055a68 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:01.832707 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5e196fb2-160a-4397-b154-ad6fbf1e2306 req-7c334c2d-1b3f-4b7e-8224-39bb1358518e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1390 microversion: 2.1 time: 0.101725 Aug 30 18:25:01.833605 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1393/2888] 10.222.0.25 () {64 vars in 1318 bytes} [Tue Aug 30 18:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:02.081816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:02.083322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:02.091829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.096118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.096885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.098403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.101667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.102400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.596706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:02.598889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:02.602912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:02.616965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4108e0e4-36d3-4321-812a-e696c35d8ad2 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1499 microversion: 2.1 time: 0.539237 Aug 30 18:25:02.618766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.622870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.623747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.625145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.628584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.631139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.634158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1496/2889] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:02 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1499 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:02.778174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:02.783516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:02.806826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.813199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.814472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:02.822152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:02.823609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:02.824362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:03.360661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:03.372766 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee1c7be7-428a-42ba-86fa-0852871ee4d4 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1353 microversion: 2.1 time: 0.602698 Aug 30 18:25:03.387841 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1497/2890] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:02 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1353 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:03.642030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:03.643150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:03.660923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:03.663421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:03.664402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:03.672836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:03.676016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:03.676699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:03.994147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9a5d6b8f5a43c0b8eb3e5e3874bfb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91f68afbea64466b5abc3357706730a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:04.035795 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-790135f6-0919-438d-87b8-433a57fe5eb3 tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 200 len: 1457 microversion: 2.1 time: 0.396865 Aug 30 18:25:04.037760 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1498/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:03 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 1457 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:04.047650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffba40d-f706-40ae-835c-42c0842275f9", "name": "network-vif-deleted", "tag": "5a2b8087-3114-464f-812a-a67d1b44dd8b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:04.068757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:04.069757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:04.070768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:04.100994 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] Creating event network-vif-deleted:5a2b8087-3114-464f-812a-a67d1b44dd8b for instance 3ffba40d-f706-40ae-835c-42c0842275f9 on n-h1-854119-10 Aug 30 18:25:04.118143 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b22baef9-d38f-4aa8-8154-95c437d9da72 req-486ce09e-00ee-4888-9ac2-c47c41e1669d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076942 Aug 30 18:25:04.119743 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1499/2892] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:04.155863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:04.173852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:04.181079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:04.183495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:04.185673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4a1d422-2a22-47bc-a7e7-5c5a607376a8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2915 microversion: 2.32 time: 1.602231 Aug 30 18:25:04.186963 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1394/2893] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:02 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2915 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:04.403181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:04.408637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:04.427049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:04.434554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:04.437727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:04.442601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:04.444780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:04.445504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.044027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:05.065690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8b290f94-6c56-4273-a549-0d7ef75b9f26 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1805 microversion: 2.1 time: 0.668729 Aug 30 18:25:05.066664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.067316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] [instance: 3ffba40d-f706-40ae-835c-42c0842275f9] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.077091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1500/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:04 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1805 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:05.106274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.109540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.109769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.110055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.110548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.122089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.126751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.128350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.145540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.147363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.151169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.155437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.157998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.160870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.169937 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] HTTP exception thrown: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Request method failure captured: Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 HTTP/1.1 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlPkN57RNe-hdOUKuaZ9_fIeWgEJ7P4PxNKER9iTEM5v3GGG1lvDDohxUJNEbCBD-KDNFv61mB2xbOXe-TMU3Jutjp2YTTgPSBmAofu9n5bU0uBPIOMWfpuaWj3aE38FfQUNowEDYNlJVfTpjAjdj8zTvOrjFa9VW1qLIefC9zjaBWs Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d91f68afbea64466b5abc3357706730a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d91f68afbea64466b5abc3357706730a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d91f68afbea64466b5abc3357706730a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-LiveMigrationTest-755123638 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d91f68afbea64466b5abc3357706730a Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-LiveMigrationTest-755123638 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-LiveMigrationTest-755123638-project Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: cf9a5d6b8f5a43c0b8eb3e5e3874bfb4 Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-LiveMigrationTest-755123638-project Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3ffba40d-f706-40ae-835c-42c0842275f9'} Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:05.172842 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. Aug 30 18:25:05.177964 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:05.179751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] Returning 404 to user: Instance 3ffba40d-f706-40ae-835c-42c0842275f9 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:05.181407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-124a2d1b-baf3-4d42-9915-91a21a89408e tempest-LiveMigrationTest-755123638 tempest-LiveMigrationTest-755123638-project] 10.222.0.25 "GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9" status: 404 len: 111 microversion: 2.1 time: 0.125002 Aug 30 18:25:05.187724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1395/2895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/3ffba40d-f706-40ae-835c-42c0842275f9 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:05.220000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.220683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.236475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.237027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.237513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.239549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.244832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.245667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.288533 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78a1d923-3c87-414b-a7e2-f7b6c1a7d1c0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794/ips" status: 200 len: 220 microversion: 2.1 time: 0.190401 Aug 30 18:25:05.296705 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1501/2896] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794/ips => generated 220 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:05.330604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.331350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.358519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.362756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.363555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.364847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.365694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.370099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.509785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:05.827469 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cff07c3b-4462-4b5e-bb6a-6c11250c4d43 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 204 len: 0 microversion: 2.1 time: 0.523333 Aug 30 18:25:05.829027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1502/2897] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:05 2022] DELETE /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:25:05.839200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:05.840329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:05.847546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.848390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.849039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:05.850042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:05.850837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:05.851530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:06.504467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:06.528279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:06.532982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:06.536844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-654042c9-dafa-4dca-bb76-d1fd707f3092 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2868 microversion: 2.32 time: 1.322196 Aug 30 18:25:06.538047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1396/2898] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2868 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:06.561125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-deleted", "tag": "a642fd74-5a94-4293-9322-bf021b5f9e5b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:06.609382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:06.611774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:06.613019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:06.660649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] Creating event network-vif-deleted:a642fd74-5a94-4293-9322-bf021b5f9e5b for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:06.671218 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ade4f984-1658-492c-bbf9-d6eb5c631eaa req-10b0cafd-5500-4c1e-ace3-64f80f089322 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130733 Aug 30 18:25:06.673209 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1397/2899] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:06.970740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:06.985828 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a87c1b66-45e1-4c6e-ab39-b6bc377ea123 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1811 microversion: 2.1 time: 1.150452 Aug 30 18:25:06.988485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1503/2900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:05 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1811 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:07.609601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:07.611380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:07.624189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.625120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.625781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:07.626876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:07.627572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:07.628224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.011952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:08.013246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:08.025375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.025876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.026441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.027149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.027509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.027915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.462930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:08.500239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:08.504096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:08.512165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0aa4879a-52fc-454d-9e52-45d944761e98 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2707 microversion: 2.32 time: 0.923930 Aug 30 18:25:08.514050 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1398/2901] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:07 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2707 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:08.523853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8937d892-b359-4876-b927-0eec8849d5ae tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '.version_select at 0x7f4e5ae63790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:08.532087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8937d892-b359-4876-b927-0eec8849d5ae tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.533112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8937d892-b359-4876-b927-0eec8849d5ae tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.534005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8937d892-b359-4876-b927-0eec8849d5ae tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.544333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8937d892-b359-4876-b927-0eec8849d5ae tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.028626 Aug 30 18:25:08.547343 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1399/2902] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:25:08 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:08.572123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4009b200-445e-43e5-b37b-d36705de88c1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:08.585170 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4009b200-445e-43e5-b37b-d36705de88c1 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018978 Aug 30 18:25:08.585909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1400/2903] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:25:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:08.601805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d83ecf2-0bf2-49ff-8c70-e9a5f6745882 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2138973511", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:08.603559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:08.607883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:08.616849 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d317db75-a8e7-45ba-9bea-9430497fec73 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1811 microversion: 2.1 time: 0.608542 Aug 30 18:25:08.618105 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1504/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:08 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1811 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:08.633805 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d83ecf2-0bf2-49ff-8c70-e9a5f6745882 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.038476 Aug 30 18:25:08.635766 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1401/2905] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Aug 30 18:25:08 2022] POST /compute/v2.1/flavors => generated 499 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:08.649363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36e05924-a65d-46c8-b59f-cd1a7fed1740 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:08.664912 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36e05924-a65d-46c8-b59f-cd1a7fed1740 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022307 Aug 30 18:25:08.665795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1505/2906] 10.222.0.25 () {58 vars in 1182 bytes} [Tue Aug 30 18:25:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:25:08.719156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-deleted", "tag": "32fa0270-af32-48e8-a4c1-6a86a32f843d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:08.740799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:08.741308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:08.741786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:08.773976 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] Creating event network-vif-deleted:32fa0270-af32-48e8-a4c1-6a86a32f843d for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:08.800023 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-89ae70c0-085a-4ec2-868b-d402e467a99d req-94cf399d-b4fb-4223-b11a-7bb83bfd6324 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092188 Aug 30 18:25:08.804556 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1402/2907] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:08.890857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1543964805", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "d312abe8-d266-41b2-b343-d44661996767"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:08.990335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:25:09.542749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:09.543527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:09.558784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:09.560860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:09.562085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:09.564298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:09.564965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:09.565714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.045455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:25:10.046924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:25:10.047663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:25:10.048561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:25:10.049332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:25:10.071418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.072213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.072802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.073771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.074507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.075141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.101364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:10.109820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:10.142011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:25:10.144942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:25:10.300928 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a3867341-2d81-4c2c-a5ba-30e42b903e19 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417240 Aug 30 18:25:10.301830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1506/2908] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:25:10.310452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:10.311772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:10.326647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.336018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.336790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.337725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.338383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.338960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.446006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:10.478870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:10.480746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:10.482734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5cf6a57a-f4b2-4f90-801b-e7a8a096a2f4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2593 microversion: 2.32 time: 0.947797 Aug 30 18:25:10.495731 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1403/2909] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:09 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2593 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:10.513991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-deleted", "tag": "9c807ad0-b557-4c33-b6ea-57b56b0ec935"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:10.526895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:10.527680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:10.528349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:10.560980 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] Creating event network-vif-deleted:9c807ad0-b557-4c33-b6ea-57b56b0ec935 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:10.578519 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-64d8a89c-8be3-4c0f-9e4b-811ac4c662b2 req-7bae3daa-6972-4de6-bb74-596ed0c6e794 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080790 Aug 30 18:25:10.579955 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1404/2910] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:10.587935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e26acae-11c0-4def-aa30-02403a585f6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:10.588946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e26acae-11c0-4def-aa30-02403a585f6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:10.695485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e26acae-11c0-4def-aa30-02403a585f6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:10.705432 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e26acae-11c0-4def-aa30-02403a585f6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1279 microversion: 2.1 time: 0.123825 Aug 30 18:25:10.706400 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1405/2911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:10 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:10.844121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:10.856992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3db7c180-b33b-4c46-9b18-771dab2bfa61 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1790 microversion: 2.1 time: 0.553133 Aug 30 18:25:10.858228 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1507/2912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:10 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1790 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:11.088458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-deleted", "tag": "457819b0-f0ad-4289-9a70-e3e8e269c9c1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:11.104079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:11.105403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:11.106188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:11.120214 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] Creating event network-vif-deleted:457819b0-f0ad-4289-9a70-e3e8e269c9c1 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:11.128820 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9bff92c3-2fe8-4991-9d0b-09cf261d0b1f req-4ff8b72a-6254-407b-a436-9d71a345d802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044529 Aug 30 18:25:11.130680 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1406/2913] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:25:11.514330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:11.515681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:11.521372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:11.560268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:11.560777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:11.561228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:11.561968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:11.567293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:11.570639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:11.730731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:11.731805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:11.758967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:11.764659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:11.765742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:11.770169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:11.772030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:11.774311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:12.131326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:12.153738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a67bc109-bcb1-4a55-88fa-3e5229891584 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1331 microversion: 2.1 time: 0.429708 Aug 30 18:25:12.159163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1407/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:11 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1331 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:12.169709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:12.171384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:12.182934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:12.183917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:12.184789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:12.186513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:12.187397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:12.189157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:12.370450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:12.384758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:12.391642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:12.399791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2dd53f31-a81a-4966-94d1-9c987686665d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2432 microversion: 2.32 time: 0.891426 Aug 30 18:25:12.400563 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1508/2915] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:11 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2432 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:13.022713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2098783494", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "ee26794b-ecc8-4609-99f1-c809aeb0acff"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:13.124039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] validate_networks() for [('ee26794b-ecc8-4609-99f1-c809aeb0acff', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:25:13.321367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:13.339407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50d53224-e2ac-4a86-adef-5708b93b0ea0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1675 microversion: 2.1 time: 1.178147 Aug 30 18:25:13.340642 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1408/2916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:12 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1675 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:13.345916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:13.351180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:13.366399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.367602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.368883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:13.376062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.377357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.378322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:13.583410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:13.599235 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db01c937-d4a1-4030-8354-155e631f4efc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1337 microversion: 2.1 time: 0.257197 Aug 30 18:25:13.613298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1409/2917] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:13 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1337 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:13.618904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-deleted", "tag": "382085cf-42ca-424c-8bfe-a37d26606e56"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:13.630101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.630845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.631437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:13.646096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] Creating event network-vif-deleted:382085cf-42ca-424c-8bfe-a37d26606e56 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:13.652120 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-af29c8d5-f698-42e6-9761-9a24b60665c2 req-23fa1738-c559-4029-a006-fe52dee17ed5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037035 Aug 30 18:25:13.653168 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1410/2918] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:13.660053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd12e0f-5f51-4c75-b5d2-e40739055a68"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:13.671600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.672716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.673240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:13.702001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] Creating event network-vif-unplugged:cbd12e0f-5f51-4c75-b5d2-e40739055a68 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:13.711374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9751824b-36ea-4c90-abd5-6a61f0c92de5 req-e59821d9-8fc4-4f3a-acfb-7cb0745c5b92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056523 Aug 30 18:25:13.712679 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1411/2919] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:13.718829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:13.719901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:13.728141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.729072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.729763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:13.730845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:13.731708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:13.733501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:14.510252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:14.533205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:14.535184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:14.536992 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-685aa756-0d4f-4ddc-a507-cdbb1694c226 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2385 microversion: 2.32 time: 0.822850 Aug 30 18:25:14.546914 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1412/2920] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:13 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2385 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:14.552691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:14.565084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:14.573158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:14.573858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:14.574675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:14.575718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:14.576337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:14.576987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:15.072184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:15.092744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f4dd6037-da8a-4605-98f2-1056ff13eaa9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1495 microversion: 2.1 time: 0.543274 Aug 30 18:25:15.112814 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1413/2921] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:14 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1495 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:15.119113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:15.120215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:15.128628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:15.129508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:15.130300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:15.131936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:15.132727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:15.133685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:15.292436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:15.306159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-daf038b4-0cbe-4666-a52c-313d1a7efbe9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1337 microversion: 2.1 time: 0.191710 Aug 30 18:25:15.307133 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1414/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:15 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1337 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:15.326080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-deleted", "tag": "a94e2401-6899-4923-9211-c9fb86eac7ef"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:15.340600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:15.342209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:15.342942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:15.361761 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] Creating event network-vif-deleted:a94e2401-6899-4923-9211-c9fb86eac7ef for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:15.368095 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2b40b7a9-1a63-478a-a2b9-35b186bdc275 req-baa455ec-a3ea-4e63-a5f3-b4648535eda1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058528 Aug 30 18:25:15.369506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1415/2923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:15.567779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:15.570079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:15.585805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:15.588674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:15.590989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:15.593881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:15.594881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:15.596237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.005087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:16.030004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:16.037501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:16.040693 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98984688-5fd5-4435-a644-6adf309ded79 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 2099 microversion: 2.32 time: 0.477619 Aug 30 18:25:16.047173 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1416/2924] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:15 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 2099 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:16.121389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:16.122275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:16.149566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.150117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.158175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.158986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.159514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.162414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.377982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:16.398712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae1b3716-944b-4f1d-84e8-a398ec3450ce tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 200 len: 1296 microversion: 2.1 time: 0.281715 Aug 30 18:25:16.421214 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1417/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:16 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 1296 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:16.426034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:25:16.426670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:25:16.427122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:25:16.427554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:25:16.428385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:25:16.438027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:16.439324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:16.453899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.455869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.457384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.462046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.463101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.463846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.464560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.465096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.465557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.482148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.482689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.483142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.620363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Getting quotas for project 75847bde432b4e93ac18faba7a993895. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:16.639119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Getting quotas for user 0981775d2e624f34862fff165cf722ef and project 75847bde432b4e93ac18faba7a993895. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:16.696667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:25:16.705055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:25:16.860991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fed53716-7262-45fb-81fa-b0e18406fc30 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.441656 Aug 30 18:25:16.862006 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1509/2926] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:25:16.883185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d113b2-b39b-4124-a35d-e3267dbd9794", "name": "network-vif-deleted", "tag": "cbd12e0f-5f51-4c75-b5d2-e40739055a68"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:16.923892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:16.925761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:16.926956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:16.957178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:16.971680 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56e1f602-6f6b-4c79-b363-9f2d075c8250 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.547025 Aug 30 18:25:16.976492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] Creating event network-vif-deleted:cbd12e0f-5f51-4c75-b5d2-e40739055a68 for instance 65d113b2-b39b-4124-a35d-e3267dbd9794 on n-h2-854119-10 Aug 30 18:25:16.986640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c161a82d-ef5c-4247-acc3-bde033f10376 req-94b50d77-9694-457a-9740-622e79e0f930 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123266 Aug 30 18:25:16.987642 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1510/2927] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:16.989798 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1418/2928] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:16 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:16.993824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a86c3063-82b1-4d19-9766-662eaadcedb1 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:16.995116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a86c3063-82b1-4d19-9766-662eaadcedb1 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:17.084465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:17.087948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:17.100180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:17.107487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:17.108643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:17.109645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:17.110376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:17.112171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:17.298375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a86c3063-82b1-4d19-9766-662eaadcedb1 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:17.328715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a86c3063-82b1-4d19-9766-662eaadcedb1 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1228 microversion: 2.1 time: 0.336836 Aug 30 18:25:17.347099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1511/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:16 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1228 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:17.350042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:17.374475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:17.376258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:17.377673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4889a282-5fd7-4037-ab43-22d48287b661 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.305996 Aug 30 18:25:17.403697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1419/2930] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:17 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:17.437431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:17.443388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:17.462781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:17.464420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:17.466202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:17.469607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:17.470892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:17.473162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:17.535348 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 HTTP/1.1 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '65d113b2-b39b-4124-a35d-e3267dbd9794'} Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:17.538463 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:25:17.544102 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:17.547034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:17.551932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51984186-b715-4f5c-a04b-979c8f0a3ea4", "name": "network-vif-deleted", "tag": "42940854-ee1d-4fa4-a985-343440ca2eb8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:17.560477 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-989add6f-383b-400e-a0ea-3ceeba9d553d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 404 len: 111 microversion: 2.1 time: 0.135071 Aug 30 18:25:17.561633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1512/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:17 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:17.576898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:17.577323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:17.577773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:17.598411 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] Creating event network-vif-deleted:42940854-ee1d-4fa4-a985-343440ca2eb8 for instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 on n-h1-854119-10 Aug 30 18:25:17.611805 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1416e87c-5011-4508-b504-be93a3bd7428 req-a04821d1-8915-4deb-aaab-1157c3fc968a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063394 Aug 30 18:25:17.612738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1420/2932] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:25:17.999849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:18.001621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:18.032582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.034771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.038263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.040487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.043150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.045729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.365006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:18.365961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:18.385779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.386693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.387494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.389080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.389761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.390373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.403162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:18.580490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:18.593502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f70480c5-158e-4b8a-b7d8-a6d728e9ec78 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1280 microversion: 2.1 time: 0.234857 Aug 30 18:25:18.601066 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1421/2933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:18 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:18.620687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:18.621461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:18.629277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.630220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.631016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.632052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:18.632720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:18.633371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:18.655832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:18.669840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80b9c8a9-023a-45ee-8e11-86cd601b348d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.674955 Aug 30 18:25:18.671333 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1513/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:17 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:18.921024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:18.939297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:18.947416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:18.949086 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-713b2e16-3d7b-4bf2-8860-62ace5538eb9 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.333067 Aug 30 18:25:18.949941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1422/2935] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:18 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:19.623549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:19.624283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:19.634006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:19.636965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:19.638998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:19.641060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:19.641847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:19.644144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:19.695309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:19.697334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:19.707551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:19.708352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:19.708945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:19.709892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:19.710555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:19.711137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:19.917839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:19.930141 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f04306a-1b2c-4331-9c23-c5b879026d58 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1286 microversion: 2.1 time: 0.308381 Aug 30 18:25:19.930971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1514/2936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:19 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:19.992133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:19.993046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:20.009250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:20.010199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:20.010832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:20.011908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:20.013558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:20.014130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:20.332459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:20.347139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:20.354558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:20.359253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a84f6bc2-2ead-47fc-afb5-78e8ecbe8ef8 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.370938 Aug 30 18:25:20.359951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1515/2937] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:19 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:20.653176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:20.670155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:20.670922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:20.671872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:20.689743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] Creating event network-changed:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:25:20.697931 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-35ff5d0a-6aca-45d3-bd69-3375b242d2e4 req-b39d1799-5d3e-4e4a-b658-0c952610d007 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053769 Aug 30 18:25:20.700002 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1516/2938] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:20.701580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:20.947252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:20.965163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-612b2402-5604-47cf-8a5a-0b5d49c36720 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 1.276207 Aug 30 18:25:20.969057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1423/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:19 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:20.971851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:20.972621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:20.982832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:20.983386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:20.985811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:20.988723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:20.994787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:20.995719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:21.116420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:21.146740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd506f79-d103-472f-8f11-7d05770be5d9 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1286 microversion: 2.1 time: 0.190587 Aug 30 18:25:21.147735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1517/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:20 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:21.396549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:21.398416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:21.419089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:21.446157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:21.447665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:21.449029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:21.450251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:21.451572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:21.989645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:21.990269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:22.000761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.001269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.001716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.002462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.005644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.006117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.060896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.071710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.073407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.075224 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1af960d4-6229-4982-a006-e34cde655bc7 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.683402 Aug 30 18:25:22.079491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1424/2941] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:21 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:22.170888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:22.171819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:22.186973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.187463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.191180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.191968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:22.192953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:22.193757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:22.391438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.405690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9e373830-5510-4f6a-9751-25751d3cac06 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.421310 Aug 30 18:25:22.424100 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1518/2942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:21 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:22.435602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:22.456497 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4252dd4a-8ff6-4d2e-b116-823614ace158 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1286 microversion: 2.1 time: 0.288740 Aug 30 18:25:22.458869 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1425/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:22 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1286 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:23.108192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:23.114033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:23.124761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.126334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.127175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.128141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.130680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.131205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.261910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:23.275058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:23.276833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:23.278715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d15464e8-5048-421e-8da8-f521a9ede8a6 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.176574 Aug 30 18:25:23.293159 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1519/2944] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:23 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:23.428566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:23.430167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:23.440039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.440981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.441652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.443130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.444111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.445143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.479688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:23.480311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:23.492201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.492712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.493155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:23.497880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:23.499357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:23.500075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:24.102906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.117902 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be063f85-65b3-4f01-938d-47f2ca20df68 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.642277 Aug 30 18:25:24.134427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1520/2945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:23 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:24.175030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.185378 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56c72b0d-bf3e-4903-b2fe-92760bd0d7c6 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.760303 Aug 30 18:25:24.185874 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1426/2946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:23 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:24.306028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:24.306905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:24.322311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:24.323536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:24.324519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:24.327010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:24.328584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:24.329864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:24.783801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.797903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.806436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:24.813106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa802c9e-dbf6-4955-b2ba-4f34c4471579 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.511765 Aug 30 18:25:24.814018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1521/2947] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:24 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:25.144899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:25.146761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:25.158429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.159735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.160802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.162805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.165826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.166955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.210004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:25.210004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:25.224213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.224807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.225440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.226383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.227117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.227784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.720515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:25.731133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74020292-6528-4024-8aab-aa4635360125 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.525640 Aug 30 18:25:25.741759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1522/2948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:25 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:25.843001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:25.843803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:25.861116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.863203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.863856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.865572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:25.867335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:25.869259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:25.920174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:25.932872 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a38e041-3235-4a07-b7d9-7a96b5e99681 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.793504 Aug 30 18:25:25.937786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1427/2949] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:25 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:26.017911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:26.036547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:26.040086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:26.044130 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7530bac8-146e-4ea1-8248-c62d2d44d885 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.206791 Aug 30 18:25:26.059379 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1523/2950] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:25 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:26.755672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:26.756449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:26.772325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.777467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.780149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:26.782464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.785770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.787293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:26.954268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:26.955622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:26.966066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:26.972102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.974585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.979320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:26.980368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:26.981004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:26.981693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:27.305649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:27.908369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:27.922456 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54368b8e-192d-4a01-b2f0-b6ef6635854a tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.969293 Aug 30 18:25:27.923165 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1524/2951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:26 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:27.941219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:27.942572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:27.951769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:27.955465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:27.956615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:27.959056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:27.959740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:27.961783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.135409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:28.178591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:28.186045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:28.194187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ecc645d-4b87-42ff-94c6-ff57d26057a4 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.262947 Aug 30 18:25:28.195671 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1525/2952] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:27 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:28.302143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:28.318523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6751bcde-b5e1-4b5c-913c-fa9df8e18ead tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 1.567053 Aug 30 18:25:28.326911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1428/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:26 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:28.669540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6821bce-d6a2-4d85-9edf-6a102da39593", "tag": "19f6e188-27b1-44d0-accb-afb25972b241"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:28.706271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.711256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.712214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.732807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] Creating event network-changed:19f6e188-27b1-44d0-accb-afb25972b241 for instance b6821bce-d6a2-4d85-9edf-6a102da39593 on n-h1-854119-10 Aug 30 18:25:28.752956 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e817562b-04d5-4b2f-951c-81eafce4bed5 req-81c193cf-95c2-449e-afd8-ebce00744f44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088247 Aug 30 18:25:28.754388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1526/2954] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:28.954577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:28.955656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:28.964894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.966366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.967039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:28.968553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:28.969214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:28.969814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.222028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:29.223064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:29.240514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.241254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.242050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.243751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.244713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.245312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.308307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:29.393524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:29.416131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:29.418262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:29.422885 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d137a01-10ef-4262-a049-6e071a67859b tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.205460 Aug 30 18:25:29.424498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1527/2955] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:29 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:29.437413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:29.439024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:29.448280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.449167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.450135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.451224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:29.452220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:29.453047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:29.699807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:29.710179 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d2cafd67-ad70-476c-9ab1-765175a65c3d tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.768974 Aug 30 18:25:29.715203 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1429/2956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:28 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:29.795921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:29.804661 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a4c3714-103e-4942-835a-62b7cccd1083 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 0.378499 Aug 30 18:25:29.818801 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1528/2957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:29 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:30.453916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:30.455277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:30.470810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:30.476438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.478162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.480065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.481988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.483736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.485585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.648877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:30.661640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:30.663151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:30.664402 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d3546fd3-10d5-42df-97db-fd2d44489057 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.214946 Aug 30 18:25:30.674542 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1430/2958] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:30 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:30.738075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:30.738735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:30.760123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.761953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.765129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.766107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.766729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.769385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.841900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:30.843552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:30.856145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.858680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.859440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:30.863244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:30.864165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:30.865402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:31.285275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:31.305308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8093dcd5-9142-45d9-8d86-0d9f4d392699 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.571820 Aug 30 18:25:31.306534 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1529/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:30 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:31.334966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-plugged", "status": "completed", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:31.353277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:31.353771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:31.354253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:31.371429 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] Creating event network-vif-plugged:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:25:31.382421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b25265e6-3492-4d9d-a86b-616f26909dad req-51d26bb2-23d1-43cb-af2c-bf2f0506e82b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073634 Aug 30 18:25:31.383886 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1530/2960] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:31.705060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:31.706044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:31.738520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:31.739791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:31.740425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:31.741460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:31.742098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:31.742741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:31.846740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:31.855407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e9759048-f4fa-4561-b924-9478d3735197 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1379 microversion: 2.1 time: 1.019480 Aug 30 18:25:31.860996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1431/2961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:30 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1379 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:32.329791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:32.331160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:32.348889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:32.349528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:32.351370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:32.352054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:32.355198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:32.356197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:32.359375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:32.361222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:32.370123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:32.371425 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c285d1cb-108a-4c00-9ad7-5d0c62d1af3f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.672954 Aug 30 18:25:32.383725 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1531/2962] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:31 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:32.884810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:32.884810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:32.896811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:32.897309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:32.897750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:32.898502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:32.898957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:32.899381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.339362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.356824 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a5e2094-2f80-4f0b-96fb-9c2840979a09 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1529 microversion: 2.1 time: 0.477852 Aug 30 18:25:33.359323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1532/2963] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:32 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1529 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:33.380201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:33.380683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:33.390995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.392499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.393026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.394112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.394991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.395869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.541159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.567913 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34fd1dfd-b753-4310-9c79-c40a888caf65 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 1.240727 Aug 30 18:25:33.571156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1432/2964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:32 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:33.593399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:33.594542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:33.604226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.605027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.605636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.607360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.608238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.609105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.617180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.630438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5eed6da-9411-40dc-bc1b-3c6f34d58b86 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1529 microversion: 2.1 time: 0.250650 Aug 30 18:25:33.642379 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1533/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:33 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1529 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:33.660566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05771976-2737-49d7-8707-549a3ae435d2 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:33.705230 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05771976-2737-49d7-8707-549a3ae435d2 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/d312abe8-d266-41b2-b343-d44661996767" status: 202 len: 0 microversion: 2.1 time: 0.050893 Aug 30 18:25:33.705839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1534/2966] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:33 2022] DELETE /compute/v2.1/flavors/d312abe8-d266-41b2-b343-d44661996767 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:25:33.716775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4785d255-1158-4776-b749-14c170ab3621 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:33.744566 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4785d255-1158-4776-b749-14c170ab3621 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032944 Aug 30 18:25:33.758127 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1535/2967] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:25:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:33.763570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:33.765945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:33.773232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.773739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.774184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.775033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:33.775494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:33.775922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:33.834371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.842765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Old instance type tempest-test_resize_flavor_-2138973511, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:25:33.851193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:25:33.851889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:25:33.852575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:25:33.853167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:25:33.853809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:25:33.889182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.907372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.913099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:33.922901 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-45198df7-0b3a-49c7-b5fd-be30731739af tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.348808 Aug 30 18:25:33.923971 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1433/2968] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:33 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:33.983595 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b20c4e2-e044-4c17-ade6-5219e0e5d26b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f/action" status: 202 len: 0 microversion: 2.1 time: 0.222667 Aug 30 18:25:33.984588 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1536/2969] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:25:33 2022] POST /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:25:33.992885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:33.993610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:34.006049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.006670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.007185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:34.015853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.016464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.016988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:34.504833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:34.527272 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-170924fa-9935-4e28-ae38-3a5b2153becd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1538 microversion: 2.1 time: 0.536545 Aug 30 18:25:34.530171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1434/2970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:33 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1538 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:34.608971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:34.611430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:34.628089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.630904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.631794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:34.633952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.636619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.637723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:34.961963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:34.963948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:34.975898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.979052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.982113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:34.983588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:34.985617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:34.986400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:35.243408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:35.257599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:35.277970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:35.282923 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c9cac16-9853-4f67-96a5-6750a6eeca33 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.679499 Aug 30 18:25:35.285183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1537/2971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:34 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:35.305541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:35.321213 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9eb5001d-54d5-4a00-a9a1-be90627a6ee1 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.360384 Aug 30 18:25:35.323039 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1435/2972] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:34 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:35.551942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:35.552882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:35.566456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:35.567529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:35.570141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:35.571364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:35.574226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:35.575146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:35.916149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:35.929173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d8a66ec-8009-4b26-84fc-91d8e22ed4d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1538 microversion: 2.1 time: 0.380988 Aug 30 18:25:35.943507 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1538/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:35 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1538 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:36.306934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:36.309292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:36.332757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.334014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.335925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:36.337709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.341343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.343488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:36.353273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:36.354658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:36.380060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.381023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.382187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:36.384006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.386979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.390707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:36.593567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:36.608969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:36.614485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:36.623071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e828eadc-5147-4e89-88cc-69a63b3f7f64 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.275053 Aug 30 18:25:36.625764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1539/2974] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:36 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:36.956504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:36.957434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:36.971483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.972570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.973764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:36.975070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:36.976110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:36.977840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:37.146705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:37.162541 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-580b3024-9add-482d-85fd-de3d1cc6e69b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.853951 Aug 30 18:25:37.174376 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1436/2975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:36 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:37.225320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6821bce-d6a2-4d85-9edf-6a102da39593", "name": "network-vif-plugged", "status": "completed", "tag": "19f6e188-27b1-44d0-accb-afb25972b241"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:37.239977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:37.240468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:37.240997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:37.275826 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] Creating event network-vif-plugged:19f6e188-27b1-44d0-accb-afb25972b241 for instance b6821bce-d6a2-4d85-9edf-6a102da39593 on n-h1-854119-10 Aug 30 18:25:37.288965 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6c4326cd-18c9-445e-942d-2f79265d1286 req-517a9c53-210f-4452-98b8-baf6dfeb2a3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067331 Aug 30 18:25:37.293313 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1437/2976] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:25:37.457973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:37.470279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7ef5a87-a2fa-46be-ba5c-afa4c3c550aa tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1538 microversion: 2.1 time: 0.522841 Aug 30 18:25:37.471729 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1540/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:36 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1538 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:37.490642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1371900886", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "e0d36cc8-9271-45f3-b30f-6a9c60f6c8a5"}, {"uuid": "8c45681a-c398-48c0-a26f-2ecc32457850"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:37.589703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] validate_networks() for [('e0d36cc8-9271-45f3-b30f-6a9c60f6c8a5', None, None, None, None, None), ('8c45681a-c398-48c0-a26f-2ecc32457850', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:25:37.651936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:37.652658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:37.663680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:37.665335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:37.670178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:37.671310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:37.681332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:37.687166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:37.825427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:37.835484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:37.845758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:37.847840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1917b3cd-4a26-4cda-a61a-9fc2aa83e46c tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.199608 Aug 30 18:25:37.848661 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1541/2978] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:37 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:38.211211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:38.212097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:38.228621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:38.229618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:38.238232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:38.239647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:38.244458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:38.250026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:38.630716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:38.645959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7c19f1b-d93a-41eb-a23c-acfc331d6ff5 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.452482 Aug 30 18:25:38.648250 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1542/2979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:38 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:38.656967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:38.657986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:38.680449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:38.682862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:38.686883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:38.687886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:38.688820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:38.691845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:39.316144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:39.329841 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-224e073e-d039-4e84-a834-4ad70f7c5a8c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1538 microversion: 2.1 time: 0.677625 Aug 30 18:25:39.332222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1543/2980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:38 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1538 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:39.345840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:39.350128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:39.367765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:39.373988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:39.374925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:39.375861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:39.377668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:39.385012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:39.668926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:39.699304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:39.707766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a12223f3ae4c440895564252bc80b3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1680292b36ac42deb267e040910c8194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:39.718282 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86a7a494-3153-4239-b938-5abcceb93476 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 200 len: 1604 microversion: 2.32 time: 0.384687 Aug 30 18:25:39.722098 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1544/2981] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:39 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:39.739227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:39.748726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:39.761851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:39.764245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:39.764804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:39.765230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:39.765948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:39.766444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:39.766856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:39.828513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:40.302710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:40.319297 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4680e203-fcd8-4502-a0f7-808ef35e720b tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1328 microversion: 2.1 time: 0.591848 Aug 30 18:25:40.319970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1545/2982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:39 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1328 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:40.364691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:40.365380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:40.376877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:40.377384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:40.379339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:40.380901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:40.381394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:40.381843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:40.893231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:40.913461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:25:40.914163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:25:40.915561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:25:40.916793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:25:40.919442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:25:40.940441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26fdf5fe-6361-4399-8602-7770f1d4830b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.582449 Aug 30 18:25:40.948850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1546/2983] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:40 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:40.966951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:40.970669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:40.971792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:40.972242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:40.973370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:40.978401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:40.980775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:40.982546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:40.989586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:40.992821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:40.998212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.001228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:41.003329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:41.006769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.035826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Getting quotas for project 65cdf3112b234567bcff894747ab473b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:25:41.049175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Getting quotas for user c1f05e9577a24221b139025ca597ffa1 and project 65cdf3112b234567bcff894747ab473b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:25:41.072724 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] HTTP exception thrown: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Request method failure captured: Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 HTTP/1.1 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlRySoHYqxSezN03h7rpjzu1yXp5G678177-mfYlWCinEWyN-vNXP6VwqquiB5IqOGiXNcO0UWClk2-kdj99Ga5nTq_rvKjWjhPA9FCeyPDFklpNu4kQyWn1UZmfcHeyVnaK2RF52vNaYbRcOb3V-OyQGKEVoqtt2N6UTv1TTicFDRw Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1680292b36ac42deb267e040910c8194"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1680292b36ac42deb267e040910c8194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: a12223f3ae4c440895564252bc80b3eb Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '51984186-b715-4f5c-a04b-979c8f0a3ea4'} Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:41.080631 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:41.088871 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.090149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:25:41.092690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:25:41.096222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Returning 404 to user: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:41.100759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-575970da-0dca-4ca2-b61f-99340ee7db8f tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 404 len: 111 microversion: 2.32 time: 0.147580 Aug 30 18:25:41.104507 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1547/2984] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:40 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:25:41.118657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d12d35a-58b0-4b0e-9270-ddfc1771d68d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '.version_select at 0x7f4e56ec2280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:41.180944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d12d35a-58b0-4b0e-9270-ddfc1771d68d tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121363298" status: 204 len: 0 microversion: 2.32 time: 0.069149 Aug 30 18:25:41.188168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1548/2985] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121363298 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:25:41.285407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d52949e8-7520-4bd9-8485-377aa35a086a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.798811 Aug 30 18:25:41.293036 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1438/2986] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:25:41.309701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5782612-616a-4cba-acbe-3568be13458b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:41.317285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f5782612-616a-4cba-acbe-3568be13458b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:41.588032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f5782612-616a-4cba-acbe-3568be13458b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:41.598887 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5782612-616a-4cba-acbe-3568be13458b tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1213 microversion: 2.1 time: 0.298687 Aug 30 18:25:41.599539 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1439/2987] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:41 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1213 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:41.641128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:41.641762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:41.666738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:41.667588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:41.668803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.669993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:41.671635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:41.673126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.686540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:41.916762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Action: 'update', calling method: .version_select at 0x7f4e56a5dd30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:41.926181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:41.926968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:41.927982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.948387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:41.951357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:41.952402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:41.974316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] HTTP exception thrown: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Request method failure captured: Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 HTTP/1.1 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 56 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlYkYpYZZQsL-qk0Ku2jAnMayrEPQCVcbwpDey2QeYjsDYG_ZBiqyTYSOrCds1gYga7pxUEfsLACSH4VqE8nnwxMIxs_QR_CN0aRcdJ3EGWpwjcYt9vpx_Ad3Kk0WoRFrgxZFHBNEFNfsd3qEKAeEerymmnAlJQuE82u3fuTPWKbBKI Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 7e298c0f5ea94431a35441fe9c7801fa Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: exception: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '65aa2642-69f4-491c-b24a-2ce9e1355fd0', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:41.977385 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:41.982942 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:41.986212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Returning 404 to user: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:41.987390 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d255a1e-be5b-4ca7-b727-6aab6e625a81 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0" status: 404 len: 110 microversion: 2.53 time: 0.725309 Aug 30 18:25:41.988566 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1549/2988] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Aug 30 18:25:41 2022] PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 => generated 110 bytes in 727 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:25:42.008808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:42.009716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:42.019144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.019830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.020558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.022756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.023460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.024137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.142454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:42.151902 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64b05f79-27e1-4458-b149-1e3ae2ee6ac8 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1527 microversion: 2.1 time: 0.530534 Aug 30 18:25:42.152476 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1440/2989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:41 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1527 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:42.166179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Action: 'update', calling method: .version_select at 0x7f4e55d1faf0>, body: {"status": "disabled"} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:42.175988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.176491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.176934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.200515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.201483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.206895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.231354 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] HTTP exception thrown: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Request method failure captured: Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 HTTP/1.1 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 22 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlYkYpYZZQsL-qk0Ku2jAnMayrEPQCVcbwpDey2QeYjsDYG_ZBiqyTYSOrCds1gYga7pxUEfsLACSH4VqE8nnwxMIxs_QR_CN0aRcdJ3EGWpwjcYt9vpx_Ad3Kk0WoRFrgxZFHBNEFNfsd3qEKAeEerymmnAlJQuE82u3fuTPWKbBKI Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7e298c0f5ea94431a35441fe9c7801fa Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: {"status": "disabled"} Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: exception: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '65aa2642-69f4-491c-b24a-2ce9e1355fd0', 'body': {'status': 'disabled'}} Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:42.238500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Returning 404 to user: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-25cdba92-a3a3-4229-b891-530d67b0a84e tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0" status: 404 len: 110 microversion: 2.53 time: 0.084772 Aug 30 18:25:42.246584 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1441/2990] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Aug 30 18:25:42 2022] PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 => generated 110 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:25:42.254469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:42.258671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:42.267912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.268514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.270670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.270670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.270670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.272007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.611883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:42.647427 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c862f20b-14a2-45d7-827a-eff04382b0c0 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1527 microversion: 2.1 time: 0.400306 Aug 30 18:25:42.667223 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1442/2991] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:42 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1527 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:42.667223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Action: 'update', calling method: .version_select at 0x7f4e5679f5e0>, body: {"status": "enabled"} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:42.667223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.667223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.667223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.669918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.670757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.672065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.689588 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] HTTP exception thrown: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Request method failure captured: Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 HTTP/1.1 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 21 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlYkYpYZZQsL-qk0Ku2jAnMayrEPQCVcbwpDey2QeYjsDYG_ZBiqyTYSOrCds1gYga7pxUEfsLACSH4VqE8nnwxMIxs_QR_CN0aRcdJ3EGWpwjcYt9vpx_Ad3Kk0WoRFrgxZFHBNEFNfsd3qEKAeEerymmnAlJQuE82u3fuTPWKbBKI Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7fd93c452fc4e48b7c96d4d811ab698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f7fd93c452fc4e48b7c96d4d811ab698 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215 Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 7e298c0f5ea94431a35441fe9c7801fa Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: {"status": "enabled"} Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: exception: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '65aa2642-69f4-491c-b24a-2ce9e1355fd0', 'body': {'status': 'enabled'}} Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:42.691565 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:42.696744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Returning 404 to user: Service 65aa2642-69f4-491c-b24a-2ce9e1355fd0 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:42.704205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a516a70a-054b-4454-a618-e0ced4627b02 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0" status: 404 len: 110 microversion: 2.53 time: 0.046088 Aug 30 18:25:42.704205 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1443/2992] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Aug 30 18:25:42 2022] PUT /compute/v2.1/os-services/65aa2642-69f4-491c-b24a-2ce9e1355fd0 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:25:42.707767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:42.707767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:42.731276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.732091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.732651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.733523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.734094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.739442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.778407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:42.789596 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3480ccb1-802b-487e-b7ed-5f7dd5ca61ac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.799640 Aug 30 18:25:42.790880 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1550/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:41 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:42.862436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:42.881733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c92cb16-1037-4f1e-80f1-76316e501f78 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1265 microversion: 2.1 time: 0.180774 Aug 30 18:25:42.893258 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1444/2994] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:42 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:42.902932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:42.907289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.907917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.908464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.909481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.910221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.910936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.944504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-29a7297f-e3ea-4b64-bc92-740b845279b9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.049581 Aug 30 18:25:42.945478 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1445/2995] 10.222.0.25 () {60 vars in 1178 bytes} [Tue Aug 30 18:25:42 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:42.964832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:42.968864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.969828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.970530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:42.971608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:42.972076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:42.972508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.006622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-925a9830-0028-4bc5-bd5a-45e1608590c9 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052363 Aug 30 18:25:43.007250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1446/2996] 10.222.0.25 () {60 vars in 1211 bytes} [Tue Aug 30 18:25:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:43.024017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.028488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.028989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.029609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.030497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.032939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.033523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.057720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.058492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.067485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.067669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd086e33-261f-47ab-92bf-769f7125ea84 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050292 Aug 30 18:25:43.067985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.069770 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1447/2997] 10.222.0.25 () {60 vars in 1178 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:25:43.080612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.081940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.082421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.083066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.085908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.090487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.091131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.091651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.092481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.093015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.093514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.130532 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c666a30-931a-44b5-b5cf-7a81696da654 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-854119-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.048706 Aug 30 18:25:43.139667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1448/2998] 10.222.0.25 () {60 vars in 1237 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/os-services?host=n-d-854119-10&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:43.145720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.150900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.151135 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] HTTP exception thrown: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.151910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.152898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Request method failure captured: Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 HTTP/1.1 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlYH2Jf7Sv0Cgbkp1L7GgxEja5HsZO7D21AnBTGCwkiY-W3CZUfGSixq-j2nA16RJYHCl9CJ1aON_R8RWiQQPGEmZUrbUPaOH31-smka8In4r8_xXhsu3EloTxlnRV01oSWUUZSPASBjN0jVZV0kmzMdN-7oWodB_igy7QgpdhfxUJc Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eea9b635547440ceaa8ebfb0f64a0ff0 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eea9b635547440ceaa8ebfb0f64a0ff0 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1664528252-project Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 103db15c2dc1472abc44f008e8ab3176 Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252-project Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b6821bce-d6a2-4d85-9edf-6a102da39593'} Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:43.155094 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.158998 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.160060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.160154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Returning 404 to user: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:43.161626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.162619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.166893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7dd19036-49cd-4721-994b-39fb7f45f458 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 404 len: 111 microversion: 2.1 time: 0.364629 Aug 30 18:25:43.167568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1551/2999] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:42 2022] DELETE /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 111 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:43.191357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.196929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.200699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99911514-1e39-4a0b-9d8a-11ea51de78d0 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.059609 Aug 30 18:25:43.209456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1449/3000] 10.222.0.25 () {60 vars in 1178 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:43.216114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.220857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.221540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.222000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.222275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.222812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.222951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.223259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.223477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.224158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.227928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.228579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.229038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.264676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d80b832-c254-4b4b-a2af-91e4124ce244 tempest-ServicesAdminNegativeV253TestJSON-2087192215 tempest-ServicesAdminNegativeV253TestJSON-2087192215-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.052746 Aug 30 18:25:43.266018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1450/3001] 10.222.0.25 () {60 vars in 1239 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:43.493785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-919c8221-a6df-4980-8101-99b402549e8d tempest-ServicesAdminNegativeV253TestJSON-730096520 tempest-ServicesAdminNegativeV253TestJSON-730096520-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.500570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-919c8221-a6df-4980-8101-99b402549e8d tempest-ServicesAdminNegativeV253TestJSON-730096520 tempest-ServicesAdminNegativeV253TestJSON-730096520-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1e6c7b03b0c74b9897347a284228acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d31781dd21477283968e6de2424ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-919c8221-a6df-4980-8101-99b402549e8d tempest-ServicesAdminNegativeV253TestJSON-730096520 tempest-ServicesAdminNegativeV253TestJSON-730096520-project] Request method failure captured: Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlYiAcBou8Wi0ZwSmSyab5kCE0vGhtFWmiwaP3n2eM1HOHeOJJtPIduvZHG--UnoLkTSUqm0inw4Y-OmvIYSh_x-A_9No8_nktHIVwMzBwH9jN6_xRnL8HmjJyISmibGwkoPQYdMfp8vsHKPQknFLCjfcvghlBVfDI7KSToQOgOMB7s Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 75d31781dd21477283968e6de2424ca5 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-730096520 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75d31781dd21477283968e6de2424ca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75d31781dd21477283968e6de2424ca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75d31781dd21477283968e6de2424ca5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75d31781dd21477283968e6de2424ca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-730096520 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 75d31781dd21477283968e6de2424ca5 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-730096520 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServicesAdminNegativeV253TestJSON-730096520-project Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1e6c7b03b0c74b9897347a284228acf6 Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-730096520-project Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:25:43.503042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 18:25:43.507615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.509756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-919c8221-a6df-4980-8101-99b402549e8d tempest-ServicesAdminNegativeV253TestJSON-730096520 tempest-ServicesAdminNegativeV253TestJSON-730096520-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:43.511397 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-919c8221-a6df-4980-8101-99b402549e8d tempest-ServicesAdminNegativeV253TestJSON-730096520 tempest-ServicesAdminNegativeV253TestJSON-730096520-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.236309 Aug 30 18:25:43.517020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1451/3002] 10.222.0.25 () {60 vars in 1178 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:25:43.524762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:43.547426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a75972f-d382-47d6-88d6-14f7f75ddbde tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1527 microversion: 2.1 time: 0.372621 Aug 30 18:25:43.548675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1552/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1527 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:43.570785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Action: 'update', calling method: >, body: {"server": {"name": "b6821bce-d6a2-4d85-9edf-6a102da39593_new"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:43.573860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.582807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.583580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.584313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.585156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.585431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.585861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.612982 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] HTTP exception thrown: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Request method failure captured: Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 HTTP/1.1 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 64 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlYH2Jf7Sv0Cgbkp1L7GgxEja5HsZO7D21AnBTGCwkiY-W3CZUfGSixq-j2nA16RJYHCl9CJ1aON_R8RWiQQPGEmZUrbUPaOH31-smka8In4r8_xXhsu3EloTxlnRV01oSWUUZSPASBjN0jVZV0kmzMdN-7oWodB_igy7QgpdhfxUJc Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eea9b635547440ceaa8ebfb0f64a0ff0 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eea9b635547440ceaa8ebfb0f64a0ff0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eea9b635547440ceaa8ebfb0f64a0ff0 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1664528252-project Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 103db15c2dc1472abc44f008e8ab3176 Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1664528252-project Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "b6821bce-d6a2-4d85-9edf-6a102da39593_new"}} Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b6821bce-d6a2-4d85-9edf-6a102da39593', 'body': {'server': {'name': 'b6821bce-d6a2-4d85-9edf-6a102da39593_new'}}} Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:25:43.614733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:43.619010 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:43.622647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] Returning 404 to user: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:43.623950 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b640cb01-6060-417c-b39b-a678759b8b34 tempest-ServersNegativeTestMultiTenantJSON-1664528252 tempest-ServersNegativeTestMultiTenantJSON-1664528252-project] 10.222.0.25 "PUT /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 404 len: 111 microversion: 2.1 time: 0.057814 Aug 30 18:25:43.634730 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1452/3004] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:25:43 2022] PUT /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:25:43.637306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.637817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.645903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.646273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.646750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.647618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.647960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.648751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.691693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:43.818504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.820617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.833850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.835350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.836257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.837674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.838530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.839780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.860360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b21bd93-6d02-4af8-8dfb-c62c2d4d7b6e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 204 len: 0 microversion: 2.1 time: 0.227333 Aug 30 18:25:43.863686 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1553/3005] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:25:43 2022] DELETE /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:25:43.876485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:43.877208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:43.891646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.895878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.896460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:43.899464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:43.900191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:43.900632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:44.129693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:44.140279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df6e579d-4c7b-4911-9767-ba2849d06ec2 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1533 microversion: 2.1 time: 0.273274 Aug 30 18:25:44.141012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1554/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1533 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:44.145980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:44.146761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:44.154169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:44.155003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:44.155606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:44.156702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:44.157318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:44.157927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:44.245004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:44.263713 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17d3cd47-584d-4bd1-abc4-12a6ecd4e42e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1271 microversion: 2.1 time: 0.121258 Aug 30 18:25:44.264989 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1555/3007] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:44 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:44.276997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:44.292430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d47b6d0e-ed2e-4cd9-9608-1a59864b73fb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.480352 Aug 30 18:25:44.295424 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1453/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:43 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:45.167988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:45.170110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:45.198965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.199700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.207755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:45.208600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.209119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.209668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:45.286093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:45.287657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:45.324459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.328912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.332040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:45.340545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.341514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.344147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:45.766708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:45.775106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b930837-3d1f-4d2e-a400-24d67f4014d4 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1533 microversion: 2.1 time: 0.613690 Aug 30 18:25:45.789809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1556/3009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:45 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1533 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:45.795454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:45.796477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:45.804019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.805787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.806492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:45.807492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:45.808203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:45.808842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:46.230643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:46.240050 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36f15228-b154-433d-9a0f-b543bdc60b5f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.448775 Aug 30 18:25:46.241242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1557/3010] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:45 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:46.392067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:46.411321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-63e3741d-ab50-4a81-8fa3-a2508f3c571e tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1313 microversion: 2.1 time: 1.129207 Aug 30 18:25:46.413078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1454/3011] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:45 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1313 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:46.798304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:46.799216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:46.815828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:46.816558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:46.817238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:46.818169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:46.819017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:46.819607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.096126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:47.097144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:47.103902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0981775d2e624f34862fff165cf722ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75847bde432b4e93ac18faba7a993895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:47.115974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.117088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.118434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.121368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.122046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00d86f07-e07a-4a1f-a057-6a3c96b78071 tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 200 len: 1491 microversion: 2.1 time: 0.327922 Aug 30 18:25:47.123768 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1558/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:46 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 1491 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:47.126821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.129339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.178662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:25:47.235965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6821bce-d6a2-4d85-9edf-6a102da39593", "name": "network-vif-deleted", "tag": "19f6e188-27b1-44d0-accb-afb25972b241"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:47.283206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.284921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.285550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.347623 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] Creating event network-vif-deleted:19f6e188-27b1-44d0-accb-afb25972b241 for instance b6821bce-d6a2-4d85-9edf-6a102da39593 on n-h1-854119-10 Aug 30 18:25:47.363034 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0f649235-0fd3-4f36-8752-78c1edbf87c9 req-18c8e43b-491b-419d-a09a-8a9841de835b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136740 Aug 30 18:25:47.369640 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1559/3013] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:47.386599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:47.390793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:47.417275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b0461c0-33fe-4c57-a781-954a180b30f4 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 204 len: 0 microversion: 2.42 time: 0.608517 Aug 30 18:25:47.419538 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1455/3014] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:25:46 2022] DELETE /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:25:47.438539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:47.441360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.442586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:47.452427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.456704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.462380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.463850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.465034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.478222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.481605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.483171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:47.487056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:47.489714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:47.494227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:48.086396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:48.101629 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11888e46-8c85-47d9-b0bb-60af105d9ad5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.725893 Aug 30 18:25:48.117626 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1560/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:47 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:48.128240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:48.129273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:48.137918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:48.138686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:48.139284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:48.140928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:48.141570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:48.142158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:48.166643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:48.197772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:48.203707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:48.205985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de31665d-91ea-43e7-beb2-272641442310 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2957 microversion: 2.42 time: 0.780766 Aug 30 18:25:48.210371 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1456/3016] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:47 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2957 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:48.242659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:48.254157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] [instance: b6821bce-d6a2-4d85-9edf-6a102da39593] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:48.263766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:48.264685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:48.265633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:48.267375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:48.268090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:48.268742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:48.289738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] HTTP exception thrown: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Request method failure captured: Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 HTTP/1.1 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlXvMm94ym_SRpGlknA2ZqBWoVxQxD44TWCsRgP7FUXwBrQl5dTRLzta5uVSQ-n0jO9eyll1TlEhkVL-AAc-_3IGYsFHyVGc4op-nYVrgaZXRA4p-AWmIAJYKCDpj6glIKQGUxgkSt5a1dWdrdZ0D-gpR3Oz_XnLuB54wxhg7CVxtfQ Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 75847bde432b4e93ac18faba7a993895 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1919114035 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75847bde432b4e93ac18faba7a993895"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75847bde432b4e93ac18faba7a993895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75847bde432b4e93ac18faba7a993895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75847bde432b4e93ac18faba7a993895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1919114035 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 75847bde432b4e93ac18faba7a993895 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1919114035 Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1919114035-project Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 0981775d2e624f34862fff165cf722ef Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1919114035-project Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b6821bce-d6a2-4d85-9edf-6a102da39593'} Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:48.291929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. Aug 30 18:25:48.295838 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:25:48.298629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] Returning 404 to user: Instance b6821bce-d6a2-4d85-9edf-6a102da39593 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:48.300387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-113a8be5-74ff-4b80-ad8c-fb99b1c1369e tempest-ServersNegativeTestMultiTenantJSON-1919114035 tempest-ServersNegativeTestMultiTenantJSON-1919114035-project] 10.222.0.25 "GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593" status: 404 len: 111 microversion: 2.1 time: 0.065990 Aug 30 18:25:48.301235 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1457/3017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:48 2022] GET /compute/v2.1/servers/b6821bce-d6a2-4d85-9edf-6a102da39593 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:25:49.162440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:49.162440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:49.169606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:49.170495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:49.172762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:49.176498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:49.177309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:49.177939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:49.329930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:49.340974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d0a9402-f56d-4aea-b1b3-22f32201e06f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.220728 Aug 30 18:25:49.353298 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1561/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:48 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:49.372961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:49.373857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:49.396952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:49.397763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:49.398382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:49.399381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:49.399981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:49.400610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:49.738921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:49.758965 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b95defb-393b-4690-89d0-2316ba0b3979 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.636479 Aug 30 18:25:49.760207 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1458/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:49 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:49.765928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "tag": "7a3f930e-f389-49c0-9146-4b83df6db2f3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:49.849656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:49.852105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:49.852907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:49.954240 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] Creating event network-changed:7a3f930e-f389-49c0-9146-4b83df6db2f3 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:25:49.980828 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cd5692d5-07df-4b14-bf6e-173f85b18a6f req-4e2c2fe8-78e6-4c80-965b-998f7b787e8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205127 Aug 30 18:25:49.982241 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1459/3020] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:50.068554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:50.084132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:50.116727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:50.124442 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0c7fe9a-06c5-4266-bb2d-46424259d283 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2957 microversion: 2.42 time: 0.768604 Aug 30 18:25:50.152879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1562/3021] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:49 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2957 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:50.378167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:50.378945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:50.396771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:50.400023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:50.401210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:50.403530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:50.406648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:50.409056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:50.796636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:50.798514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:50.810131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:50.810984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:50.812119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:50.815508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:50.816926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:50.817650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.178650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:51.193782 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87335752-47d7-4e98-b08f-38332797e84c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.824573 Aug 30 18:25:51.204111 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1460/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:50 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:51.228922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:51.229993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:51.241465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.243118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.243877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.244967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.248102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.249138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.365115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:51.380948 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a76425e0-c5fd-450c-b58b-bfb2b72183df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.591663 Aug 30 18:25:51.396414 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1563/3023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:50 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:51.594899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:51.714761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:51.715625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:51.740071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.743616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.745022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.746525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.771413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.772696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.813851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:51.821392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] HTTP exception thrown: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Request method failure captured: Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 HTTP/1.1 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlRySoHYqxSezN03h7rpjzu1yXp5G678177-mfYlWCinEWyN-vNXP6VwqquiB5IqOGiXNcO0UWClk2-kdj99Ga5nTq_rvKjWjhPA9FCeyPDFklpNu4kQyWn1UZmfcHeyVnaK2RF52vNaYbRcOb3V-OyQGKEVoqtt2N6UTv1TTicFDRw Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1680292b36ac42deb267e040910c8194"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1680292b36ac42deb267e040910c8194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: a12223f3ae4c440895564252bc80b3eb Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '51984186-b715-4f5c-a04b-979c8f0a3ea4'} Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:51.826936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.834313 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.838956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Returning 404 to user: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:51.840321 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8b305c95-7ba7-40e4-abeb-978f4a076d05 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 404 len: 111 microversion: 2.32 time: 0.131337 Aug 30 18:25:51.841554 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1564/3024] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:25:51 2022] DELETE /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:25:51.855339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:51.857643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] [instance: 51984186-b715-4f5c-a04b-979c8f0a3ea4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:51.885704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.890792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.892359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.893553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:51.894248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:51.895097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:51.939601 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] HTTP exception thrown: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Request method failure captured: Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 HTTP/1.1 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlRySoHYqxSezN03h7rpjzu1yXp5G678177-mfYlWCinEWyN-vNXP6VwqquiB5IqOGiXNcO0UWClk2-kdj99Ga5nTq_rvKjWjhPA9FCeyPDFklpNu4kQyWn1UZmfcHeyVnaK2RF52vNaYbRcOb3V-OyQGKEVoqtt2N6UTv1TTicFDRw Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1680292b36ac42deb267e040910c8194"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1680292b36ac42deb267e040910c8194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1680292b36ac42deb267e040910c8194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 1680292b36ac42deb267e040910c8194 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TaggedBootDevicesTest-676129582 Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: a12223f3ae4c440895564252bc80b3eb Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TaggedBootDevicesTest-676129582-project Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '51984186-b715-4f5c-a04b-979c8f0a3ea4'} Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:25:51.941792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. Aug 30 18:25:51.947109 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:25:51.949959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] Returning 404 to user: Instance 51984186-b715-4f5c-a04b-979c8f0a3ea4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:25:51.952291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d275221-3c46-4725-9e87-5e341b852a50 tempest-TaggedBootDevicesTest-676129582 tempest-TaggedBootDevicesTest-676129582-project] 10.222.0.25 "GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4" status: 404 len: 111 microversion: 2.32 time: 0.106503 Aug 30 18:25:51.953523 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1565/3025] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:51 2022] GET /compute/v2.1/servers/51984186-b715-4f5c-a04b-979c8f0a3ea4 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:25:52.232204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:52.233094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:52.250523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:52.258113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:52.259104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:52.259961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:52.261774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:52.262601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:52.263252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:52.468229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:52.480426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:52.488782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:52.491178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59d2ecc3-6e36-404c-b0e9-616d4a6f1b8d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2957 microversion: 2.42 time: 1.284300 Aug 30 18:25:52.518752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1461/3026] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:51 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2957 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:52.526273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:52.527208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:52.550922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:52.551731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:52.552353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:52.553277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:52.553916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:52.560342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:53.231666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=18 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:53.343980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:53.356906 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecad9840-7cb3-42d9-873f-2d7ccf7b0f9a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.835693 Aug 30 18:25:53.365874 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1462/3027] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:52 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:53.384379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "tag": "99efee07-9dee-4967-bbb9-d41d246f4ed6"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:53.444418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:53.445059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:53.445513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:53.498184 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] Creating event network-changed:99efee07-9dee-4967-bbb9-d41d246f4ed6 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:25:53.514465 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f914237e-5d33-4c5a-ba38-b215619a2f5b req-79e5eddc-8b5f-4182-a026-64a7b75fc30b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138472 Aug 30 18:25:53.515291 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1463/3028] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:53.555658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:53.563265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:53.592913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:53.593753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:53.595102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:53.611306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:53.612360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:53.613000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:53.630120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:54.064266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:54.083266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6299950c-70dd-4f3a-99c9-3a7d4636fbd2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.857389 Aug 30 18:25:54.085876 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1566/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:52 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:54.382183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:54.382961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:54.399116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:54.399711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:54.402026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:54.406467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:54.407201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:54.409336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:54.968946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:54.978440 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c73a6cc-58a9-4d00-a8bd-a7ab6211b07b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.600758 Aug 30 18:25:54.983964 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1567/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:54 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:55.028449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:55.053039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:55.057413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:55.063871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac3b9062-7d76-40eb-8391-b2d4ef27bdaa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2957 microversion: 2.42 time: 1.539119 Aug 30 18:25:55.079713 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1464/3031] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:53 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2957 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:55.113748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:55.114661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:55.126153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:55.127633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:55.129382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:55.130227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:55.133716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:55.133716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:55.461319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:55.478890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad58dc9a-fb6c-4aac-9bae-7defb36a6855 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.369317 Aug 30 18:25:55.479530 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1568/3032] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:55 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:25:56.007225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:56.008145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:56.019771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:56.023093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:56.031197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:56.033805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:56.034301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:56.035482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:56.105680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:56.106796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:56.115539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:56.116819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:56.117431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:56.118372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:56.118990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:56.119590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:57.112085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:57.157432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:57.166757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:57.169128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a851c3d2-b849-4f70-9b71-bdd579336225 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2936 microversion: 2.42 time: 1.067578 Aug 30 18:25:57.178253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1569/3033] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:56 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2936 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:25:57.190420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:57.191412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:57.219339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:57.220197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:57.220970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:57.222228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:57.229034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:57.230570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:57.303038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:57.313499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4763b7e-4345-49d3-bbb4-62bf28578539 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 1.312102 Aug 30 18:25:57.323813 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1465/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:56 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:57.362029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "c7b9917f-c612-494f-bb46-629acf69b6c1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:57.379034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:25:57.381534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:57.382170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:57.385431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:57.417901 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] Creating event network-vif-unplugged:c7b9917f-c612-494f-bb46-629acf69b6c1 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:25:57.433409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8c17cc31-2085-420f-aee5-177f6396e2b0 req-22f5396b-86ca-4388-a6b0-b6a7697a7014 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074794 Aug 30 18:25:57.435185 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1466/3035] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:25:58.198779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:58.199877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:58.227275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:58.228107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:58.228727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:58.229637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:58.230637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:58.231331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:58.499989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:58.514938 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d686d1d0-b247-4d7c-8b38-904d688c16bd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.333566 Aug 30 18:25:58.521798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1570/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:57 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:58.527356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:58.528006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:58.559292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:58.560272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:58.560720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:58.561476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:58.561935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:58.562391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:59.077342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:59.091674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-35ad5d8b-13b1-4c8c-88cd-4af022e1ca6d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.568151 Aug 30 18:25:59.100689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1571/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:58 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:25:59.516114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "fd88dabe-1e40-497a-a17d-cef59e4a5d84"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "f7d4c69b-23a6-45aa-8df6-3532cb2bdd55"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "f44263b0-4a1b-4c47-ae87-11c454d595aa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:25:59.562721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:59.563350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:59.563809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:59.622693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Creating event network-vif-unplugged:fd88dabe-1e40-497a-a17d-cef59e4a5d84 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:25:59.626835 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Creating event network-vif-unplugged:f7d4c69b-23a6-45aa-8df6-3532cb2bdd55 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:25:59.627815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] Creating event network-vif-unplugged:f44263b0-4a1b-4c47-ae87-11c454d595aa for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:25:59.654408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-55f03f64-ad30-44a8-8433-58db66d300db req-8bc8b0f1-7c29-4df3-a989-2bbb0fbff1a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.139430 Aug 30 18:25:59.658267 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1572/3038] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:25:59.681589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:25:59.686862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:25:59.711968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:59.713470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:59.713938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:59.714720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:25:59.715459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:25:59.716050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:25:59.943720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:59.989205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:25:59.999373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:00.001052 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9685f180-77c2-44e7-8a37-a00e3085f316 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2936 microversion: 2.42 time: 1.808791 Aug 30 18:26:00.020087 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1467/3039] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:25:58 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2936 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:00.130131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:00.131678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:00.142030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:00.142790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:00.144126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:00.146126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:00.146859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:00.147451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:00.523423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:00.537501 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-556f385d-e96c-4cbe-845b-880bae3515d9 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.874761 Aug 30 18:26:00.558936 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1573/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:25:59 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:01.035121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:01.036100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:01.068334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:01.068975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:01.073420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:01.076353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:01.078905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:01.081858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:01.976742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:02.017257 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de8dc0f0-b475-4029-8b0c-11394cf00e67 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 1.893624 Aug 30 18:26:02.020689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1468/3041] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:00 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:02.060898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:02.061612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:02.082857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:02.087020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:02.087812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:02.088693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:02.089172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:02.089607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:02.214078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:02.229953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:02.231751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:02.235967 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-708cdc29-890c-408a-809a-984dcce63c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2936 microversion: 2.42 time: 1.205187 Aug 30 18:26:02.239998 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1574/3042] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:01 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2936 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:02.248980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "7e6900a7-e5fc-4080-bc85-941d55b2029a"}, {"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-unplugged", "status": "completed", "tag": "07686b3e-76c6-440a-bf29-7d62ba1c4f20"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:02.272403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:02.276244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:02.278583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:02.335185 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Creating event network-vif-unplugged:7e6900a7-e5fc-4080-bc85-941d55b2029a for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:02.340123 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] Creating event network-vif-unplugged:07686b3e-76c6-440a-bf29-7d62ba1c4f20 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:02.349323 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2a8293fb-6f49-451b-9854-92b547893eed req-0faf1571-303e-4c50-842e-076015b9dc02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.106877 Aug 30 18:26:02.349323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1575/3043] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:03.043589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:03.044532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:03.064536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:03.065302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:03.066169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:03.067104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:03.067793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:03.068536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:03.109712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:03.141869 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8af8034-832e-42d4-865a-4c456d694bf1 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.104426 Aug 30 18:26:03.142884 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1469/3044] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:02 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:03.267374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:03.267993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:03.282287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:03.284595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:03.285054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:03.285824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:03.286282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:03.289461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:04.027710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:04.048502 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8cfe0b95-a2d0-4b44-8f75-3ca71baf9caf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 1.009426 Aug 30 18:26:04.050304 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1576/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:03 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:04.167664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:04.168404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:04.189100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:04.189612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:04.190232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:04.193593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:04.194329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:04.194963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:04.711459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:04.767432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:04.789787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:04.794546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a4f12f4-6112-406d-bf2b-96e03033d95e tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2915 microversion: 2.42 time: 1.529454 Aug 30 18:26:04.802803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1470/3046] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:03 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2915 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:05.071214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:05.072109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:05.077569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:05.081747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:05.083706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:05.084322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:05.085229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:05.085852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:05.086491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:05.090687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4e68ec8-0b60-49ff-8d98-e32abc20a5fd tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.925913 Aug 30 18:26:05.092180 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1577/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:04 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:05.826076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:05.826859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:05.844091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:05.847361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:05.848241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:05.849241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:05.853002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:05.854457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:05.991594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:06.002748 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8776aa2d-3746-4ea7-bf79-c3958b7bd5d7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.935368 Aug 30 18:26:06.020421 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1471/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:05 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:06.077504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-deleted", "tag": "f7d4c69b-23a6-45aa-8df6-3532cb2bdd55"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:06.096464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:06.104537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:06.105332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:06.135860 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] Creating event network-vif-deleted:f7d4c69b-23a6-45aa-8df6-3532cb2bdd55 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:06.178506 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0a0b0249-75ba-4e74-b297-d680f1446300 req-f4dbdbd5-9113-49f8-909c-845544af07b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101934 Aug 30 18:26:06.182783 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1472/3049] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:06.224300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:06.227798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:06.256526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:06.258574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:06.259348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:06.262791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:06.264415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:06.265156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:06.705898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:06.720789 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5293103a-73fc-495f-8681-9c222d9daaff tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.520515 Aug 30 18:26:06.721983 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1473/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:06 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:07.030151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:07.031685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.056746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.061084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.061760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.062644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.067212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.068435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.379395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.397409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.444140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:07.447880 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c55a375-9e76-439a-a817-fa7e8bd72cc7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2869 microversion: 2.42 time: 1.624967 Aug 30 18:26:07.448547 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1578/3051] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:05 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2869 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:07.468473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "name": "network-vif-plugged", "status": "completed", "tag": "99efee07-9dee-4967-bbb9-d41d246f4ed6"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:07.504825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.505317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.505756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.530974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] Creating event network-vif-plugged:99efee07-9dee-4967-bbb9-d41d246f4ed6 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:26:07.540468 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b62578c0-8fb2-4a45-96cf-2ef804671be9 req-2246d9b6-6acc-4eb5-9d09-a9cc58bfe75c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089687 Aug 30 18:26:07.541665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1579/3052] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:07.753197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:07.753919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:07.772177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.778158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.779045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:07.780097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:07.780818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:07.782011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.050615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:08.065125 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-11dd4f5a-cc03-4bf9-a2e5-7dcb21cb2118 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 1.040442 Aug 30 18:26:08.080791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1474/3053] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:07 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:08.455553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-deleted", "tag": "7e6900a7-e5fc-4080-bc85-941d55b2029a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:08.475821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:08.476304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:08.476731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.507497 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] Creating event network-vif-deleted:7e6900a7-e5fc-4080-bc85-941d55b2029a for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:08.524698 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-95d3f011-8320-462f-99d8-a9e36d3455a6 req-d36cd434-3283-4e90-a01c-bccea1fd28e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071625 Aug 30 18:26:08.527322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1475/3054] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:08.540171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:08.564595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:08.603844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:08.605324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:08.606044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.607717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:08.609410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:08.610131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:08.831537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:08.848147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-480c3df7-d5e0-4cd3-b582-06dd0660949d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.099296 Aug 30 18:26:08.848814 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1580/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:07 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:09.086545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:09.087184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:09.100721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:09.101151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:09.101699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:09.102462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:09.102928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:09.103361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:09.794784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:09.818047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:09.819952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:09.825887 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14eb92ac-dfd0-4472-888b-fc5aa9b78c14 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2549 microversion: 2.42 time: 1.294033 Aug 30 18:26:09.828656 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1476/3056] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:08 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2549 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:09.916883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:09.941916 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-180e07e6-ce95-4182-bb5e-95bf28a50912 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 0.859255 Aug 30 18:26:09.944071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1581/3057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:09 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:09.951324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a3f930e-f389-49c0-9146-4b83df6db2f3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:09.964499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:09.979136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:09.981274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:09.982634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.010320 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] Creating event network-vif-plugged:7a3f930e-f389-49c0-9146-4b83df6db2f3 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:26:10.027299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a8d8e1ec-e1f4-4e8a-940e-a2d1fff3e936 req-c9d89343-76c4-490d-993d-46b0d81bfe77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076637 Aug 30 18:26:10.040923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1582/3058] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:10.062672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.064942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:10.087822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.088651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.089287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.098010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.098677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.099138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.221266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4eb3ac61-a355-47b3-a68d-c148c6707905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Calling method '.version_select at 0x7f4e567fa8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.341303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4eb3ac61-a355-47b3-a68d-c148c6707905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.508740 Aug 30 18:26:10.342182 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1477/3059] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:26:09 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:26:10.363355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee5b4bf7-9b40-4991-adff-15030fb5c905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Action: 'create', calling method: .version_select at 0x7f4e55d17550>, body: {"pool": "non_exist_pool"} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:10.456993 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ee5b4bf7-9b40-4991-adff-15030fb5c905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] HTTP exception thrown: Floating IP pool not found. Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee5b4bf7-9b40-4991-adff-15030fb5c905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Request method failure captured: Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 26 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlZBLp-FlAqy_wK6Bu2zqyzxY32stILvIyZ7Eu4OZQJEvgfy3aFwbFP8QqpLUqE_wQkTVoZ42kyLEdtjazQzZha72Tm2UprRjFg5YPC0A6yGS6DJ2dWLFdvP-LMdsI0Uly8yN2InrxNeVPHtY8ElEmRakK_f2vgHmerI_ZJd8eQQI0U Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 08c7e50bd49b42f5b9287f082e0d9bc0 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 08c7e50bd49b42f5b9287f082e0d9bc0 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsNegativeTestJSON-656533225-project Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9d9f9e733d8241268f00cc87f82a34f9 Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-656533225-project Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: {"pool": "non_exist_pool"} Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: exception: Floating IP pool not found. Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:10.458813 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:10.463554 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 30 18:26:10.463554 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.465370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee5b4bf7-9b40-4991-adff-15030fb5c905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Returning 404 to user: Floating IP pool not found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:10.466765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee5b4bf7-9b40-4991-adff-15030fb5c905 tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.110055 Aug 30 18:26:10.468296 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1478/3060] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:26:10 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:26:10.477523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Calling method '.version_select at 0x7f4e56936f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.736600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9e81957c-c0aa-416d-8e23-d3ef31496910 could not be found", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:26:10.737988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] HTTP exception thrown: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Request method failure captured: Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-floating-ips/9e81957c-c0aa-416d-8e23-d3ef31496910 HTTP/1.1 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlZBLp-FlAqy_wK6Bu2zqyzxY32stILvIyZ7Eu4OZQJEvgfy3aFwbFP8QqpLUqE_wQkTVoZ42kyLEdtjazQzZha72Tm2UprRjFg5YPC0A6yGS6DJ2dWLFdvP-LMdsI0Uly8yN2InrxNeVPHtY8ElEmRakK_f2vgHmerI_ZJd8eQQI0U Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 08c7e50bd49b42f5b9287f082e0d9bc0 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c7e50bd49b42f5b9287f082e0d9bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 08c7e50bd49b42f5b9287f082e0d9bc0 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-656533225 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsNegativeTestJSON-656533225-project Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9d9f9e733d8241268f00cc87f82a34f9 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-656533225-project Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: exception: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '9e81957c-c0aa-416d-8e23-d3ef31496910'} Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9e81957c-c0aa-416d-8e23-d3ef31496910 could not be found Aug 30 18:26:10.740322 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41b4ca9f-4c35-4773-b071-f4281666112a'] Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910. Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910 Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910 Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] Returning 404 to user: Floating IP not found for ID 9e81957c-c0aa-416d-8e23-d3ef31496910 {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:10.746244 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4675edac-2081-4372-b531-3b840d17e00d tempest-FloatingIPsNegativeTestJSON-656533225 tempest-FloatingIPsNegativeTestJSON-656533225-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9e81957c-c0aa-416d-8e23-d3ef31496910" status: 404 len: 111 microversion: 2.1 time: 0.268551 Aug 30 18:26:10.756116 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1479/3061] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:26:10 2022] DELETE /compute/v2.1/os-floating-ips/9e81957c-c0aa-416d-8e23-d3ef31496910 => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:10.779911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-deleted", "tag": "fd88dabe-1e40-497a-a17d-cef59e4a5d84"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:10.837496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.842705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.843178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.913479 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] Creating event network-vif-deleted:fd88dabe-1e40-497a-a17d-cef59e4a5d84 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:10.934001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f6ace95d-ce98-4d84-951b-b11a17246ad5 req-f461b5c4-aecf-4127-92d7-5319b1823cb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175844 Aug 30 18:26:10.936054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:10.938238 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1480/3062] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:10.944788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.946159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:10.950442 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-efac54d9-39cd-4a17-a333-cceee6ab5f0c tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 0.904479 Aug 30 18:26:10.951044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1583/3063] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:10 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:10.979458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:10.980116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:10.983703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.985048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.986085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.987041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:10.988529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:10.989904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:10.996656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.002844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.003430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:11.004099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.005338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.006212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:11.651199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:11.675831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:11.684717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:11.687702 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-114521ba-e2fc-4743-af5d-f20987c800e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2549 microversion: 2.42 time: 0.747377 Aug 30 18:26:11.704968 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1481/3064] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:10 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2549 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:11.977351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:11.981181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:11.992754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.993274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.994942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:11.996469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:11.998407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:11.999468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:12.399337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:12.415848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:12.460411 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d8692ee-e2d4-4c98-9f79-0ed621431b10 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1543 microversion: 2.1 time: 1.483136 Aug 30 18:26:12.467207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1584/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:10 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1543 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:12.714282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:12.715515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:12.733370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:12.733910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:12.736430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:12.737457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:12.741478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:12.742684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:13.608676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:13.625231 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8120fa2a-1469-4aa0-803e-51deaa4b7377 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1334 microversion: 2.1 time: 1.646054 Aug 30 18:26:13.625911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1482/3066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:11 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1334 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:13.640994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:13.645665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:13.655502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:13.656212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:13.656839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:13.658233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:13.659006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:13.659735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:13.728034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:13.756837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:13.759034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:13.761486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aeff1487-79d4-466b-b1e1-43927d669bfd tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2389 microversion: 2.42 time: 1.051959 Aug 30 18:26:13.778335 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1585/3067] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:12 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2389 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:14.657370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:14.658330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:14.682460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:14.694929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:14.700337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:14.702330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:14.705957 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e99458ea-6f68-4ed1-acd2-8cd22b3237b9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1542 microversion: 2.1 time: 1.078356 Aug 30 18:26:14.706984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:14.714438 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1483/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:13 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1542 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:14.730533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:14.734581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:14.792056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:14.793730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:14.828582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:14.829077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:14.829514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:14.830233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:14.830709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:14.831125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.571259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:15.574572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:15.608173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:15.608963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e04d56ce-4297-41d1-86f8-86fa8544172a tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1669 microversion: 2.1 time: 0.932690 Aug 30 18:26:15.618127 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1586/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:14 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1669 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:15.620387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:15.622572 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93fb5adc-c29b-471b-9453-a40e8807d4aa tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2389 microversion: 2.42 time: 0.836822 Aug 30 18:26:15.623841 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1484/3070] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:14 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2389 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:15.637100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-deleted", "tag": "f44263b0-4a1b-4c47-ae87-11c454d595aa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:15.662552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:15.663053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:15.675053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.675764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.676521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.689757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.690252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.690741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.691580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.692035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.692459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.714013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] Creating event network-vif-deleted:f44263b0-4a1b-4c47-ae87-11c454d595aa for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:15.732233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-26b56941-4a14-4ed7-b036-b24eb00e86ba req-d80a8ec3-8ac5-433d-93ea-7891430e3516 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111934 Aug 30 18:26:15.733850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1587/3071] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:15.743112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:15.750065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:15.779007 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48d91767-3bcd-4005-92cc-b899f55b57f3 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed/ips" status: 200 len: 179 microversion: 2.1 time: 0.122989 Aug 30 18:26:15.785834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1485/3072] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:26:15 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed/ips => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:15.792510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:15.793039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:15.800166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.802443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.802858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.803633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.806734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.808755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.812513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.812862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.813301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.814018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:15.823207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:15.826072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:15.878485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:26:15.887289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:16.029569 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e7d4539-28c3-4e73-a1a3-152947c20b5d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "DELETE /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 204 len: 0 microversion: 2.1 time: 0.242066 Aug 30 18:26:16.033425 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1486/3073] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:26:15 2022] DELETE /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:26:16.045405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:16.046850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:16.058519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.059714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.060442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:16.061584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.062218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.062846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:16.568455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:16.594622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8bcff31-395e-4e34-ae1e-c94570536ce2 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1675 microversion: 2.1 time: 0.556128 Aug 30 18:26:16.595239 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1487/3074] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:16 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1675 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:16.657809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:16.658806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:16.667546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.669423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.670809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:16.672181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:16.672883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:16.673477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:17.057545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:17.070066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cfb26e3a-035e-4829-a260-e280df5428c3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1542 microversion: 2.1 time: 1.334595 Aug 30 18:26:17.079979 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1588/3075] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:15 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1542 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:17.085363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:17.104344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:17.105301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:17.105907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:17.143448 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Creating event network-vif-unplugged:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:26:17.150273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] Instance 4fef1157-56b1-474b-8613-499cda01795f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:26:17.163833 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1224f290-a8a9-4e65-8dec-b14a22e0be44 req-4ca457e7-ced3-44e8-8774-1947977ff4f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082212 Aug 30 18:26:17.169705 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1589/3076] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:17.215711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:17.234796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:17.236286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:17.237694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7e8f265-f4f1-40ee-aed1-db3ddaf93d5b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2097 microversion: 2.42 time: 0.587010 Aug 30 18:26:17.241758 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1488/3077] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:16 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2097 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:17.618937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:17.619705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:17.633143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:17.633650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:17.634784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:17.635810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:17.639563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:17.640117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.077525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:18.089637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db6f78e5-5c0c-4e8d-857f-df91935bf851 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1675 microversion: 2.1 time: 0.475307 Aug 30 18:26:18.090438 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1590/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:17 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1675 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:18.100687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:18.101586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:18.109755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.110931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.112448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.113634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.115159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.116372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.267932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:18.269340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:18.292057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.293993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.295950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.299496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:18.300268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:18.300920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:18.509169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:18.534507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:18.542057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:18.543814 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d851fd34-dba1-4bd3-8f81-9cbcafd2c9db tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 2030 microversion: 2.42 time: 0.280514 Aug 30 18:26:18.555357 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1591/3079] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:18 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 2030 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:19.126443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:19.127904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:19.143238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.146142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.146905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.149813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.150506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.154579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.376391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.387842 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f29f161-280f-4b19-bef6-222250d540b0 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1675 microversion: 2.1 time: 0.265102 Aug 30 18:26:19.389001 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1592/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:19 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:19.531556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90", "name": "network-vif-deleted", "tag": "07686b3e-76c6-440a-bf29-7d62ba1c4f20"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:19.556552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.559027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.562999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.602829 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] Creating event network-vif-deleted:07686b3e-76c6-440a-bf29-7d62ba1c4f20 for instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 on n-h2-854119-10 Aug 30 18:26:19.612135 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-24a124b8-b1ea-4106-80a3-a392a354a09e req-9ddadad3-fc1b-49bb-82a8-1717d9042e06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084635 Aug 30 18:26:19.617687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1593/3081] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:19.623723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:19.635935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:19.656760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.657653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.658209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.659313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:19.663138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:19.663727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:19.830508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.853068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.855044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.857231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64ebe48e-46c5-4774-904a-9f6ba6516eb3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.237978 Aug 30 18:26:19.861672 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1594/3082] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:19 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:19.909436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:19.921704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1786e929-6257-4a3f-9517-f79bb7db155f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1474 microversion: 2.1 time: 1.824928 Aug 30 18:26:19.932123 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1489/3083] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:18 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1474 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:20.419862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:20.420575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:20.431740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.439148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.439789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.440671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.441246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.441772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.739018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:20.752917 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3ed375f-b02e-4b07-a4e3-2b68ee696b29 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1675 microversion: 2.1 time: 0.337738 Aug 30 18:26:20.763758 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1595/3084] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:20 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1675 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:20.897338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:20.899142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:20.925884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.926864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.930177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.932932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.935272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.936586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.953564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:20.954659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:20.975403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.982128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.984250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:20.987292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:20.989588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:20.990373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:21.461319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:21.485304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:21.488538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:21.501656 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61bdd904-37ad-4b0e-85e0-ab613fbfaf9d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.602262 Aug 30 18:26:21.505410 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1490/3085] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:20 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:21.780029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:21.782324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:21.797947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:21.798857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:21.801576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:21.802663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:21.803372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:21.806675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:21.848080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:21.868076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66f0ad86-b310-4006-9988-13f873be4076 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1471 microversion: 2.1 time: 0.919734 Aug 30 18:26:21.868682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1596/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:20 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1471 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:21.902579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:21.903792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:21.918449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:21.920317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:21.921762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:21.923655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:21.924292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:21.924956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.041509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.042433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.043537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.044668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.045355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.045967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.092694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:26:22.102020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:26:22.380689 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17f93739-e5b3-4a93-b344-c49a29b487df tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f/action" status: 202 len: 0 microversion: 2.1 time: 0.490144 Aug 30 18:26:22.400201 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1597/3087] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:26:21 2022] POST /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:26:22.428149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "name": "network-vif-deleted", "tag": "99efee07-9dee-4967-bbb9-d41d246f4ed6"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:22.473919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.475238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.475888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.513631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] Creating event network-vif-deleted:99efee07-9dee-4967-bbb9-d41d246f4ed6 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:26:22.526446 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cff550fc-fda9-4403-bdc3-9ce1f3ae0edd req-bd4811d1-ba58-4dac-a092-b22ffaa69169 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120687 Aug 30 18:26:22.528448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1598/3088] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:22.574701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:22.575442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:22.596806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.600563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.601022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.607788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.609342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.609788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.947446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:22.961344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87e4c14f-9a6f-412c-850e-1a34ca4b87f5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1470 microversion: 2.1 time: 0.426496 Aug 30 18:26:22.962466 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1599/3089] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:22 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:22.972554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:22.976080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:22.989755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.992981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:22.993891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:22.997319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:22.998270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:23.001143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:23.122859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:23.133185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:23.138662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:23.140371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:23.142118 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70928a68-4de2-494c-86a3-f3b462778640 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.178106 Aug 30 18:26:23.158130 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1600/3090] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:22 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:23.158130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "name": "network-vif-unplugged", "status": "completed", "tag": "7a3f930e-f389-49c0-9146-4b83df6db2f3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:23.164709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:23.165610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:23.166814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:23.194315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] Creating event network-vif-unplugged:7a3f930e-f389-49c0-9146-4b83df6db2f3 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:26:23.204985 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-11b53f01-3356-498e-9548-33858354cef4 req-01d50766-5d65-4b1f-ad03-3b64feefbce5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059953 Aug 30 18:26:23.211365 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1601/3091] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:23.440551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:23.454948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2cdaea29-611d-4462-9e38-842f0c2601ea tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1654 microversion: 2.1 time: 1.679672 Aug 30 18:26:23.456145 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1491/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:21 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1654 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:23.989588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:23.991237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:24.006544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.010903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.011773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.012872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.015657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.016295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.167334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:24.168034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:24.186751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.201668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.202136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.203172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.204144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.207170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.415536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:24.431015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:24.432604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:24.434109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac22a665-2dbb-47ed-a08e-3ddc80cf76ab tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.272645 Aug 30 18:26:24.443225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1492/3093] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:24 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:24.481278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:24.482480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:24.498108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.500804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.501273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.502036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:24.502647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:24.503085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:24.796506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:24.815871 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed2c456e-0da7-4867-ad71-909d7e4a16eb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1470 microversion: 2.1 time: 0.832028 Aug 30 18:26:24.816829 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1602/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:23 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1470 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:25.266550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-plugged", "status": "completed", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:25.292708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.293653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.294250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.318046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Creating event network-vif-plugged:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:26:25.336936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] Instance 4fef1157-56b1-474b-8613-499cda01795f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:26:25.356438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8052da01-f158-487b-9859-0fd7f07d07d9 req-13ce0565-1f32-4950-a7f1-860881a7d95d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093469 Aug 30 18:26:25.357183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1603/3095] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:25.467603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:25.468723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:25.485753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.486924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.487599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.488673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.489353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.490019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.493841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f05e9577a24221b139025ca597ffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cdf3112b234567bcff894747ab473b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:25.512309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-faeb24c6-8d49-4316-9cd3-58da8df1803d tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 200 len: 1496 microversion: 2.1 time: 1.035777 Aug 30 18:26:25.525858 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1493/3096] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:24 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 1496 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:25.624890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377090a8-8190-4869-bfea-3d4a0ae3f8ed", "name": "network-vif-deleted", "tag": "7a3f930e-f389-49c0-9146-4b83df6db2f3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:25.654846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.655410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.656284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.686677 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] Creating event network-vif-deleted:7a3f930e-f389-49c0-9146-4b83df6db2f3 for instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed on n-h1-854119-10 Aug 30 18:26:25.704323 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b299c556-a521-4d6d-80fa-1beee52f3481 req-d6632fab-ed3f-4a0f-8ff2-b614e9991796 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084856 Aug 30 18:26:25.705355 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1494/3097] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:25.808802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:25.823925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:25.843865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:25.844806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:25.852081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:25.857299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-479b63d9-1f0d-4753-9088-f4cc40c80c4f tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.394000 Aug 30 18:26:25.861657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1604/3098] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:25 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:25.884349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.884995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.885605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:25.886417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:25.886932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:25.896676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.539937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:26.540395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:26.561525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.568750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.569471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.570315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.570817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.571243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.612198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed HTTP/1.1 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '377090a8-8190-4869-bfea-3d4a0ae3f8ed'} Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:26.622951 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:26.628061 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:26.631083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:26.632267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8acc813-1e46-4764-9d88-76a480789e7f tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 404 len: 111 microversion: 2.1 time: 0.101305 Aug 30 18:26:26.635018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1605/3099] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:26 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:26.861600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:26.877601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b28158cf-1109-4891-a234-972fdd075ac4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1470 microversion: 2.1 time: 1.043612 Aug 30 18:26:26.886364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:26.887603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:26.889967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1495/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:25 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1470 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:26.902456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.903275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.903920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:26.904815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:26.905429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:26.906016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.583419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.604527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.609787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:27.615823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4651cf2e-8458-489a-8514-382a6f735c7d tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.733761 Aug 30 18:26:27.619460 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1606/3101] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:26 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:27.905808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:27.906472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:27.914637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.915956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.916582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:27.917664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:27.918528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:27.923855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:28.501644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:28.556198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a16671a-02ab-4bb5-8afb-dcc18a4c0268 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1470 microversion: 2.1 time: 0.654182 Aug 30 18:26:28.609501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1496/3102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:27 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1470 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:28.642147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:28.642861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:28.662578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:28.663696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:28.664351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:28.665290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:28.665900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:28.666509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:29.067832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:29.091915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:29.094122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:29.096115 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-571cd4e7-5177-4b68-a8f9-cd00df43d48c tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.458751 Aug 30 18:26:29.099143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1607/3103] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:28 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:29.618442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:29.619073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:29.630231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:29.631826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:29.632314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:29.636101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:29.647823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:29.649381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:29.649832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.130055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:30.133653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:30.161044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:30.172875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.204148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.208776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.209699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:30.210206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:30.210670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:30.220615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6526ae66-f447-473b-bf10-d1dfd06d327a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1470 microversion: 2.1 time: 0.588054 Aug 30 18:26:30.223222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1497/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:29 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1470 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:30.613086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:30.648504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:30.649952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:30.651401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ca19e27-fc2b-46f8-b2e1-da0180d57494 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.530246 Aug 30 18:26:30.652026 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1608/3105] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:30 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:31.248196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:31.252387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:31.271119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.271625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.272058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.272793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.273573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.274179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.680858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:31.686013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:31.689466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:31.702828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.702996 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5952642b-9e64-43d4-bca9-7afc30442765 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1536 microversion: 2.1 time: 0.459142 Aug 30 18:26:31.703655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.705804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1498/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:31 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1536 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:31.711051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.711931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:31.712578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:31.714728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:31.971404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:31.990714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:31.998710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:32.003448 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-055c4239-4080-40cf-80b7-d7d01512e529 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.328444 Aug 30 18:26:32.005955 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1609/3107] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:31 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:32.686911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:32.709187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:32.709899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:32.710685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:32.725206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:32.734067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:32.751957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:32.758082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:32.758691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:32.759195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:32.763310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:32.764466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:32.766712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:32.769331 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Creating event network-vif-unplugged:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:26:32.796408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] Instance 4fef1157-56b1-474b-8613-499cda01795f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:26:32.811733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-df31bc8a-41b1-4927-9c80-ab616cef5725 req-9b090f31-c68f-4133-b7a6-415f41bd70ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128738 Aug 30 18:26:32.812878 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1499/3108] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:26:33.030364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:33.031642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:33.046134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:33.046795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:33.047506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:33.049943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:33.050651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:33.053250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:33.460369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:33.483064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:33.485026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:33.486609 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85f9cdb3-1236-427e-84cd-1671597c29ad tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.460951 Aug 30 18:26:33.487689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1500/3109] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:33 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:34.438112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:34.454862 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89c98f5e-8bdd-4b1f-a2a5-8b6b45341353 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1536 microversion: 2.1 time: 1.733499 Aug 30 18:26:34.459391 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1610/3110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:32 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1536 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:34.519115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:34.520622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:34.559043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:34.560015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:34.560471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:34.567153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:34.567654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:34.568202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:34.863526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:34.889723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:34.891219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:34.892525 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d067fcf8-bd48-4b98-8294-0d58de451465 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.379993 Aug 30 18:26:34.893072 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1501/3111] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:34 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:35.483141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:35.484419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:35.502922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.503772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.508739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:35.513627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.514404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.515163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:35.918301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:35.919116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:35.936627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.940799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.942674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:35.943596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:35.944280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:35.947323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:36.173529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:36.197956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:36.205239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:36.217049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:36.221512 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-114632d0-0c43-4183-8094-38f4e1e16818 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.308850 Aug 30 18:26:36.232731 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1502/3112] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:35 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:36.556050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:36.567401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a9f846b-7f91-4153-a1a5-af1de93b8371 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1529 microversion: 2.1 time: 1.089117 Aug 30 18:26:36.571597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1611/3113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:35 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1529 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:36.595960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:36.597242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:36.612249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:36.612762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:36.613204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:36.614298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:36.622691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:36.623415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:37.090822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:37.111348 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f40d0392-a20a-4a2c-9a38-19780c528f43 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1529 microversion: 2.1 time: 0.519382 Aug 30 18:26:37.112710 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1503/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:36 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1529 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:37.150193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-574cc614-f406-44d6-88df-e7cd5d9b0b73 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:37.163861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-574cc614-f406-44d6-88df-e7cd5d9b0b73 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] HTTP exception thrown: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-574cc614-f406-44d6-88df-e7cd5d9b0b73 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Request method failure captured: Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/flavors/d312abe8-d266-41b2-b343-d44661996767 HTTP/1.1 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlVeuc-WGJJ2Lt8SB3uce3J5Gase9KtbOMhgBbXQkMXMnl4uIGctDhjAXPqDQ47i8rl91OVMXMinD946gelio-HzU16aeDvedjdN7EHD6UFN26iHzss43pTGFfLXPClRvwGZxGcHd6_cAAwqPv6_ptg3HwESGPf2CSWL62DAaT0xJ6w Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ea2dba7ca7934bf187b00f707d8581dd Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MigrationsAdminTest-1820220372 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea2dba7ca7934bf187b00f707d8581dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea2dba7ca7934bf187b00f707d8581dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea2dba7ca7934bf187b00f707d8581dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea2dba7ca7934bf187b00f707d8581dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MigrationsAdminTest-1820220372 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ea2dba7ca7934bf187b00f707d8581dd Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MigrationsAdminTest-1820220372 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MigrationsAdminTest-1820220372-project-admin Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 0aecddcc1cdc4f7db102acd0b9c21774 Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MigrationsAdminTest-1820220372-project-admin Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd312abe8-d266-41b2-b343-d44661996767'} Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:37.169974 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-574cc614-f406-44d6-88df-e7cd5d9b0b73 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Returning 404 to user: Flavor d312abe8-d266-41b2-b343-d44661996767 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-574cc614-f406-44d6-88df-e7cd5d9b0b73 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/d312abe8-d266-41b2-b343-d44661996767" status: 404 len: 109 microversion: 2.1 time: 0.025419 Aug 30 18:26:37.174164 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1612/3115] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:26:37 2022] DELETE /compute/v2.1/flavors/d312abe8-d266-41b2-b343-d44661996767 => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:37.257695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:37.259100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:37.271548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:37.276545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:37.277377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:37.278623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:37.279399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:37.280119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:37.443712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-397125654", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:37.482828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:37.516527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:37.524527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:37.528880 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e9a091c-bfcc-4013-900a-0781bdbc73a7 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.274619 Aug 30 18:26:37.532899 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1504/3116] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:37 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:37.643919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:26:38.577046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:38.577855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:38.593273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:38.593764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:38.594203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:38.594969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:38.595422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:38.595848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:38.834334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:38.848142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:38.849675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:38.864192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bcaede70-7e8f-4a75-b590-980332f2a6c1 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.291929 Aug 30 18:26:38.864657 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1505/3117] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:38 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:39.022011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:26:39.022894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:26:39.024061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:26:39.024922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:26:39.032502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:26:39.066636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.076183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.077049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.078125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.078735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.079324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.167023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:26:39.193637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Getting quotas for user 4101b57c797e491e897f9871b5f5b1a0 and project 5fd4f43a900b48eebd7e4589e8cf1cab. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:26:39.229895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.230846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.252251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:26:39.258383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.260068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.261242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.263554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.264802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.265012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:26:39.266440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.293394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed HTTP/1.1 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '377090a8-8190-4869-bfea-3d4a0ae3f8ed'} Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:39.297604 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.302624 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.306974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:39.309218 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1bb938f-e03f-4a32-b729-dce72373c170 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "DELETE /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 404 len: 111 microversion: 2.1 time: 0.089705 Aug 30 18:26:39.311171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1506/3118] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:26:39 2022] DELETE /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:39.324134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.325966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 377090a8-8190-4869-bfea-3d4a0ae3f8ed] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.349820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.355001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.358675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.371007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e144c1f4-772a-4b88-b3f1-0345c35ad690 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.934561 Aug 30 18:26:39.378947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1613/3119] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:26:39.383388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.384520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.385345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.386297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13771de4-5edc-4dc7-acf6-8f490a4e3f38 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.387385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13771de4-5edc-4dc7-acf6-8f490a4e3f38 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.429236 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed HTTP/1.1 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '377090a8-8190-4869-bfea-3d4a0ae3f8ed'} Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.436239 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.442102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 377090a8-8190-4869-bfea-3d4a0ae3f8ed could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:39.443142 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f12ac622-92f5-4a24-9382-692f6ce86862 tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed" status: 404 len: 111 microversion: 2.1 time: 0.126796 Aug 30 18:26:39.449751 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1507/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:39 2022] GET /compute/v2.1/servers/377090a8-8190-4869-bfea-3d4a0ae3f8ed => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:39.501854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.502864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.537988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.540616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.547074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.559959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.575822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.579504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.625106 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 HTTP/1.1 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '65d113b2-b39b-4124-a35d-e3267dbd9794'} Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:39.630027 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.639965 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.645400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:39.647491 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ba650f3-c3d7-44ba-9500-3d1e3a66c0cc tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 404 len: 111 microversion: 2.1 time: 0.192660 Aug 30 18:26:39.661594 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1508/3121] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:26:39 2022] DELETE /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:39.682538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.689703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] [instance: 65d113b2-b39b-4124-a35d-e3267dbd9794] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.713775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.715775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.718756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.719790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.720393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.723796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.770764 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] HTTP exception thrown: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Request method failure captured: Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 HTTP/1.1 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlXH67_OTXZI0ksFb6WhBjUu91ukXWmRnhY3G_bxatpcJGrgeFL5-etvH5rwhctE2S9i1BWjk3LUxgtBLQbi0ot19gETZZe5Xos0KuGKrC500fbt9bGpEJ5TK8vWpDx3gTwAriClAFRfpwQbtcgpT6jX2Qy_AqfrdJtgI2wZR9TU0TI Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65cdf3112b234567bcff894747ab473b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65cdf3112b234567bcff894747ab473b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65cdf3112b234567bcff894747ab473b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 65cdf3112b234567bcff894747ab473b Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestMultiNic-1732201407 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: c1f05e9577a24221b139025ca597ffa1 Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestMultiNic-1732201407-project Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '65d113b2-b39b-4124-a35d-e3267dbd9794'} Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:39.777232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. Aug 30 18:26:39.782068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:26:39.783389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] Returning 404 to user: Instance 65d113b2-b39b-4124-a35d-e3267dbd9794 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:39.788299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a7bf6ee2-2c06-4ab0-8bd8-812db45df6fa tempest-ServersTestMultiNic-1732201407 tempest-ServersTestMultiNic-1732201407-project] 10.222.0.25 "GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794" status: 404 len: 111 microversion: 2.1 time: 0.121438 Aug 30 18:26:39.789386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1509/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:39 2022] GET /compute/v2.1/servers/65d113b2-b39b-4124-a35d-e3267dbd9794 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:26:39.884499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-13771de4-5edc-4dc7-acf6-8f490a4e3f38 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:39.898901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13771de4-5edc-4dc7-acf6-8f490a4e3f38 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1212 microversion: 2.1 time: 0.516861 Aug 30 18:26:39.907091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:39.907818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:39.914577 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1614/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:39 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1212 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:39.922314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.926525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.927151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:39.928019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:39.930473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:39.931180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.279784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:40.296522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:40.299968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:40.302774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8e6c904-f0f2-4edc-9c02-573150b360b3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.401357 Aug 30 18:26:40.305554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1510/3124] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:39 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:40.927033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:40.927677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:40.944820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:40.951487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.952434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.955059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:40.956286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:40.970490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:40.971280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:41.333482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:41.334201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:41.355983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:41.356665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:41.357711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:41.358728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:41.359638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:41.360490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:41.595233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:41.662978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e28fc0a-bd3c-44dc-a260-6587bf3da5ce tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1264 microversion: 2.1 time: 0.734814 Aug 30 18:26:41.666402 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1615/3125] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:40 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1264 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:42.517706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:42.529956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:42.531443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:42.532672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a05345c-fd42-4684-8179-fcac1ea0de52 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 1.203456 Aug 30 18:26:42.533241 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1511/3126] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:41 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:42.692978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:42.693590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:42.710761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:42.711317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:42.717100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:42.718390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:42.719135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:42.719751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:43.022934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:43.035205 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37d1e2c0-b5b4-443d-a54a-74a584f9cfac tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1270 microversion: 2.1 time: 0.346746 Aug 30 18:26:43.042921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1616/3127] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:42 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:43.323820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-plugged", "status": "completed", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:43.348891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:43.349721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:43.350386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:43.366558 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] Creating event network-vif-plugged:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:26:43.384118 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6164ad3b-8fc8-47d1-9e29-ca3c134d51af req-a50247a6-0740-4221-a144-b54610f65973 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064412 Aug 30 18:26:43.385514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1512/3128] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:43.559513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:43.560527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:43.569367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:43.575240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:43.576574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:43.577394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:43.579146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:43.579610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:43.730794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:43.772928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:43.776790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:43.778955 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6129064e-9d88-429a-8ec8-f6cd467e765b tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.225650 Aug 30 18:26:43.783206 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1617/3129] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:43 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:26:44.069859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:44.074989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:44.094660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:44.095514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:44.096169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:44.099668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:44.100446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:44.101126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:44.313717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:44.328944 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28df2775-61e6-442b-89ad-54cab088c276 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1270 microversion: 2.1 time: 0.267670 Aug 30 18:26:44.345264 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1513/3130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:44 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1270 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:44.814235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:44.814965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:44.841446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:44.841976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:44.843375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:44.846726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:44.852074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:44.852912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:45.373929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:45.375009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:45.422736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:45.427121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:45.429259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:45.434182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:45.436288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:45.439484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:45.610332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:45.648285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:45.649757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b5d25aea63b469b922af291fe70c4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab2ff903c844c2bbeffab1c8fda61fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:45.651041 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6e19f68-b6a7-42c9-9b7b-281aa2d9f8a3 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 200 len: 1604 microversion: 2.42 time: 0.841712 Aug 30 18:26:45.652304 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1618/3131] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:44 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 1604 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:26:45.810025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:45.824437 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd86e5f7-b886-42a7-adb1-c4ca0b54a858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1270 microversion: 2.1 time: 0.456774 Aug 30 18:26:45.826891 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1514/3132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:45 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1270 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:46.679200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:46.680925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:46.695327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:46.696112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:46.696754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:46.697672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:46.702222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:46.703094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:46.745823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] HTTP exception thrown: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Request method failure captured: Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 HTTP/1.1 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlSRlPrZucljX5LARG2soAnoD6L9zspWp4SBuXgCfdkp8NlULPNADzAQRonNxs3-LhPrbOXHKru5n1Zpvzn0CvLvBDg6IMGrybQ_z5s8Zsg5oYHIfV7B2YXZSbzTBf_Z-qIzwjWK_He_q4YFnXaGRE7kbEgI3CBCZMQx3RJAFU3LPQ4 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 9b5d25aea63b469b922af291fe70c4d6 Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90'} Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:46.748958 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:26:46.753792 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:26:46.755533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Returning 404 to user: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:26:46.756626 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95901907-640c-4951-a9e1-c496dcf4cbd5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 404 len: 111 microversion: 2.42 time: 0.081465 Aug 30 18:26:46.757869 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1619/3133] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:26:46 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:26:46.769468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24077fa5-3378-4fa5-8790-b5322adce448 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '.version_select at 0x7f4e567faa60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:46.846919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:46.848165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:46.858045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:46.859135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24077fa5-3378-4fa5-8790-b5322adce448 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421609892" status: 204 len: 0 microversion: 2.42 time: 0.095353 Aug 30 18:26:46.862911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1515/3134] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Aug 30 18:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421609892 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:26:46.863425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:46.864039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:46.864972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:46.865589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:46.866184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:46.947563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24077fa5-3378-4fa5-8790-b5322adce448 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:46.949239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24077fa5-3378-4fa5-8790-b5322adce448 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001821 Aug 30 18:26:46.949836 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1516/3135] 10.222.0.25 () {56 vars in 886 bytes} [Tue Aug 30 18:26:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 18:26:47.697099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:47.742212 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b2b1291-ed11-46e3-8b21-23650e608960 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.898196 Aug 30 18:26:47.743718 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1620/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:46 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:48.767535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:48.768242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:48.788842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:48.790535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:48.791187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:48.793538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:48.794160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:48.794912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:49.636751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:49.651936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8fbb345b-6fcc-4738-ac80-12f1e2fe0fe7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.888657 Aug 30 18:26:49.678766 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1517/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:48 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:50.697775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:50.698632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:50.701575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:50.705831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:50.717906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:50.718421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:50.718868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:50.719603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:50.720064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:50.720492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:51.236440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:26:51.267024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:51.268126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:51.268806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:51.299059 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] Creating event network-changed:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:26:51.310646 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ebbe7c22-880c-46ad-a280-4c1851627f21 req-14f29d7d-a733-4e86-a681-654665ad062f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078840 Aug 30 18:26:51.319298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1518/3138] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:26:51.623580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:51.634392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2375b423-4c53-416d-9ed8-04d7dfb9ea36 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.940746 Aug 30 18:26:51.640399 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1621/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:50 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:52.666810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:52.667526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:52.682195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:52.689434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:52.689934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:52.690733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:52.691202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:52.691625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:53.381921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:53.398691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a986b08-d540-454f-8fe5-4e49804e4256 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.738562 Aug 30 18:26:53.399717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1519/3140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:52 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:26:54.437509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:54.438233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:54.446785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:54.447487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:54.448116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:54.449183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:54.449680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:54.450394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:54.453336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:26:55.128156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:55.155819 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7e66437-2555-41f3-a032-3af1a8e252cb tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.717268 Aug 30 18:26:55.169209 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1622/3141] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:54 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:56.178174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:56.178838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:56.213630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:56.217317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:56.220979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:56.229967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:56.245123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:56.252192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:57.593418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:57.612510 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ab42b60-bc95-48c8-bacd-ed532c1df9a9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 1.439146 Aug 30 18:26:57.613134 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1520/3142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:56 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:26:58.634199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:26:58.635109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:26:58.644748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:58.645421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:58.645866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:58.646649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:26:58.647107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:26:58.649200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:26:59.099215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:26:59.121356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f598dc3e-d4ca-4cf1-967e-4002f755446d tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.489789 Aug 30 18:26:59.125004 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1623/3143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:26:58 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:00.147803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:00.150144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:00.156390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:00.205566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:00.207059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:00.209781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:00.211104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:00.212663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:00.215204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:00.697019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-plugged", "status": "completed", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:00.722082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:00.724077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:00.728487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:00.760088 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] Creating event network-vif-plugged:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:27:00.773675 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6dfaeee5-495b-47d2-9c56-f9b310c2c027 req-b653cead-d4e8-40b3-9d7a-84e0106da7f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082453 Aug 30 18:27:00.777390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1624/3144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:27:02.060735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:02.076859 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1737d0c-0795-472a-9419-62ddc19eea50 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 1.934706 Aug 30 18:27:02.077685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1521/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:00 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:03.103910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:03.105387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:03.118982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:03.121982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:03.123994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:03.124939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:03.127539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:03.128177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:03.585470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:03.605149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b389bf0c-3bfb-4d28-ba2a-264964fae9d9 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1312 microversion: 2.1 time: 0.506924 Aug 30 18:27:03.605813 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1625/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:03 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1312 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:04.633768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:04.635981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:04.654550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:04.661714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:04.663230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:04.664616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:04.664773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:04.667402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:05.625564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:05.641878 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e101ed03-2fd3-47d1-89f6-dea759c742c7 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1461 microversion: 2.1 time: 1.012350 Aug 30 18:27:05.642738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1522/3147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:04 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1461 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:05.665315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:05.665948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:05.674319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:05.675680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:05.676389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:05.677696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:05.678544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:05.679246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:06.549345 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-219d42cd-02df-44b7-b94e-f8e4ee3fecc3 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1614 microversion: 2.1 time: 0.887929 Aug 30 18:27:06.570207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1626/3148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:05 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1614 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:06.579366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:06.580068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:06.596599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:06.607632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:06.616741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:06.618288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:06.618989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:06.621667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:06.955501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=85 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:07.013153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0aecddcc1cdc4f7db102acd0b9c21774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2dba7ca7934bf187b00f707d8581dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:07.021599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] flavor_id is None. Assuming migration. {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:27:07.023927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:27:07.296639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b45e4faa-52af-4645-bb8e-8ae7cbcebaa2 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Action: 'create', calling method: .version_select at 0x7f4e5673f8b0>, body: {"pool": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:07.675447 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0032a9c1-a8ee-4972-be63-7a5a23767992 tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d/action" status: 202 len: 0 microversion: 2.1 time: 1.102216 Aug 30 18:27:07.676918 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1523/3149] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:06 2022] POST /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:07.707477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:07.709017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:07.738438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:07.739467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:07.740260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:07.747098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:07.752645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:07.756179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:09.135479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:09.144103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f1faa93-5b3f-4adb-b8a7-b3fdeb25f003 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1470 microversion: 2.1 time: 1.455891 Aug 30 18:27:09.148658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1524/3150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:07 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1470 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:10.182225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:10.183075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:10.207692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:10.222486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:10.223506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:10.225826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:10.226673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:10.227383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:11.456339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:11.469721 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49d4fc6e-861f-475f-a5a8-a8e931bb58d4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1470 microversion: 2.1 time: 1.293423 Aug 30 18:27:11.473058 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1525/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:10 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1470 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:11.497823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:11.498847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:11.575969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:11.580031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:11.584946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:11.585828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:11.586316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:11.586797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:11.639928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] HTTP exception thrown: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Request method failure captured: Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 HTTP/1.1 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlSRlPrZucljX5LARG2soAnoD6L9zspWp4SBuXgCfdkp8NlULPNADzAQRonNxs3-LhPrbOXHKru5n1Zpvzn0CvLvBDg6IMGrybQ_z5s8Zsg5oYHIfV7B2YXZSbzTBf_Z-qIzwjWK_He_q4YFnXaGRE7kbEgI3CBCZMQx3RJAFU3LPQ4 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9b5d25aea63b469b922af291fe70c4d6 Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90'} Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:27:11.664282 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Returning 404 to user: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb2b55b0-404e-4efe-a912-c467d23ef7e5 tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 404 len: 111 microversion: 2.42 time: 0.187990 Aug 30 18:27:11.676752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1526/3152] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:27:11 2022] DELETE /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:27:11.692904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:11.694310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] [instance: ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:11.712699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:11.713241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:11.716780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:11.717823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:11.718571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:11.720930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:11.795585 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] HTTP exception thrown: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Request method failure captured: Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 HTTP/1.1 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlSRlPrZucljX5LARG2soAnoD6L9zspWp4SBuXgCfdkp8NlULPNADzAQRonNxs3-LhPrbOXHKru5n1Zpvzn0CvLvBDg6IMGrybQ_z5s8Zsg5oYHIfV7B2YXZSbzTBf_Z-qIzwjWK_He_q4YFnXaGRE7kbEgI3CBCZMQx3RJAFU3LPQ4 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eab2ff903c844c2bbeffab1c8fda61fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: eab2ff903c844c2bbeffab1c8fda61fc Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2084143155 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9b5d25aea63b469b922af291fe70c4d6 Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2084143155-project Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90'} Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.800824 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. Aug 30 18:27:11.805749 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:27:11.810866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] Returning 404 to user: Instance ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:27:11.817124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-89e20746-14f2-4f9c-9ada-fdfb321a851a tempest-TaggedBootDevicesTest_v242-2084143155 tempest-TaggedBootDevicesTest_v242-2084143155-project] 10.222.0.25 "GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90" status: 404 len: 111 microversion: 2.42 time: 0.135417 Aug 30 18:27:11.819474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1527/3153] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:27:11 2022] GET /compute/v2.1/servers/ef3b0ddd-8619-4d9a-9301-3b3d0f9f9c90 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:27:12.504767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:12.506273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:12.529382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:12.532220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:12.534970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:12.535758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:12.536244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:12.536688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:14.359215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:14.388175 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ad1a5bd-d518-46fd-9a0a-b6819a7f407b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1470 microversion: 2.1 time: 1.887173 Aug 30 18:27:14.413560 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1528/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:12 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1470 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:15.423473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:15.425713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:15.436744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:15.437532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:15.438212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:15.439641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:15.440594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:15.441240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:15.674868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=23 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:16.331897 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b45e4faa-52af-4645-bb8e-8ae7cbcebaa2 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.380694 Aug 30 18:27:16.345337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1627/3155] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:27:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:27:16.351518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c478e64-602a-4685-96a7-105e01a629fc tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Action: 'create', calling method: .version_select at 0x7f4e572ad4c0>, body: {"pool": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:16.546144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=25 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:17.026027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:17.058802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10196fe5-bf7e-4520-a20f-c3fe9fc49445 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1470 microversion: 2.1 time: 1.642288 Aug 30 18:27:17.067834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1529/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:15 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1470 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:18.093205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:18.097134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:18.131473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:18.133223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:18.134230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:18.140890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:18.142132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:18.143011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:19.877292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c478e64-602a-4685-96a7-105e01a629fc tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.530514 Aug 30 18:27:19.885809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1628/3157] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:27:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:19.916812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:19.954808 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6811cb80-dcdd-4271-9892-a0323ddb7271 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1470 microversion: 2.1 time: 1.842010 Aug 30 18:27:19.955573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1530/3158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:18 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1470 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:19.978324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0269d0b-f116-4eef-b1ff-1df506238169 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Action: 'create', calling method: .version_select at 0x7f4e570cc700>, body: {"pool": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:20.318439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Action: 'create', calling method: .version_select at 0x7f4e55dec9d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:20.388355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Getting quotas for project 4d07684d7a414045ac6a46fdf3fcc4a1. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:20.407889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Getting quotas for user 20ecd404d9ed48be902b524ebdd194dd and project 4d07684d7a414045ac6a46fdf3fcc4a1. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:20.579524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Getting quotas for project 4d07684d7a414045ac6a46fdf3fcc4a1. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:20.592993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Getting quotas for user 20ecd404d9ed48be902b524ebdd194dd and project 4d07684d7a414045ac6a46fdf3fcc4a1. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:20.620908 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bafbfafe-13b1-446f-a872-2d9dd724fed8 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.732334 Aug 30 18:27:20.635848 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1629/3159] 10.222.0.25 () {62 vars in 1214 bytes} [Tue Aug 30 18:27:19 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:27:20.645240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-067f8dd1-1b5d-4a2d-a993-42db39e07fb4 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:20.681538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-067f8dd1-1b5d-4a2d-a993-42db39e07fb4 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.043145 Aug 30 18:27:20.683243 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1630/3160] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 18:27:20 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:27:20.703308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95390097-2396-4cac-b15e-71fbcce242fc tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:20.756727 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95390097-2396-4cac-b15e-71fbcce242fc tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db" status: 200 len: 235 microversion: 2.64 time: 0.060292 Aug 30 18:27:20.769764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1631/3161] 10.222.0.25 () {60 vars in 1304 bytes} [Tue Aug 30 18:27:20 2022] GET /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db => generated 235 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:27:20.781508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcf8ec8c-f17d-4d04-8c40-ce4f02fb4739 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:20.862654 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcf8ec8c-f17d-4d04-8c40-ce4f02fb4739 tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db" status: 204 len: 0 microversion: 2.64 time: 0.090363 Aug 30 18:27:20.886787 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1632/3162] 10.222.0.25 () {60 vars in 1307 bytes} [Tue Aug 30 18:27:20 2022] DELETE /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:27:20.892797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c514d46c-5294-4bfb-af0e-c38e7d552f4d tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:20.902719 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c514d46c-5294-4bfb-af0e-c38e7d552f4d tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] HTTP exception thrown: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c514d46c-5294-4bfb-af0e-c38e7d552f4d tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Request method failure captured: Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db HTTP/1.1 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlaGu-WRDMEq7-SJ0pnUdVfq9xqmAtAqpaPCT8rwpFmbJdZJ4OqTFkCBQruERwM-sZn8Q3s-FUp2p-DZfl4CWrlUGQbwIP5i0Vc065Ao1V3txTXBG0DabELofj5mSXz4Egb71F-tO94NhsU_yw6whSSeWcNWi8GZriRHUtHgehTUQ9k Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.64 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 4d07684d7a414045ac6a46fdf3fcc4a1 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerGroup264TestJSON-599546198 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d07684d7a414045ac6a46fdf3fcc4a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d07684d7a414045ac6a46fdf3fcc4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d07684d7a414045ac6a46fdf3fcc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d07684d7a414045ac6a46fdf3fcc4a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerGroup264TestJSON-599546198 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 4d07684d7a414045ac6a46fdf3fcc4a1 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerGroup264TestJSON-599546198 Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerGroup264TestJSON-599546198-project Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 20ecd404d9ed48be902b524ebdd194dd Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerGroup264TestJSON-599546198-project Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bfdf3196-20c4-4d8b-b246-bdad579623db'} Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:27:20.911360 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. Aug 30 18:27:20.916688 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:27:20.918248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c514d46c-5294-4bfb-af0e-c38e7d552f4d tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] Returning 404 to user: Instance group bfdf3196-20c4-4d8b-b246-bdad579623db could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:27:20.919633 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c514d46c-5294-4bfb-af0e-c38e7d552f4d tempest-ServerGroup264TestJSON-599546198 tempest-ServerGroup264TestJSON-599546198-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db" status: 404 len: 117 microversion: 2.64 time: 0.031047 Aug 30 18:27:20.920406 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1633/3163] 10.222.0.25 () {60 vars in 1307 bytes} [Tue Aug 30 18:27:20 2022] DELETE /compute/v2.1/os-server-groups/bfdf3196-20c4-4d8b-b246-bdad579623db => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:27:21.015310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:21.016535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:21.037867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:21.038484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:21.039006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:21.040053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:21.040613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:21.045444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:21.529313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:21.559621 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7aaf2e1c-dec9-4a54-a3fe-45b3247d96a4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1475 microversion: 2.1 time: 0.546832 Aug 30 18:27:21.560577 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1634/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:21 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1475 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:22.588187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:22.590480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:22.633089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:22.634075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:22.635167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:22.636596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:22.637662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:22.638604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:23.564258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:23.584042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47992bc3-489f-431e-aa8b-9d7ad63a105b tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1475 microversion: 2.1 time: 1.001255 Aug 30 18:27:23.585451 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1635/3165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:22 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1475 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:24.619660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:24.622118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:24.657743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:24.660516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:24.662484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:24.663471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:24.667721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:24.668713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:26.068180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:26.087867 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6887dc6d-3c28-485f-b7e9-4a6d3184a5a1 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1475 microversion: 2.1 time: 1.478281 Aug 30 18:27:26.091669 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1636/3166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:24 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1475 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:27.113173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:27.116155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:27.143775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:27.150193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:27.151042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:27.153278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:27.155493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:27.166162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:28.124235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=21 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:28.578215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:28.588421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a85b2aac-2ad3-4606-b833-dc1d09daeb66 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1475 microversion: 2.1 time: 1.477794 Aug 30 18:27:28.591088 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1637/3167] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:27 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1475 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:29.710459 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0269d0b-f116-4eef-b1ff-1df506238169 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.745059 Aug 30 18:27:29.711149 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1531/3168] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:27:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:29.729515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47da82d3-d6dc-4d43-835e-ef94da74ad9d tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Action: 'create', calling method: .version_select at 0x7f4e569e88b0>, body: {"pool": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:29.912162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:29.914198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:29.921336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:29.927420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:29.928310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:29.932267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:29.935080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:29.935879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:29.936511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:30.384720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:30.404677 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f04121f4-b15e-437e-9f23-28bfcbb36966 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1474 microversion: 2.1 time: 0.794655 Aug 30 18:27:30.406726 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1638/3169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:29 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1474 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:31.048131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-unplugged", "status": "completed", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:31.059453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:31.084749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:31.089471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:31.091946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:31.151906 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Creating event network-vif-unplugged:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h2-854119-10 Aug 30 18:27:31.165096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:31.200900 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bdb90f14-2e4f-417a-9aa1-6eb9270e0ec8 req-22675faf-7681-4959-b988-ad2083cee81c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157527 Aug 30 18:27:31.206029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1639/3170] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:27:31.435628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:31.436712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:31.451780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:31.452673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:31.454545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:31.455892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:31.457867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:31.460066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:31.964469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:31.978961 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ccf0c2b-8e81-4ba2-8f47-2252a93d76a5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1474 microversion: 2.1 time: 0.549674 Aug 30 18:27:31.980925 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1640/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:31 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1474 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:33.006199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:33.007949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:33.029617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.035372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.037737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.039096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.039805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.040587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.882898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:33.897753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b9873c4-c1fb-4923-bffb-294910330228 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1474 microversion: 2.1 time: 0.899802 Aug 30 18:27:33.898839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1641/3172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:32 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1474 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:33.919556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:33.940544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:33.943794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:33.944529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:33.972171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Creating event network-changed:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h2-854119-10 Aug 30 18:27:33.984103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:34.029507 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6a9ff918-7e69-429e-9207-4b9c3690267c req-7e106ad5-289b-4b10-90e9-79a62e5339d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129072 Aug 30 18:27:34.030969 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1642/3173] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:34.921181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:34.922174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:34.938232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.938769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.939203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:34.939932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:34.940385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:34.940809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:35.341301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:35.354046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-630bcc43-1f08-4c28-98c7-706ee4e17440 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1474 microversion: 2.1 time: 0.437298 Aug 30 18:27:35.405394 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1643/3174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:34 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1474 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:35.535895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1483299043", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "262f4119-3cd3-41d5-9a09-cedb226fd437"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:35.660602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] validate_networks() for [('262f4119-3cd3-41d5-9a09-cedb226fd437', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:27:38.113144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47da82d3-d6dc-4d43-835e-ef94da74ad9d tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.388048 Aug 30 18:27:38.114425 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1532/3175] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:27:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:38.119474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:38.120301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:38.170768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.171905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.172650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.173646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.174429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.175318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.341315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:27:38.342286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:27:38.342997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:27:38.343736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:27:38.344485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:27:38.361210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.361932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.362780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.365033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:38.365507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:38.365952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:38.425032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Getting quotas for project b9bf8edcd6dc48c6afcd1fb0b198eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:38.432584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Getting quotas for user 0dbf6096ac0f4dd5897a52e84991d725 and project b9bf8edcd6dc48c6afcd1fb0b198eb2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:38.448997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:27:38.451705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:27:38.579895 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4200a9d8-0840-471f-aabc-343307fc5c8f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.172915 Aug 30 18:27:38.588000 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1644/3176] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:27:38.601110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdefdf96-908c-4e12-8307-7091f0accbbd tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e55de5c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:38.733723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:38.749316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1fe94104-0f29-4753-babc-a5cb0bfe11d2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1472 microversion: 2.1 time: 0.633591 Aug 30 18:27:38.763849 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1533/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:38 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1472 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:38.770181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7af74fc5-dd82-42ab-a01a-f99e9a2b25d1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:38.771139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7af74fc5-dd82-42ab-a01a-f99e9a2b25d1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:39.002760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7af74fc5-dd82-42ab-a01a-f99e9a2b25d1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:39.015985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7af74fc5-dd82-42ab-a01a-f99e9a2b25d1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1225 microversion: 2.1 time: 0.250588 Aug 30 18:27:39.017995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1534/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:38 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:39.696930 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdefdf96-908c-4e12-8307-7091f0accbbd tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/d253b0f2-0986-4db7-b4ee-15d116f26b60" status: 200 len: 142 microversion: 2.1 time: 1.107522 Aug 30 18:27:39.697510 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1645/3179] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:27:38 2022] GET /compute/v2.1/os-floating-ips/d253b0f2-0986-4db7-b4ee-15d116f26b60 => generated 142 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:39.711528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4239328e-98ee-4fb2-8dad-91b9805eb4f9 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e56f9e9d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:39.774278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:39.775453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:39.786626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:39.794552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:39.795658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:39.796742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:39.797389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:39.797980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:40.383243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:40.396274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa434b9a-2681-44f2-80c5-29806ccbfddc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1469 microversion: 2.1 time: 0.625546 Aug 30 18:27:40.397339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1646/3180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:39 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1469 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:40.415532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:40.416570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:40.426080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:40.427048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:40.428235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:40.429673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:40.430582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:40.431102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:40.859487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:40.873310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f25b94d9-df16-4891-89ee-42813bdb3fe4 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1277 microversion: 2.1 time: 0.463012 Aug 30 18:27:40.874105 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1647/3181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:40 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1277 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:40.886198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:40.887110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:40.910148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:40.917109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:40.917601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:40.920261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:40.921898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:40.922383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.156214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c93e62b-e7da-4912-a6bf-3584a7cf6ff2 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "POST /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d/action" status: 202 len: 0 microversion: 2.1 time: 0.280136 Aug 30 18:27:41.164613 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1648/3182] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:27:40 2022] POST /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:41.189595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:41.191742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:41.201806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.202301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.202765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.203519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.204091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.204509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.893796 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4239328e-98ee-4fb2-8dad-91b9805eb4f9 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d253b0f2-0986-4db7-b4ee-15d116f26b60" status: 202 len: 0 microversion: 2.1 time: 2.187153 Aug 30 18:27:41.900545 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1535/3183] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:27:39 2022] DELETE /compute/v2.1/os-floating-ips/d253b0f2-0986-4db7-b4ee-15d116f26b60 => generated 0 bytes in 2195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:41.907013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:41.908879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:41.922180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.923135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.924077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:41.925984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:41.926972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:41.927766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:42.060116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:42.071374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3fde7939-c93a-4970-bf3c-1cd71521dd7f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1283 microversion: 2.1 time: 0.169190 Aug 30 18:27:42.085828 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1536/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:41 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:42.098417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-efd11b7c-dada-4ef3-a4e5-f69443483d0e tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e575f6ca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:42.219874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:42.237485 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a75582e-61f2-4218-afcf-c85a135f8965 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 1.062777 Aug 30 18:27:42.239955 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1649/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:41 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:42.396063 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-efd11b7c-dada-4ef3-a4e5-f69443483d0e tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.308739 Aug 30 18:27:42.404158 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1537/3186] 10.222.0.25 () {58 vars in 1164 bytes} [Tue Aug 30 18:27:42 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:27:42.410119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a66e15b4-e164-4b8b-bc0e-742740a5abf7 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e56ab0550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:43.093699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:43.094313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:43.112741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.113621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.114289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.115246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.116332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.116967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.488822 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a66e15b4-e164-4b8b-bc0e-742740a5abf7 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.082908 Aug 30 18:27:43.502789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1650/3187] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:27:42 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:27:43.611014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:43.626802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8be65624-1be2-4883-9079-12f1701e2562 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.537090 Aug 30 18:27:43.631196 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1538/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:43 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:43.639362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:43.642364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:43.680479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.681192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.681991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.694612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:43.695448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:43.696101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:43.775281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d7293ab-26ca-44ad-9ae0-50c0381b9bb1 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: .version_select at 0x7f4e55dc1d30>, body: {"keypair": {"name": "tempest-keypair-253145875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsylmOKiUjMXXIDOx8ZH+EeNY3IkTiu660DZomaof2xHoLN/YkRAZZ3g6FJF+V3mrW9gPFsbR/Rwz3XUar8Tlb6S48b+8zqLkpzxIGBt7HP9Q2FIsn+mA0CRRtNr4C+fA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:43.831304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3d7293ab-26ca-44ad-9ae0-50c0381b9bb1 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:43.851695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3d7293ab-26ca-44ad-9ae0-50c0381b9bb1 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:43.895882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:43.910596 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d7293ab-26ca-44ad-9ae0-50c0381b9bb1 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411391 Aug 30 18:27:43.922744 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1651/3189] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:27:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:43.939449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ed1ad5c-d00c-4bca-91ff-b1c5c56a06b5 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e55dc1670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:44.505300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:44.521442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2860bcbf-9621-4df8-ab10-51aa34a0d263 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 0.888593 Aug 30 18:27:44.524410 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1539/3190] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:43 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:44.540007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-plugged", "status": "completed", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:44.568007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:44.571969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:44.572768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:44.596650 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Creating event network-vif-plugged:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h2-854119-10 Aug 30 18:27:44.620212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:44.636852 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-63f072b1-8fdf-4dfe-962f-d1ca892c5ae9 req-ffeb456d-a17b-4700-be90-27a0a6815c62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107854 Aug 30 18:27:44.638408 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1540/3191] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:44.659492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:44.660652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:44.669417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:44.670250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:44.671030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:44.672039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:44.672617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:44.673112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:45.069855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:45.082049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c278cbf-334a-4809-ac59-0e3a5b9d0f57 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.429045 Aug 30 18:27:45.096542 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1541/3192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:44 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:45.102073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6", "tag": "d465b1b7-c40a-4715-a800-35aa5f85af27"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:45.117048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:45.118220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:45.119001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:45.147754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] Creating event network-changed:d465b1b7-c40a-4715-a800-35aa5f85af27 for instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 on n-h2-854119-10 Aug 30 18:27:45.156576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e7103a1c-b3b9-4edc-b078-da9e4af8886e req-ba10f638-07d4-4c13-b7dd-2c2f079ed54e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058671 Aug 30 18:27:45.157808 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1542/3193] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:45.550170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:45.551235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:45.566879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:45.567459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:45.567990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:45.568975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:45.569525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:45.572414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:46.065484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:46.083270 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0983c88-d29a-4e3e-bc1c-ae3e5c462665 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 0.538754 Aug 30 18:27:46.088359 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1543/3194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:45 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:46.129098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:46.136817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:46.163335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:46.164205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:46.165907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:46.179239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:46.180117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:46.182700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:46.848105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:46.857774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff9d92ce-53a1-4bee-9f23-a80f7a7863a1 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.758156 Aug 30 18:27:46.887196 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1544/3195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:46 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:27:47.116222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:47.117225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:47.140708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:47.141800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:47.142714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:47.143740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:47.144457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:47.145270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:47.738875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:47.754906 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2ee79e6-613d-4499-8784-5d343e579aa0 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 0.647849 Aug 30 18:27:47.756120 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1545/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:47 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:47.908025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:47.908691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:47.922406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:47.923307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:47.923837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:47.924801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:47.925261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:47.938767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:48.400077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:49.014401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:49.063132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:49.074745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32bcd75e-819b-4e52-ba83-8b5a7a700aef tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 1.170532 Aug 30 18:27:49.086791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1546/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:47 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:49.092441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:49.093316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:49.111493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.111996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.112439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:49.113162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:49.113620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:49.114040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:50.423408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:50.434491 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e05dd72e-c027-4fe7-8597-376c1ab94858 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 1.345920 Aug 30 18:27:50.449246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1547/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:49 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:50.456198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:50.456998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:50.471704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:50.473402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:50.476281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:50.477659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:50.479443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:50.484732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:50.684315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ed1ad5c-d00c-4bca-91ff-b1c5c56a06b5 tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/f0a24ccf-086a-4a25-a8fe-0dde51fa665e" status: 202 len: 0 microversion: 2.1 time: 6.755145 Aug 30 18:27:50.684954 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1652/3199] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:27:43 2022] DELETE /compute/v2.1/os-floating-ips/f0a24ccf-086a-4a25-a8fe-0dde51fa665e => generated 0 bytes in 6757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:50.694642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-077a4828-b011-4c5f-bec2-7e3d3271fe3c tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e56736550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:51.013562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:51.025022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a95f015-823a-4fd8-b291-e647df426f0a tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.573750 Aug 30 18:27:51.036961 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1548/3200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:50 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:51.047612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-unplugged", "status": "completed", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:51.091571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:51.092122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:51.092772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:51.120124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Creating event network-vif-unplugged:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:27:51.139461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:51.167492 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-50420431-abe7-428c-b229-c017b3290625 req-2462c7fa-6808-4b26-adcc-bc4436635138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128835 Aug 30 18:27:51.168833 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1549/3201] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:51.456633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:51.457597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:51.469197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:51.469700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:51.470139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:51.471039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:51.471497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:51.471968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:52.104552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:52.119681 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a5bb84f-7135-4d25-b202-f70664d0ccdf tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 0.667877 Aug 30 18:27:52.123933 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1550/3202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:51 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:52.132814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:52.133438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:52.141072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:52.147057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:52.147802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:52.148957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:52.149869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:52.151041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:52.231421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:52.754976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:52.782233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-730ba512-f5d9-4c88-911a-ec10eab77819 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.656432 Aug 30 18:27:52.783455 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1551/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:52 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:52.868772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1600331128", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5"}], "security_groups": [{"name": "tempest-securitygroup--2013060172"}], "key_name": "tempest-keypair-253145875", "user_data": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:53.269513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] validate_networks() for [('5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:27:53.873513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:53.958529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:54.412347 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-077a4828-b011-4c5f-bec2-7e3d3271fe3c tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/68207dae-1c30-4cf3-a546-e6f14be9ed98" status: 202 len: 0 microversion: 2.1 time: 3.722696 Aug 30 18:27:54.416867 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1653/3204] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:27:50 2022] DELETE /compute/v2.1/os-floating-ips/68207dae-1c30-4cf3-a546-e6f14be9ed98 => generated 0 bytes in 3728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:27:54.424242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:54.425723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:54.434043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:54.434669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:54.435210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:54.436214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:54.436894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:54.437540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:54.830649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:54.879903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e436bc43-c007-47b5-98e8-72555f1cc400 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1468 microversion: 2.1 time: 0.461412 Aug 30 18:27:54.893973 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1654/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:54 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:54.899080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:54.915495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:54.916159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:54.916810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:54.941960 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Creating event network-changed:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:27:54.952494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:27:54.970663 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-579e6e9c-b531-4352-a6f7-1e94574dd007 req-d3b6b092-9fd7-48e0-8d4c-a5be4cb4d4ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072720 Aug 30 18:27:54.971363 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1655/3206] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:54.979021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:54.979309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:54.991007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:54.991829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:54.992463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:54.994306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:54.994986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:54.995582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:55.062623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:27:55.063681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:27:55.064333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:27:55.064915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:27:55.065529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:27:55.089273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:55.090421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:55.091073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:55.093050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:55.093738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:55.094775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:55.115736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:55.122677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:55.140597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:27:55.148939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:27:55.249072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98953f2f-4eef-4f71-b272-51b84753fb9e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.390942 Aug 30 18:27:55.249754 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1552/3207] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:27:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:27:55.266824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-007ba087-416b-4289-9d69-76eb3e64f53c tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] Calling method '.version_select at 0x7f4e56936040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:55.777626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:55.805164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b59a10e-1132-4252-81cd-21be012083b2 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.832050 Aug 30 18:27:55.837299 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1656/3208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:54 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:55.843240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21986817-74ef-4efa-86b1-99f626b22a2f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:55.844597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21986817-74ef-4efa-86b1-99f626b22a2f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:56.037495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21986817-74ef-4efa-86b1-99f626b22a2f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:56.082120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21986817-74ef-4efa-86b1-99f626b22a2f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1241 microversion: 2.1 time: 0.239825 Aug 30 18:27:56.085857 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1657/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:55 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1241 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:56.107761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6", "name": "network-vif-plugged", "status": "completed", "tag": "d465b1b7-c40a-4715-a800-35aa5f85af27"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:56.166541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:56.171779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:56.174118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:56.217816 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] Creating event network-vif-plugged:d465b1b7-c40a-4715-a800-35aa5f85af27 for instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 on n-h2-854119-10 Aug 30 18:27:56.246546 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-07ec6db6-207e-4340-ab0e-e5a01065ec9e req-3269fe55-43ec-4fe3-a951-453e6b5aeb73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154721 Aug 30 18:27:56.248735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1658/3210] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:27:56.263185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:56.264377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:56.295853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:56.296858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:56.298297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:56.299329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:56.300987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:56.301657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:57.252940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:57.271422 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1298caae-5367-4ef2-9d7d-111b838727b5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1461 microversion: 2.1 time: 1.017614 Aug 30 18:27:57.272093 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1659/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:56 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1461 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:57.277169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:57.277786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:57.292902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:57.293405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:57.293875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:57.294643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:57.295278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:57.295872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:57.795048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:57.819119 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a99d7371-c4f3-448e-9b0f-cb2549633c12 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1325 microversion: 2.1 time: 0.545079 Aug 30 18:27:57.822503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1660/3212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:57 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:57.830485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:57.843301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:57.850199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:57.850898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:57.851587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:57.852795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:57.853479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:57.854116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:58.032093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:27:58.050369 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56ead4ff-87b8-48fd-bcae-96a6c5dbccaf tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1299 microversion: 2.1 time: 0.224769 Aug 30 18:27:58.051168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1661/3213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:57 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:58.356971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:58.360632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:58.416587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:58.425820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:58.427085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:58.431077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:58.431996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:58.432468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:59.313005 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-007ba087-416b-4289-9d69-76eb3e64f53c tempest-FloatingIPDetailsTestJSON-1045756552 tempest-FloatingIPDetailsTestJSON-1045756552-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/0c1c2f0d-2982-4337-927d-7d5aceb3635b" status: 202 len: 0 microversion: 2.1 time: 4.060999 Aug 30 18:27:59.313863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1553/3214] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:27:55 2022] DELETE /compute/v2.1/os-floating-ips/0c1c2f0d-2982-4337-927d-7d5aceb3635b => generated 0 bytes in 4063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:27:59.323345 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ad73045-b460-4175-9abf-beadf40bbcdf tempest-MigrationsAdminTest-1820220372 tempest-MigrationsAdminTest-1820220372-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1614 microversion: 2.1 time: 1.267514 Aug 30 18:27:59.327167 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1662/3215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:58 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1614 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:27:59.385271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:27:59.387808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:27:59.437682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:59.440828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:59.441764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:59.443123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:27:59.445769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:27:59.446067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:27:59.638881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: .version_select at 0x7f4e56998af0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1497540719", "policies": ["affinity"]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:27:59.656830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:27:59.702561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:59.735770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:59.902099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:27:59.920287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:27:59.982229 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f48d79a1-311a-4956-afe4-1bc8d516c302 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.659352 Aug 30 18:27:59.985515 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1554/3216] 10.222.0.25 () {60 vars in 1174 bytes} [Tue Aug 30 18:27:59 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:00.005163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:00.005766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:00.025360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.026322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.028450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.030490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.032401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.033257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.044815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=91 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:00.267362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:00.282505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ef51c823-569b-47e7-846d-ccc1e4c3e9de tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1299 microversion: 2.1 time: 0.290486 Aug 30 18:28:00.295457 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1555/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:59 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:00.321456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:00.322908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:00.334204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.335194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.336617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.338420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.338911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.339360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.381013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:00.475997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:00.521142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90ba9605-66cc-48e6-bb86-c6783a185b6d tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1522 microversion: 2.1 time: 1.190405 Aug 30 18:28:00.525158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1663/3218] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:27:59 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1522 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:00.535825 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a69c91a-180a-4159-a549-d3f81f6daf5e tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 204 len: 0 microversion: 2.1 time: 0.237092 Aug 30 18:28:00.543048 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1556/3219] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:00 2022] DELETE /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:00.549940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: .version_select at 0x7f4e55dc8c10>, body: {"server_group": {"name": "tempest-server-group-279334387", "policies": ["affinity"]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:00.560462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-plugged", "status": "completed", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:00.576070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.577027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.577857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.595565 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] Creating event network-vif-plugged:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:28:00.602574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8d6d2940-69b0-4830-b01c-b21c90835398 req-42b2010d-204c-4822-a7b5-af556fb580fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059425 Aug 30 18:28:00.604868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1557/3220] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:00.608523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:00.614254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:00.615528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:00.621751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:00.624089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.624887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.625696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.626837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.627520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.628247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.712029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:00.721090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:00.740975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3416bb1d-f577-4e27-99dc-2c7be8cfd9d1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.214189 Aug 30 18:28:00.742200 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1664/3221] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:28:00 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:00.751631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:00.752545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:00.765042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.765611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.766285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.767255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:00.767833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:00.768522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:00.816473 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] HTTP exception thrown: Action 999 not found Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Request method failure captured: Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6/os-instance-actions/999 HTTP/1.1 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlaWSBH1EzE-W4fgK4V5xYtRT-y1O7yF7QCTloDJIVBVhXZng4r6PLkUjGJtSi82TwQBuqt3DTbWQPijMhairbARsvh8uYCm2-fxABgEZCgmGjSyK8JPsNoxMNU6U0gXICr5Ets8T2B4Xj_9FMPPWKRFNiUg0BZ_QoJKCLEZyvfe3Ek Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 0dbf6096ac0f4dd5897a52e84991d725 Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: exception: Action 999 not found Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6', 'id': '999'} Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 30 18:28:00.831731 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:00.837097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Returning 404 to user: Action 999 not found {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:00.837097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86fecc1f-6f97-4c77-aa51-20d0e65ce19b tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.090175 Aug 30 18:28:00.840021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1665/3222] 10.222.0.25 () {58 vars in 1308 bytes} [Tue Aug 30 18:28:00 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6/os-instance-actions/999 => generated 66 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:28:00.849375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: .version_select at 0x7f4e55dec280>, body: {"server_group": {"name": "tempest-server-group-279334387", "policies": ["affinity"]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:00.893358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:00.908777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:00.994222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:01.000347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:01.018223 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3337ffc-3089-4907-a853-450a33928e40 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.176654 Aug 30 18:28:01.019433 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1666/3223] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:28:00 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:01.025742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '.version_select at 0x7f4e5af46a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.026317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: e3eec9f4-91cc-4741-ada1-a5e2148c8838] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:01.034537 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] HTTP exception thrown: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Request method failure captured: Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/e3eec9f4-91cc-4741-ada1-a5e2148c8838/os-instance-actions HTTP/1.1 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlaWSBH1EzE-W4fgK4V5xYtRT-y1O7yF7QCTloDJIVBVhXZng4r6PLkUjGJtSi82TwQBuqt3DTbWQPijMhairbARsvh8uYCm2-fxABgEZCgmGjSyK8JPsNoxMNU6U0gXICr5Ets8T2B4Xj_9FMPPWKRFNiUg0BZ_QoJKCLEZyvfe3Ek Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 0dbf6096ac0f4dd5897a52e84991d725 Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': 'e3eec9f4-91cc-4741-ada1-a5e2148c8838'} Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:01.036175 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. Aug 30 18:28:01.041429 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:01.043713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Returning 404 to user: Instance e3eec9f4-91cc-4741-ada1-a5e2148c8838 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:01.044882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c6e35d5-cfeb-4747-8fa4-29e73b41f513 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/e3eec9f4-91cc-4741-ada1-a5e2148c8838/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024472 Aug 30 18:28:01.047798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1667/3224] 10.222.0.25 () {58 vars in 1296 bytes} [Tue Aug 30 18:28:01 2022] GET /compute/v2.1/servers/e3eec9f4-91cc-4741-ada1-a5e2148c8838/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:01.057899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8231e7a-3fef-4149-b290-8437dd5e9937 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.092196 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8231e7a-3fef-4149-b290-8437dd5e9937 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/35369243-9721-4797-9fad-fc9818668a18" status: 204 len: 0 microversion: 2.1 time: 0.042890 Aug 30 18:28:01.093546 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1668/3225] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:01 2022] DELETE /compute/v2.1/os-server-groups/35369243-9721-4797-9fad-fc9818668a18 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:01.107693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.108303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:01.115713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.116291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.118448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.118448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.118855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.119554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.153037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:01.310840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b1cf844-2b49-4b1c-8654-d078779db8bc tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 204 len: 0 microversion: 2.1 time: 0.213487 Aug 30 18:28:01.311921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1669/3226] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:01 2022] DELETE /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:01.334407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8e060f2-711c-4cbf-a760-f584d9d1b4da tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.348660 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8e060f2-711c-4cbf-a760-f584d9d1b4da tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.035222 Aug 30 18:28:01.349580 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1670/3227] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:28:01 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:01.355918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.356991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:01.365695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:01.368057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.368658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.369407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.370156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.370663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.371145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.641762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:01.668479 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d529aec-d68f-41a6-8810-18a89f833129 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1467 microversion: 2.1 time: 1.060250 Aug 30 18:28:01.673223 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1558/3228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:00 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1467 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:01.689623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.695426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:01.720638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.721565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.722185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.722890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:01.723966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:01.727391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:01.728951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:01.789428 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-440fdb73-38de-4f82-a563-c646a71eb451 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.434890 Aug 30 18:28:01.813282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1671/3229] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:01 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:01.828950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c50e9083-5958-4c60-896a-274e4b4d9e52 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.898591 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c50e9083-5958-4c60-896a-274e4b4d9e52 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/6f6c9ff3-bd6d-47f3-87b1-925df53b173c" status: 204 len: 0 microversion: 2.1 time: 0.083030 Aug 30 18:28:01.899785 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1672/3230] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:01 2022] DELETE /compute/v2.1/os-server-groups/6f6c9ff3-bd6d-47f3-87b1-925df53b173c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:01.913614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7deb4cf5-26a5-499d-a12c-fd680dadc046 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:01.959192 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7deb4cf5-26a5-499d-a12c-fd680dadc046 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.051959 Aug 30 18:28:01.960913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1673/3231] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:28:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:01.983157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: .version_select at 0x7f4e5af46940>, body: {"server_group": {"name": "tempest-server-group-356491969", "policies": ["affinity"]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:02.020809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:02.031148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:02.110080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:02.119117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:02.136602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d4765f7-0f30-43b0-8cd7-94669a3da3c1 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.164524 Aug 30 18:28:02.138494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1674/3232] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:28:01 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:02.151366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-779970f8-28be-4ec8-902f-4c4fbe0260f3 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:02.190145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-779970f8-28be-4ec8-902f-4c4fbe0260f3 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cce31b09-200b-4cc2-acc4-a160440bf1f4" status: 204 len: 0 microversion: 2.1 time: 0.044235 Aug 30 18:28:02.194289 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1675/3233] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:02 2022] DELETE /compute/v2.1/os-server-groups/cce31b09-200b-4cc2-acc4-a160440bf1f4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:28:02.208692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf58b97b-4c07-4b82-baf1-ef44a9f9fa81 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:02.228302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf58b97b-4c07-4b82-baf1-ef44a9f9fa81 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027424 Aug 30 18:28:02.230856 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1676/3234] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:28:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:02.244415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: .version_select at 0x7f4e55e02d30>, body: {"server_group": {"name": "tempest-server-group-669272380", "policies": ["anti-affinity"]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:02.302840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:02.317492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:02.433165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:02.440183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_groups'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:02.469031 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5041de58-758f-4da2-a24b-7fe1ac981dd5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.229716 Aug 30 18:28:02.469965 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1677/3235] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:28:02 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:02.492819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6784674a-26a2-46a3-ae8d-5e03a6035f9a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:02.573175 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6784674a-26a2-46a3-ae8d-5e03a6035f9a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4c808eea-54a8-4349-ad1f-f12850cada86" status: 204 len: 0 microversion: 2.1 time: 0.086257 Aug 30 18:28:02.574153 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1678/3236] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:02 2022] DELETE /compute/v2.1/os-server-groups/4c808eea-54a8-4349-ad1f-f12850cada86 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:02.582655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0639881e-3346-4385-98fb-2dbceaf8bce2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:02.609152 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0639881e-3346-4385-98fb-2dbceaf8bce2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030693 Aug 30 18:28:02.609780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1679/3237] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:28:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:02.693989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-956832496", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "89f4618a-81bd-4859-8e6c-8ca1e8af778e"}]}, "os:scheduler_hints": {"group": "c9740711-f031-492e-a319-cad642ad85c3"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:02.818810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] validate_networks() for [('89f4618a-81bd-4859-8e6c-8ca1e8af778e', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:28:03.587186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:28:03.588895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:28:03.589832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:28:03.591111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:28:03.591730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:28:03.622969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:03.624622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:03.626481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:03.646454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:03.656142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:03.657993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:03.659545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:03.662380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07e442a9-8f50-4b80-a11b-90b50d4dfa73 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1528 microversion: 2.1 time: 1.986739 Aug 30 18:28:03.685137 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1559/3238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:01 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1528 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:03.690626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:03.691749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:03.713467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:03.718577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:03.719150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:03.722112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:03.722647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:03.723093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:03.731372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:03.742549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:03.780207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:28:03.783255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:28:03.799201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:03.861756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122589) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 18:28:03.909663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_group_members'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:03.921850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_group_members'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:04.040985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for project fc8134577e5943f291d03292c04da5e4. Resources: {'server_group_members'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:04.053697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Getting quotas for user f69ad52cca3b43a5b744396bb418a185 and project fc8134577e5943f291d03292c04da5e4. Resources: {'server_group_members'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:04.138402 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78784399-ea2f-4ea6-a6c6-b0161ed2a81f tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452810 Aug 30 18:28:04.139583 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1680/3239] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:28:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:28:04.147965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:04.149851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:04.156910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:04.157421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:04.158192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:04.159180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:04.159654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:04.160088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:04.415695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:04.426832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f6979be9-4948-4e4d-9029-d7c2a4cf3a31 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.286022 Aug 30 18:28:04.441362 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1681/3240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:04 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:04.447312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c5215b8-14c6-4d64-91c3-757c26a798f5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:04.448331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c5215b8-14c6-4d64-91c3-757c26a798f5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:04.579463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c5215b8-14c6-4d64-91c3-757c26a798f5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:04.596265 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c5215b8-14c6-4d64-91c3-757c26a798f5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1212 microversion: 2.1 time: 0.152916 Aug 30 18:28:04.607006 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1682/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:04 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1212 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:04.632296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:04.652119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd266881-6eff-4a70-91c7-bf0ed4af5887 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1467 microversion: 2.1 time: 0.965421 Aug 30 18:28:04.661863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1560/3242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:03 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1467 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:04.709024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:04.725483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:04.734497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:04.735349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:04.736020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:04.736986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:04.737732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:04.738585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:05.107015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:05.119835 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20de4537-3828-4299-9a46-e3a21e9c33fd tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1528 microversion: 2.1 time: 0.419264 Aug 30 18:28:05.123734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1683/3243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:04 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1528 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:05.450165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:05.451286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:05.459231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:05.470569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:05.473487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:05.474121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:05.479794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:05.480308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:05.480759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:05.639548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:05.640274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:05.654712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:05.659083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:05.659552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:05.660316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:05.660786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:05.661217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:06.547146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:06.591664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50694f3b-1615-4d2d-a1c5-b6c29cd0d5eb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 1.140989 Aug 30 18:28:06.615270 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1561/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:05 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:06.649618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:06.652293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:06.655531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:06.693313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c08ed4b8-c220-402f-b2d9-cd41c3c5c14c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1264 microversion: 2.1 time: 1.044128 Aug 30 18:28:06.708696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1684/3245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:05 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1264 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:06.714874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:06.714874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:06.717079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:06.720191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:06.724929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:06.728605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:06.752746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:06.753607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:06.796603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:06.799331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:06.804056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:06.805907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:06.811253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:06.813027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:06.889163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:07.037445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf6096ac0f4dd5897a52e84991d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bf8edcd6dc48c6afcd1fb0b198eb2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:07.065287 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-158575c0-c86a-41c0-8ebd-4f82a746bc0f tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 200 len: 1310 microversion: 2.1 time: 0.329384 Aug 30 18:28:07.068021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1685/3246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:06 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 1310 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:07.362661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1845312794", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:07.489930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:28:07.491589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:28:07.492826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:28:07.493837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:28:07.495505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:28:07.516692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.517478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.517950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.519186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.519975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.520631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.541758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Getting quotas for project 2f7a34efd06e48ce954efb8256d0c73c. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:07.552345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Getting quotas for user fbc3370aea1b4e5c83d093fe0fd5c3a1 and project 2f7a34efd06e48ce954efb8256d0c73c. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:07.574104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:28:07.577936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:28:07.728661 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-470fd77b-b99a-4ba8-aa15-f92cfa9baa45 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.657701 Aug 30 18:28:07.730850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1686/3247] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:28:07.741189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6", "name": "network-vif-deleted", "tag": "d465b1b7-c40a-4715-a800-35aa5f85af27"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:07.757303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.758146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.758874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.814969 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] Creating event network-vif-deleted:d465b1b7-c40a-4715-a800-35aa5f85af27 for instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 on n-h2-854119-10 Aug 30 18:28:07.828331 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bcf8a589-d24f-4e00-a7e8-ea5f89432b22 req-59b12cc3-8beb-4d88-8f28-cda8da47a337 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095350 Aug 30 18:28:07.828950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1687/3248] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:07.841772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:07.843033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:07.858114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.860296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.860762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.861513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.862327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.862993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.882616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:07.897894 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b0803a9-a06d-4025-8ed1-40e3688d1bc4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 200 len: 1425 microversion: 2.1 time: 1.271903 Aug 30 18:28:07.918616 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1562/3249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:06 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 1425 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:07.939941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:07.942504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:07.956327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.957322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.958107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:07.959469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:07.960351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:07.961350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:08.261451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:08.270336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dbef888d-7ba7-4d2b-9ea9-1f55955534f9 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1270 microversion: 2.1 time: 0.350085 Aug 30 18:28:08.271732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:08.274683 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1563/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:07 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:08.283357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:08.283993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:08.290836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b275ece6-8891-4a1b-b54e-b2bba9eae23f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.460118 Aug 30 18:28:08.306392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1688/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:07 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:08.313694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:08.314627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] [instance: 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:08.329562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:08.333033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:08.333692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:08.338180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:08.338895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:08.339430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:08.372544 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] HTTP exception thrown: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Request method failure captured: Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 HTTP/1.1 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlaWSBH1EzE-W4fgK4V5xYtRT-y1O7yF7QCTloDJIVBVhXZng4r6PLkUjGJtSi82TwQBuqt3DTbWQPijMhairbARsvh8uYCm2-fxABgEZCgmGjSyK8JPsNoxMNU6U0gXICr5Ets8T2B4Xj_9FMPPWKRFNiUg0BZ_QoJKCLEZyvfe3Ek Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9bf8edcd6dc48c6afcd1fb0b198eb2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b9bf8edcd6dc48c6afcd1fb0b198eb2b Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-147796335 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 0dbf6096ac0f4dd5897a52e84991d725 Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-147796335-project Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6'} Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.375163 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. Aug 30 18:28:08.380436 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.382385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] Returning 404 to user: Instance 3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:08.384237 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3af7e81-7746-4a4a-922f-7a404079a8f6 tempest-InstanceActionsNegativeTestJSON-147796335 tempest-InstanceActionsNegativeTestJSON-147796335-project] 10.222.0.25 "GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6" status: 404 len: 111 microversion: 2.1 time: 0.086187 Aug 30 18:28:08.389056 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1689/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:08 2022] GET /compute/v2.1/servers/3454cf88-8d77-4c32-aa2c-e7bc8e60c9c6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:08.445044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:08.458721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:08.460950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:08.463766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0cb92ea-2720-4732-8eda-e04398d11e4e tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1281 microversion: 2.47 time: 0.187404 Aug 30 18:28:08.465144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1564/3253] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:08 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:08.939772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:08.941400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0de02f84-9bb0-40d2-9f1e-714260b2145d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:08.950395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:08.952221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:08.953453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:08.954885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:08.956236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:08.956969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:08.982775 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] HTTP exception thrown: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Request method failure captured: Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d HTTP/1.1 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlVc4aIf2XgBn9lXZWo0RWjJWItbtto-_VAREu3cwodEBwzDUUMKBFjfmu9mx3ORhpMCAZZLrYuG72LRtgKuUzMFbozEuoVxWKmsWVam_sBqczG_q0kG8tn_gQuK0idUHZBCELvFb2dMJJhYCS0-wcaZERl2I8qfT2s7d9BKQaqc77U Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 4101b57c797e491e897f9871b5f5b1a0 Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '0de02f84-9bb0-40d2-9f1e-714260b2145d'} Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:08.987524 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. Aug 30 18:28:08.995601 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:09.002956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Returning 404 to user: Instance 0de02f84-9bb0-40d2-9f1e-714260b2145d could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:09.004239 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d77ca7ef-9e17-4649-882c-11dc06159e78 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d" status: 404 len: 111 microversion: 2.1 time: 0.068868 Aug 30 18:28:09.006064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1690/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:08 2022] GET /compute/v2.1/servers/0de02f84-9bb0-40d2-9f1e-714260b2145d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:09.018127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:09.018870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:09.028216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.030069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.030808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.031762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.032542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.033133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.066245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:09.180455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3288bce5-55bd-4b35-b066-f1fd73f915ef tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 204 len: 0 microversion: 2.1 time: 0.167203 Aug 30 18:28:09.189708 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1565/3255] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:09 2022] DELETE /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:09.194450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:09.195277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:09.202383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.202895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.203335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.204042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.204805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.205670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.296187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:09.297357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:09.304062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.305339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.307374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.308375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.309065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.310040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.567049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:09.603315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e33ca320-ca4d-4b0b-8299-44f9b9a700ea tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1270 microversion: 2.1 time: 0.303259 Aug 30 18:28:09.604207 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1566/3256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:09 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1270 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:09.610614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:09.611726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:09.644490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.645837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.646602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.647633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.648345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.649365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.663671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:09.686982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9dafb67-ef26-42af-901c-693da1b14e6f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1535 microversion: 2.1 time: 0.496797 Aug 30 18:28:09.700287 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1691/3257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:09 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1535 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:09.705198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:09.705835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:09.723331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.729307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.730153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:09.743673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:09.747818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:09.748765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:10.024673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:10.057466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:10.064304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:10.069503 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb886aae-ca1a-47e0-b255-5e8fe4412232 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1351 microversion: 2.47 time: 0.380060 Aug 30 18:28:10.081988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1692/3258] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:09 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1351 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:10.087307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de02f84-9bb0-40d2-9f1e-714260b2145d", "name": "network-vif-deleted", "tag": "21739901-ce94-4ec7-8c3d-a2dfadf57e0a"}, {"name": "network-changed", "server_uuid": "23458d56-3de6-4429-91bd-9d46736b5a3f", "tag": "385e253f-9581-4c5c-8aa5-941c3ef491b8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:10.102713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:10.109620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:10.110176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:10.126042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Creating event network-vif-deleted:21739901-ce94-4ec7-8c3d-a2dfadf57e0a for instance 0de02f84-9bb0-40d2-9f1e-714260b2145d on n-h1-854119-10 Aug 30 18:28:10.126969 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] Creating event network-changed:385e253f-9581-4c5c-8aa5-941c3ef491b8 for instance 23458d56-3de6-4429-91bd-9d46736b5a3f on n-h1-854119-10 Aug 30 18:28:10.134200 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7f2ec787-d398-4212-8177-f94c5d04edce req-491e34a8-0191-4ae1-8bfa-1504ccb57303 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050741 Aug 30 18:28:10.135565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1693/3259] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:10.446625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:10.480733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7790318-47e2-400e-97f2-67a14b6b640b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.873780 Aug 30 18:28:10.508770 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1567/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:09 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:10.656580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:10.657787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:10.685967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:10.689115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:10.690959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:10.693287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:10.695259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:10.697028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:10.713592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:10.714221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:10.729120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:10.729628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:10.730071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:10.730832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:10.733258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:10.735720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:11.319774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:11.329687 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c1051e0-e2ed-4cf5-80ac-ff5d62174289 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1535 microversion: 2.1 time: 0.624873 Aug 30 18:28:11.330661 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1568/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:10 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1535 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:11.335853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:11.336776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:11.345100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:11.345605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:11.346068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:11.347055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:11.347987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:11.348587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:11.682276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:11.695482 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b50eba2-dba8-416d-890b-35c94077ae2a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 1.047550 Aug 30 18:28:11.708765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1694/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:10 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:11.714249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:11.727864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:11.734962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:11.737134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:11.737784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:11.739468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:11.743400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:11.744165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:11.969921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:11.985080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:11.987844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:11.992342 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb475045-220a-420a-ab8c-5cb6b4ad0999 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1339 microversion: 2.47 time: 0.658438 Aug 30 18:28:11.993451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1569/3263] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:11 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1339 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:12.351615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:12.352986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:12.360327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:12.360813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:12.361231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:12.361949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:12.362416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:12.365751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:12.377505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:12.515238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:12.533560 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26ca96a5-e10b-4303-860d-f2b561a5fab6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.821904 Aug 30 18:28:12.534843 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1695/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:11 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:12.720762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:12.721693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:12.731650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:12.732455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:12.733526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:12.734504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:12.735206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:12.735839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:12.864416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:12.874098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ec9703a-9668-438f-b2b0-050c45845b8f tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1535 microversion: 2.1 time: 0.526395 Aug 30 18:28:12.875554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1570/3265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:12 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1535 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:13.017331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:13.018818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:13.028909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.029699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.030499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.031361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.031830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.032258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.237994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:13.248243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:13.250137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:13.252526 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7dc34e98-f73c-453a-a6b8-9f762847f18f tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1360 microversion: 2.47 time: 0.238485 Aug 30 18:28:13.257658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1571/3266] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:13 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:13.277733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1265201796"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:13.281915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:13.289246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.294518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.298810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.300234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.300899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.303309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.634315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:13.651784 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f674eba-ad26-4193-ae3d-4c6d611fa421 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 0.938484 Aug 30 18:28:13.658450 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1696/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:12 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:13.658769 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-405d5196-e44f-4a9c-b151-fae47944f6ce tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "POST /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1/action" status: 202 len: 52 microversion: 2.47 time: 0.380547 Aug 30 18:28:13.658945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:13.659109 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1572/3268] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:28:13 2022] POST /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1/action => generated 52 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 30 18:28:13.659281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:13.675011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.675818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.676589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.677449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.679690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.681443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.732538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:13.738565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:13.755900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.757088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.758032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.759668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:13.760546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:13.761904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:13.872302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:14.065119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f72975f5-c882-46e0-9a24-093e60e3d2f1 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 204 len: 0 microversion: 2.47 time: 0.384919 Aug 30 18:28:14.068916 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1573/3269] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:28:13 2022] DELETE /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:28:14.076766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:14.078412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:14.086800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:14.087596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:14.087973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:14.089072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:14.089701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:14.090066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:14.450327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:14.472423 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f550d034-b9f4-45ae-89a7-41f2726265af tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 200 len: 1493 microversion: 2.1 time: 0.401819 Aug 30 18:28:14.473527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1574/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:14 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 1493 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:14.493482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a759da-7d88-4410-b92c-f070dddca5ff", "tag": "e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:14.522992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:14.524404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:14.524853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:14.562004 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] Creating event network-changed:e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f for instance 93a759da-7d88-4410-b92c-f070dddca5ff on n-h2-854119-10 Aug 30 18:28:14.575738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-88f5b258-2428-495c-b1b1-14b4c4cba9b3 req-2f45043e-1d16-46b5-a8d8-a9a48aeee3f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096103 Aug 30 18:28:14.577071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1575/3271] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:14.591135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:14.594759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:14.615357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:14.619636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:14.620380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:14.621365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:14.622045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:14.622731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:14.665279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:14.676498 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6e02d6d-a412-45e3-8f6e-1564778023ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 1.022260 Aug 30 18:28:14.681912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1697/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:13 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:14.902654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:14.912973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:14.922304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:14.926390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ac1bbc8-4ba7-4b1b-a7e0-b6deee92c4e6 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1366 microversion: 2.47 time: 0.348293 Aug 30 18:28:14.930037 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1576/3273] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:14 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:14.958743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:14.966089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:14.990990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.017491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.019806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.033136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.033890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.034568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.099081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fef1157-56b1-474b-8613-499cda01795f", "name": "network-vif-deleted", "tag": "6c7005a8-219f-444c-b9fa-bbb90b358617"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:15.131135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.134146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.136320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.167375 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] Creating event network-vif-deleted:6c7005a8-219f-444c-b9fa-bbb90b358617 for instance 4fef1157-56b1-474b-8613-499cda01795f on n-h2-854119-10 Aug 30 18:28:15.184450 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-422f4a0b-b05a-40f3-a714-ef64f43f804c req-c65d6800-ad6a-443b-8591-41da32d1d069 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.495741 Aug 30 18:28:15.186665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1698/3274] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:15.499223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:15.499930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 4fef1157-56b1-474b-8613-499cda01795f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:15.509595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.512957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.513618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.516130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.519000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.519678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.560239 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] HTTP exception thrown: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Request method failure captured: Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f HTTP/1.1 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlVc4aIf2XgBn9lXZWo0RWjJWItbtto-_VAREu3cwodEBwzDUUMKBFjfmu9mx3ORhpMCAZZLrYuG72LRtgKuUzMFbozEuoVxWKmsWVam_sBqczG_q0kG8tn_gQuK0idUHZBCELvFb2dMJJhYCS0-wcaZERl2I8qfT2s7d9BKQaqc77U Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 4101b57c797e491e897f9871b5f5b1a0 Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4fef1157-56b1-474b-8613-499cda01795f'} Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:15.561936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. Aug 30 18:28:15.567892 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:15.569447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Returning 404 to user: Instance 4fef1157-56b1-474b-8613-499cda01795f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:15.570564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-02feba9a-9561-4239-9a37-b5dbae7ed03c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f" status: 404 len: 111 microversion: 2.1 time: 0.075818 Aug 30 18:28:15.571663 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1699/3275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:15 2022] GET /compute/v2.1/servers/4fef1157-56b1-474b-8613-499cda01795f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:15.587034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-472ce3f6-7d49-4635-990c-60ddbcc304c4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '.version_select at 0x7f4e55dec820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:15.618799 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-472ce3f6-7d49-4635-990c-60ddbcc304c4 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545758201" status: 202 len: 0 microversion: 2.1 time: 0.042608 Aug 30 18:28:15.620091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1700/3276] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545758201 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:28:15.703298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:15.705636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:15.726782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.747161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.749088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:15.758562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:15.761312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:15.765913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:16.018165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:16.028291 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-11fe486b-0b96-472b-939c-02aa2c4e6f32 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 1.093032 Aug 30 18:28:16.028905 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1577/3277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:14 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:16.045940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:16.046686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:16.057871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:16.058287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:16.058986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:16.070152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:16.071262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:16.071909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:16.411742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:16.424034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:16.430986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:16.434810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0b7e43e-e82a-462f-9554-1cfc64d9fcb4 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1366 microversion: 2.47 time: 0.404798 Aug 30 18:28:16.436750 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1578/3278] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:16 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:16.523316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:16.547569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acb31fc2-b29f-4bba-94a8-cc822014518e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.846975 Aug 30 18:28:16.548347 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1701/3279] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:15 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:16.753692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23458d56-3de6-4429-91bd-9d46736b5a3f", "name": "network-vif-plugged", "status": "completed", "tag": "385e253f-9581-4c5c-8aa5-941c3ef491b8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:16.765083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:16.765956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:16.766685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:16.780717 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] Creating event network-vif-plugged:385e253f-9581-4c5c-8aa5-941c3ef491b8 for instance 23458d56-3de6-4429-91bd-9d46736b5a3f on n-h1-854119-10 Aug 30 18:28:16.788309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-730c92a3-5613-4d10-af33-e0adb3fda7bd req-f3b2ffb9-4bb1-4244-98d7-6fe595173369 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038173 Aug 30 18:28:16.789618 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1579/3280] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:17.049698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:17.051093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:17.060291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.061132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.062216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.063251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.064002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.064667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.395103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:17.395772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:17.412301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.412826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.413459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.414535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.415318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.415773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.455483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:17.492004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:17.504785 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4ad0907-17ea-4b02-9717-9fea4006cd6d tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 0.459206 Aug 30 18:28:17.520932 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1702/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:17 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:17.526211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:17.527380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:17.529692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:17.535734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.536246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.536692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.537472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.537959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.538400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.553301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:17.565300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=56 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:17.587801 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3447c210-5f64-43f9-a50f-13ed53db3578 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 204 len: 0 microversion: 2.1 time: 0.196795 Aug 30 18:28:17.588820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1580/3282] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:17 2022] DELETE /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:17.594851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:17.595572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:17.606527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.607569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.608184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.609077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.609552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.609969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.632831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:17.647405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:17.649400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:17.650992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-42e95c58-0650-45b9-94a8-485c3fc698dc tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1366 microversion: 2.47 time: 0.128984 Aug 30 18:28:17.651634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1703/3283] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:17 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:17.657744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:17.659230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:17.678124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.678906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.679923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:17.681687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:17.682414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:17.684697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.044842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:18.064739 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2792536b-bdcf-4332-a429-a649a9d10fdc tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1469 microversion: 2.1 time: 0.411193 Aug 30 18:28:18.065847 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1704/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:17 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1469 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:18.288895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:18.298117 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2dd75c7c-3fcf-411d-9afc-a1fe2b83adc8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.707847 Aug 30 18:28:18.298740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1581/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:17 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:18.531277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:18.532044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:18.541409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:18.542526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:18.543403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.545219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:18.546514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:18.547212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.676014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:18.677271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:18.680364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:18.698994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:18.699872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:18.700479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.701424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:18.702056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:18.703033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.759077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:18.760184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:18.760655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:18.761128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lazy-loading 'fault' on Instance uuid 650e2903-59dd-47e8-8263-2bd26e7382f1 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:28:18.918614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:18.927238 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e162fad1-23ae-4f15-a3e9-d8c956e1b2d0 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 0.401605 Aug 30 18:28:18.937242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1705/3286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:18 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:19.084373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:19.090698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:19.091978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:19.100546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:19.104149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc3370aea1b4e5c83d093fe0fd5c3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7a34efd06e48ce954efb8256d0c73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:19.104992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:19.106965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:19.107499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a21cfde1-413b-46f2-86b0-52167f2383e5 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 200 len: 1371 microversion: 2.47 time: 0.435389 Aug 30 18:28:19.107673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:19.108101 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1582/3287] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:18 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 1371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:28:19.108398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:19.111893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:19.112496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:19.329686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:19.330363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:19.346434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:19.347042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:19.347491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:19.348233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:19.349951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:19.350446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:19.360040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:19.620782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:19.629294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-21bee57a-eec3-4cb5-b440-dc7027649c3b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1367 microversion: 2.1 time: 0.304279 Aug 30 18:28:19.643271 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1583/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:19 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:19.954158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a759da-7d88-4410-b92c-f070dddca5ff", "name": "network-vif-plugged", "status": "completed", "tag": "e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:19.973906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:19.974544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:19.975060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:19.991841 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] Creating event network-vif-plugged:e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f for instance 93a759da-7d88-4410-b92c-f070dddca5ff on n-h2-854119-10 Aug 30 18:28:20.000930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-aa4fee87-f485-4e4a-a79b-9f2f3d07458c req-385d714a-1b78-481e-8d72-f841ad7a2b00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053582 Aug 30 18:28:20.001967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1584/3289] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:20.010069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:20.011306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:20.019517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.020014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.020452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.021172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.021627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.022129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.149327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:20.160676 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6aeedabb-2b0d-41e7-ade1-91b9adc4ffe3 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1469 microversion: 2.1 time: 1.073920 Aug 30 18:28:20.166996 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1706/3290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:19 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1469 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:20.177926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:20.180481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] [instance: 650e2903-59dd-47e8-8263-2bd26e7382f1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:20.191693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:20.204835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.205343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.205775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.211749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.214130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.217734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.244568 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] HTTP exception thrown: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Request method failure captured: Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 HTTP/1.1 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDla2bed9655ul2yWMqUD4zLmTMms85KNGDA2cz8TJDM46HcRt3NBukkEgebiC3_33jrioX-oFu2eyEqNBRnmSYFFVxmnuXHFvDB5SWmIA-Lkg_m8n45o1cNyg73HMJXhL5M3-JYOGkufwSLyBBrh8lPUBIH1faUs4wFEWmVSLEk3FoA Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2f7a34efd06e48ce954efb8256d0c73c Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAaction247Test-709429956 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f7a34efd06e48ce954efb8256d0c73c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f7a34efd06e48ce954efb8256d0c73c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f7a34efd06e48ce954efb8256d0c73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f7a34efd06e48ce954efb8256d0c73c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAaction247Test-709429956 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2f7a34efd06e48ce954efb8256d0c73c Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAaction247Test-709429956 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAaction247Test-709429956-project Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: fbc3370aea1b4e5c83d093fe0fd5c3a1 Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAaction247Test-709429956-project Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '650e2903-59dd-47e8-8263-2bd26e7382f1'} Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:20.247928 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. Aug 30 18:28:20.252430 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:20.255795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] Returning 404 to user: Instance 650e2903-59dd-47e8-8263-2bd26e7382f1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:20.256963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d5eac68-68f0-49c8-8716-fd5606e3aa90 tempest-ServersAaction247Test-709429956 tempest-ServersAaction247Test-709429956-project] 10.222.0.25 "GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1" status: 404 len: 111 microversion: 2.47 time: 0.088020 Aug 30 18:28:20.258252 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1707/3291] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:28:20 2022] GET /compute/v2.1/servers/650e2903-59dd-47e8-8263-2bd26e7382f1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:28:20.520193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:20.533599 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39651d22-8103-40e3-834e-4c9c3ceb340e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1312 microversion: 2.1 time: 0.529450 Aug 30 18:28:20.534952 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1585/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:20 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:20.651858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:20.652737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:20.670454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.675639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.677027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.678100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:20.680166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:20.680919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:20.714724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:21.202042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:21.202838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:21.226992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.230910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.232762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:21.235186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.236347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.238278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:21.241154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:21.251193 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f7646c3-531e-4a1c-9cba-2419d9553658 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1557 microversion: 2.1 time: 0.605111 Aug 30 18:28:21.258781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1708/3293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:20 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1557 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:21.276119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:21.276630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:21.285105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.285603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.286052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:21.286797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.291142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.292175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:21.660249 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3372de3e-ed25-44f1-af77-f0cb30fa3f58 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.388464 Aug 30 18:28:21.662579 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1709/3294] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:28:21 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-interface => generated 285 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:21.688325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:21.693229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:21.699447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:21.710316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8a4d1403-541f-4978-a95c-5a5d509960d5 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1469 microversion: 2.1 time: 0.526179 Aug 30 18:28:21.713636 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1586/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:21 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:21.716833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.719511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.720565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:21.724616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:21.726103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:21.728827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.185802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb0077d-d700-47a5-88f0-567d2c8e527e", "name": "network-vif-deleted", "tag": "d181bbea-a166-41e4-ab99-4f76ea2720db"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:22.197671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.198569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.199343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.215741 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] Creating event network-vif-deleted:d181bbea-a166-41e4-ab99-4f76ea2720db for instance cdb0077d-d700-47a5-88f0-567d2c8e527e on n-h2-854119-10 Aug 30 18:28:22.221781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0a71cb9b-9bf8-4409-8baf-ebb616abc297 req-f1e95999-2858-45ee-8b77-6abcc06e782a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039676 Aug 30 18:28:22.222728 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1587/3296] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:22.731663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:22.732272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:22.733025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:22.741740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.742728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.744152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.745376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.746105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.746843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.750906 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96ff8925-d69a-4b85-9dae-92da7c6e0bfb tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1497 microversion: 2.1 time: 1.083397 Aug 30 18:28:22.760043 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1710/3297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:21 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1497 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:22.791193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:22.821002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.821719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.822373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.822661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.server_groups [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Querying cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) for 1 instances {{(pid=122589) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 18:28:22.823551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lazy-loading 'fault' on Instance uuid cdb0077d-d700-47a5-88f0-567d2c8e527e {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:28:22.824457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.825187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.825824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.896899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6be12831-596f-41a4-b716-51a4d09e5f7c tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3" status: 200 len: 222 microversion: 2.1 time: 0.118230 Aug 30 18:28:22.903882 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1711/3298] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:28:22 2022] GET /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3 => generated 222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:22.909888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:22.910431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:22.929992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.931241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.931712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:22.932553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:22.938126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:22.938806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.016085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:23.049613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:23.064417 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f8a499d-8a36-4f55-9f45-65a61a0b255a tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 200 len: 1303 microversion: 2.1 time: 0.336543 Aug 30 18:28:23.069518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1588/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:22 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 1303 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:23.223718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be9516b3-8598-4d4a-a1fc-364f891bcac6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 204 len: 0 microversion: 2.1 time: 0.318356 Aug 30 18:28:23.224606 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1712/3300] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:22 2022] DELETE /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:23.236848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:23.237604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:23.252530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.254700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.255585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.258289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:23.262987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:23.263538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:23.774299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:23.786931 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48b45c2f-9145-40c1-a5d6-d12b7b28c9a2 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1503 microversion: 2.1 time: 0.556646 Aug 30 18:28:23.799986 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1589/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:23 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:24.088649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:24.089499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: cdb0077d-d700-47a5-88f0-567d2c8e527e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:24.111394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.115945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.116673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.118936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.121896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.122880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.156355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] HTTP exception thrown: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Request method failure captured: Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e HTTP/1.1 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlVc4aIf2XgBn9lXZWo0RWjJWItbtto-_VAREu3cwodEBwzDUUMKBFjfmu9mx3ORhpMCAZZLrYuG72LRtgKuUzMFbozEuoVxWKmsWVam_sBqczG_q0kG8tn_gQuK0idUHZBCELvFb2dMJJhYCS0-wcaZERl2I8qfT2s7d9BKQaqc77U Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 4101b57c797e491e897f9871b5f5b1a0 Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'cdb0077d-d700-47a5-88f0-567d2c8e527e'} Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:24.163011 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. Aug 30 18:28:24.176431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:24.184963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Returning 404 to user: Instance cdb0077d-d700-47a5-88f0-567d2c8e527e could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:24.189059 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91c3f336-1372-4adb-9047-c0cb737b6ac8 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e" status: 404 len: 111 microversion: 2.1 time: 0.105095 Aug 30 18:28:24.195870 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1713/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:24 2022] GET /compute/v2.1/servers/cdb0077d-d700-47a5-88f0-567d2c8e527e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:24.207000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:24.207541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:24.225782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.226284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.230646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.232173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.234491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.238894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.330795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:28:24.594202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-793e4e18-a733-4982-be76-cca827d2503c tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 204 len: 0 microversion: 2.1 time: 0.394395 Aug 30 18:28:24.606085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:24.607174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:24.610800 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1590/3303] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:24 2022] DELETE /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:24.621072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.623680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.625024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.627389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.628840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.631346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.815856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:24.817178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:24.838793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.839621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.840296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:24.841314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:24.843233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:24.844088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:25.347594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:25.392763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9036204-c100-44be-a930-56de257ed167 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1503 microversion: 2.1 time: 0.582484 Aug 30 18:28:25.417176 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1591/3304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:24 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1503 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:25.704345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:25.717988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b9f29f5-ae07-4bd7-af02-e94ebc5aaebd tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1469 microversion: 2.1 time: 1.116834 Aug 30 18:28:25.718996 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1714/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:24 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1469 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:26.436849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:26.437691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:26.464540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.465033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.465676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:26.466685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.475910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.476910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:26.757901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:26.759051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:26.774471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.774967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.775407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:26.776176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:26.776792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:26.777181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:27.332334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:27.364768 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e6994d3-468b-4974-ab11-e08aeb64bae4 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1503 microversion: 2.1 time: 0.932188 Aug 30 18:28:27.365879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1592/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:26 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1503 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:27.803161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:27.814233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f09794b-b865-4482-8c69-b04cdff04e62 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1469 microversion: 2.1 time: 1.059789 Aug 30 18:28:27.821147 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1715/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:26 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1469 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:28.387155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:28.387768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:28.404610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.405120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.405744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.407262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.408714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.410935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.576135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23458d56-3de6-4429-91bd-9d46736b5a3f", "tag": "385e253f-9581-4c5c-8aa5-941c3ef491b8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:28.599263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.599755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.600183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.669544 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] Creating event network-changed:385e253f-9581-4c5c-8aa5-941c3ef491b8 for instance 23458d56-3de6-4429-91bd-9d46736b5a3f on n-h1-854119-10 Aug 30 18:28:28.691433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-acbff38c-7045-4f7d-9d22-810f46afef70 req-57911425-05d7-439a-ae1f-96aca16310ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118919 Aug 30 18:28:28.692893 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1716/3308] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:28.837602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:28.838318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:28.853526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.854084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.854566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.856594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:28.861069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:28.861797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:28.968958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4101b57c797e491e897f9871b5f5b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd4f43a900b48eebd7e4589e8cf1cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:28.975545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ad52cca3b43a5b744396bb418a185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc8134577e5943f291d03292c04da5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:28.986947 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01217241-dea3-4908-99a5-740a5b09ca22 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 200 len: 1427 microversion: 2.1 time: 0.155145 Aug 30 18:28:28.987917 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1717/3309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:28 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:28.990926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8378501f-01c6-4c9a-acb9-3a0fe744869e tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 200 len: 1461 microversion: 2.1 time: 0.608203 Aug 30 18:28:29.005179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1593/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:28 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 1461 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:29.052340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62", "name": "network-vif-deleted", "tag": "86a507da-9ff6-439e-a830-c3058e8fddbe"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:29.090434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:29.091246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:29.091863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:29.106069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] Creating event network-vif-deleted:86a507da-9ff6-439e-a830-c3058e8fddbe for instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 on n-h1-854119-10 Aug 30 18:28:29.113555 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5053f471-c3bb-43de-b7a2-856b72336cb5 req-0cc49646-96e4-428b-80e2-4ba1a6ae7a42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064568 Aug 30 18:28:29.115019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1718/3311] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:30.025899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.031472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] [instance: 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:30.034263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.034977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:30.052146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.052398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.052641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.053015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.053461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.056258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.056741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.057178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.057436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.061647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.062636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.064579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.103376 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] HTTP exception thrown: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. Aug 30 18:28:30.104675 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Request method failure captured: Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 HTTP/1.1 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlVc4aIf2XgBn9lXZWo0RWjJWItbtto-_VAREu3cwodEBwzDUUMKBFjfmu9mx3ORhpMCAZZLrYuG72LRtgKuUzMFbozEuoVxWKmsWVam_sBqczG_q0kG8tn_gQuK0idUHZBCELvFb2dMJJhYCS0-wcaZERl2I8qfT2s7d9BKQaqc77U Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5fd4f43a900b48eebd7e4589e8cf1cab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 5fd4f43a900b48eebd7e4589e8cf1cab Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MigrationsAdminTest-54570559 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 4101b57c797e491e897f9871b5f5b1a0 Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MigrationsAdminTest-54570559-project Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62'} Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.105363 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] Returning 404 to user: Instance 0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce94ea7e-cee2-439b-9836-96039560c100 tempest-MigrationsAdminTest-54570559 tempest-MigrationsAdminTest-54570559-project] 10.222.0.25 "GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62" status: 404 len: 111 microversion: 2.1 time: 0.092239 Aug 30 18:28:30.113819 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1719/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/servers/0d0fe3b0-9f58-460f-8b8e-8b6821b5bc62 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff HTTP/1.1 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '93a759da-7d88-4410-b92c-f070dddca5ff'} Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.126053 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.135571 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.139712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.142865 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76100fef-614e-4108-8fa3-1c7329ab1139 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 404 len: 111 microversion: 2.1 time: 0.128972 Aug 30 18:28:30.144664 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1594/3313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.154505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.185034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.server_groups [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Querying cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) for 1 instances {{(pid=122589) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 18:28:30.185752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.186237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.186702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.215945 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93e879cd-d7d5-4c26-86ec-41245f5cf3df tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.065317 Aug 30 18:28:30.216548 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1720/3314] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:30.229455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.256558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_groups [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Querying cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) for 1 instances {{(pid=122590) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 18:28:30.257638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.258414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.259085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.282551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b327b470-ef97-4c41-8813-f38d22abf09a tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3" status: 200 len: 184 microversion: 2.1 time: 0.057801 Aug 30 18:28:30.296434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.297377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:30.302599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1595/3315] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3 => generated 184 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:30.306689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.307476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.308164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.309461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.310177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.310700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.333092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff HTTP/1.1 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '93a759da-7d88-4410-b92c-f070dddca5ff'} Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:30.335235 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.341149 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.346490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.347887 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d6217c5-6f4f-4830-af44-36a9a5dec242 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 404 len: 111 microversion: 2.1 time: 0.056181 Aug 30 18:28:30.352542 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1721/3316] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.357670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.358302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] [instance: 93a759da-7d88-4410-b92c-f070dddca5ff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:30.365637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.366134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.368953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.371637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:30.372136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:30.379112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:30.403059 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff HTTP/1.1 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '93a759da-7d88-4410-b92c-f070dddca5ff'} Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.405731 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance 93a759da-7d88-4410-b92c-f070dddca5ff could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91ed3e78-f449-45dd-b4ad-0099cc4bc7c5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff" status: 404 len: 111 microversion: 2.1 time: 0.053841 Aug 30 18:28:30.415519 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1596/3317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:30 2022] GET /compute/v2.1/servers/93a759da-7d88-4410-b92c-f070dddca5ff => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.422728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c719084-120f-405f-8f06-c615abf18407 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.431394 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1c719084-120f-405f-8f06-c615abf18407 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c719084-120f-405f-8f06-c615abf18407 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-server-groups/4c808eea-54a8-4349-ad1f-f12850cada86 HTTP/1.1 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4c808eea-54a8-4349-ad1f-f12850cada86'} Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.434655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. Aug 30 18:28:30.439220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.443160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c719084-120f-405f-8f06-c615abf18407 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance group 4c808eea-54a8-4349-ad1f-f12850cada86 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.445105 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c719084-120f-405f-8f06-c615abf18407 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/4c808eea-54a8-4349-ad1f-f12850cada86" status: 404 len: 117 microversion: 2.1 time: 0.025841 Aug 30 18:28:30.450183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1722/3318] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/os-server-groups/4c808eea-54a8-4349-ad1f-f12850cada86 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.458149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1791264-7f9b-452b-9261-eb441c8742d5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.467692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-b1791264-7f9b-452b-9261-eb441c8742d5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1791264-7f9b-452b-9261-eb441c8742d5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-server-groups/cce31b09-200b-4cc2-acc4-a160440bf1f4 HTTP/1.1 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'cce31b09-200b-4cc2-acc4-a160440bf1f4'} Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.470949 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. Aug 30 18:28:30.483066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.495683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1791264-7f9b-452b-9261-eb441c8742d5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance group cce31b09-200b-4cc2-acc4-a160440bf1f4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.496985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1791264-7f9b-452b-9261-eb441c8742d5 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cce31b09-200b-4cc2-acc4-a160440bf1f4" status: 404 len: 117 microversion: 2.1 time: 0.046642 Aug 30 18:28:30.498776 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1597/3319] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/os-server-groups/cce31b09-200b-4cc2-acc4-a160440bf1f4 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.506914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b95793c-0e2e-41be-b6f1-87aa4cd50127 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.515655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7b95793c-0e2e-41be-b6f1-87aa4cd50127 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b95793c-0e2e-41be-b6f1-87aa4cd50127 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-server-groups/6f6c9ff3-bd6d-47f3-87b1-925df53b173c HTTP/1.1 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '6f6c9ff3-bd6d-47f3-87b1-925df53b173c'} Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.518208 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. Aug 30 18:28:30.524419 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.526239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b95793c-0e2e-41be-b6f1-87aa4cd50127 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance group 6f6c9ff3-bd6d-47f3-87b1-925df53b173c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.527370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b95793c-0e2e-41be-b6f1-87aa4cd50127 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/6f6c9ff3-bd6d-47f3-87b1-925df53b173c" status: 404 len: 117 microversion: 2.1 time: 0.024524 Aug 30 18:28:30.531950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1723/3320] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/os-server-groups/6f6c9ff3-bd6d-47f3-87b1-925df53b173c => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.537361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-053703fd-68eb-40c0-abe8-a94411b95960 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.559513 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-053703fd-68eb-40c0-abe8-a94411b95960 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] HTTP exception thrown: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-053703fd-68eb-40c0-abe8-a94411b95960 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Request method failure captured: Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-server-groups/35369243-9721-4797-9fad-fc9818668a18 HTTP/1.1 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlatN1navCtrcf6qa31w5jKZLACt_jiOpnccDZhE8EigeqaApaE59KRdj5FnkRa4MjcCAfoa0xvDZ9QI977KCYgrTsNGz3SwiNtFfF4yjwwWd0t1kzPW0aL5oUonw-B5cMh2Sd5P_KLO9KXKPxGYB1_hY_nsk8VWPv1-Bubdvvm7TwU Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc8134577e5943f291d03292c04da5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc8134577e5943f291d03292c04da5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fc8134577e5943f291d03292c04da5e4 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerGroupTestJSON-1284150305 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: f69ad52cca3b43a5b744396bb418a185 Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerGroupTestJSON-1284150305-project Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '35369243-9721-4797-9fad-fc9818668a18'} Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.563828 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-053703fd-68eb-40c0-abe8-a94411b95960 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Returning 404 to user: Instance group 35369243-9721-4797-9fad-fc9818668a18 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:30.568398 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-053703fd-68eb-40c0-abe8-a94411b95960 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/35369243-9721-4797-9fad-fc9818668a18" status: 404 len: 117 microversion: 2.1 time: 0.032735 Aug 30 18:28:30.572597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1598/3321] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/os-server-groups/35369243-9721-4797-9fad-fc9818668a18 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:30.579312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2bc1fa5-1ff5-4655-af5c-0bd9e17641f6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:30.625974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2bc1fa5-1ff5-4655-af5c-0bd9e17641f6 tempest-ServerGroupTestJSON-1284150305 tempest-ServerGroupTestJSON-1284150305-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3" status: 204 len: 0 microversion: 2.1 time: 0.050206 Aug 30 18:28:30.626653 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1724/3322] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:28:30 2022] DELETE /compute/v2.1/os-server-groups/c9740711-f031-492e-a319-cad642ad85c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:28:31.089356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a759da-7d88-4410-b92c-f070dddca5ff", "name": "network-vif-deleted", "tag": "e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:31.129857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:31.130823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:31.131543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:31.176896 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] Creating event network-vif-deleted:e1ed9ee3-2ad4-4f69-8c10-c3a59cde398f for instance 93a759da-7d88-4410-b92c-f070dddca5ff on n-h2-854119-10 Aug 30 18:28:31.189947 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5143d5b2-553f-4f13-b6ac-f34193c28ec8 req-fbe9e7f5-312c-4964-a921-73ca9ee7c3dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107717 Aug 30 18:28:31.197572 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1599/3323] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:36.767084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27d1b111-bc36-48f2-a2d4-f52cdeb75601 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] Calling method '.version_select at 0x7f4e55d78280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:36.792965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27d1b111-bc36-48f2-a2d4-f52cdeb75601 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.344651 Aug 30 18:28:36.793741 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1725/3324] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:28:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:36.850510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e725c425-2b05-4311-8ac9-8ef465e8f668 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] Action: 'update', calling method: .version_select at 0x7f4e56738670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:37.575573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=14,nova_api:INSERT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:37.606763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e725c425-2b05-4311-8ac9-8ef465e8f668 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.795599 Aug 30 18:28:37.607645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1600/3325] 10.222.0.25 () {60 vars in 1206 bytes} [Tue Aug 30 18:28:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:37.625233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68922ecd-77e6-46e3-b75c-2e75ab26fab8 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] Calling method '.version_select at 0x7f4e55d785e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:37.655516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68922ecd-77e6-46e3-b75c-2e75ab26fab8 tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035751 Aug 30 18:28:37.656721 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1726/3326] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 18:28:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:37.682703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95cb74c5-6ded-440d-b8e2-dc71a942532f tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] Action: 'update', calling method: .version_select at 0x7f4e568ffee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:37.899461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95cb74c5-6ded-440d-b8e2-dc71a942532f tempest-QuotaClassesAdminTestJSON-869823673 tempest-QuotaClassesAdminTestJSON-869823673-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.227603 Aug 30 18:28:37.910545 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1601/3327] 10.222.0.25 () {60 vars in 1206 bytes} [Tue Aug 30 18:28:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:42.756040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:43.079889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] Calling method '.version_select at 0x7f4e55cd65e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:43.223241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 17827502-09cb-4ee1-9907-e504c7dcea9e could not be found", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:28:43.223884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] HTTP exception thrown: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] Request method failure captured: Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-floating-ips/17827502-09cb-4ee1-9907-e504c7dcea9e HTTP/1.1 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlba1NbDTki-HznjqRDFDD3EMd8ENkkn6lvspKok3_oNcAi9WCkcHZOWVspz5AOUno4dy61DaMvYE7IkmEtnHTgHZsBg80rIwa6cUOPs_C-43YkL_Nat2kblsaB9GjdQQiorpW8EcPn4V9O5NZtQd9VUhj7cLKSqpmyPvyouwzfrPyE Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 451ddbbaf7cd45ed80c14107483a513e Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-54281055 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ddbbaf7cd45ed80c14107483a513e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/451ddbbaf7cd45ed80c14107483a513e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/451ddbbaf7cd45ed80c14107483a513e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_451ddbbaf7cd45ed80c14107483a513e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-54281055 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 451ddbbaf7cd45ed80c14107483a513e Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-54281055 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-54281055-project Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ea0fdcfdb0cb418d8823a98c8f097a74 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-54281055-project Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: exception: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '17827502-09cb-4ee1-9907-e504c7dcea9e'} Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 17827502-09cb-4ee1-9907-e504c7dcea9e could not be found Aug 30 18:28:43.227220 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdebbeda-4975-4c7d-8ff5-e18a26301fa0'] Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e. Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e Aug 30 18:28:43.232312 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:28:43.236101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] Returning 404 to user: Floating IP not found for ID 17827502-09cb-4ee1-9907-e504c7dcea9e {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:28:43.237159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f4b25db-4cea-4b14-a3fd-4d1043321aee tempest-FloatingIPDetailsNegativeTestJSON-54281055 tempest-FloatingIPDetailsNegativeTestJSON-54281055-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/17827502-09cb-4ee1-9907-e504c7dcea9e" status: 404 len: 111 microversion: 2.1 time: 0.487448 Aug 30 18:28:43.238255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1727/3328] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:28:42 2022] GET /compute/v2.1/os-floating-ips/17827502-09cb-4ee1-9907-e504c7dcea9e => generated 111 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:28:44.275067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:44.363493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1353970736", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "98ccad33-03c9-4e15-8b08-bcbe46fb2514"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:44.489061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] validate_networks() for [('98ccad33-03c9-4e15-8b08-bcbe46fb2514', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:28:47.166274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3f46f2a-00ad-46b9-b964-cf84d2cf692c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: .version_select at 0x7f4e55cd6160>, body: {"keypair": {"name": "tempest-keypair-1866961532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTkma4byTvmfyKnTvHDMVune3fdZhNWIkkeI3r/wqyx47S6wH1JqkwxgWwMYDlJHq1Qpmhc9Mfk2O+GPT2NrgZKNGjfoZ6OMILhnnswjTeTiPyubI2FPcYdFutlKIjrQA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:47.202552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f3f46f2a-00ad-46b9-b964-cf84d2cf692c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:47.219463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f3f46f2a-00ad-46b9-b964-cf84d2cf692c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:47.275643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3f46f2a-00ad-46b9-b964-cf84d2cf692c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401971 Aug 30 18:28:47.277938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1728/3329] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:28:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:47.474727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:28:47.475877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:28:47.477282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:28:47.478034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:28:47.478752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:28:47.504678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:47.505168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:47.505605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:47.506480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:47.512284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:47.516049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:47.578553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Getting quotas for project 1be68bfe12584808b60cf5a04b30be11. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:28:47.597193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Getting quotas for user ada6c19cda644c79bada4093d45aa7a6 and project 1be68bfe12584808b60cf5a04b30be11. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:28:47.640649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:28:47.650461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:28:47.806096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60884559-0caa-48d2-8773-924044ca3aae tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.537955 Aug 30 18:28:47.808496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1602/3330] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:28:47.825316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d03efa0-d820-493d-854a-9eac77daa18a tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:47.828802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d03efa0-d820-493d-854a-9eac77daa18a tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:47.852849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Action: 'update', calling method: .version_select at 0x7f4e55d5d550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:47.983501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:47.984341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:47.984999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:47.986001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:47.986623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:47.987642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.130497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d03efa0-d820-493d-854a-9eac77daa18a tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:48.165001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d03efa0-d820-493d-854a-9eac77daa18a tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1217 microversion: 2.1 time: 0.347044 Aug 30 18:28:48.166107 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1603/3331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:47 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1217 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:48.229149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a87f2643-0032-4909-ba82-8dd00a600374 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0" status: 200 len: 240 microversion: 2.36 time: 0.743024 Aug 30 18:28:48.231131 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1729/3332] 10.222.0.25 () {62 vars in 1303 bytes} [Tue Aug 30 18:28:47 2022] PUT /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0 => generated 240 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:28:48.251711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Calling method '.version_select at 0x7f4e5667b280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:48.522266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:48.523018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:48.531079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.532034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:48.532519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:48.532953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:48.593337 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae857201-4532-4fa2-812c-9b3932d116e3 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0/detail" status: 200 len: 672 microversion: 2.36 time: 0.348560 Aug 30 18:28:48.607715 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1604/3333] 10.222.0.25 () {60 vars in 1304 bytes} [Tue Aug 30 18:28:48 2022] GET /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0/detail => generated 672 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:28:48.968910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Action: 'update', calling method: .version_select at 0x7f4e55ceaaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:49.164305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.164950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.166075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.217610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:49.219715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:49.229482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.234098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.065s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.239187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.263780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.267754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.271776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.276549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.279322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.282131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.540546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.544406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.562909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.569084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:49.572463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:49.574786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:49.773439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:49.803700 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a47d466-f211-4ffc-a82a-1e7d9c2677a8 tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0?user_id=32840d71b94245cd81b3308b4607432d" status: 200 len: 240 microversion: 2.36 time: 0.845887 Aug 30 18:28:49.805533 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1730/3334] 10.222.0.25 () {62 vars in 1384 bytes} [Tue Aug 30 18:28:48 2022] PUT /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0?user_id=32840d71b94245cd81b3308b4607432d => generated 240 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:28:49.818246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b087e0d-b513-4e69-bd00-0d3b6a727f4a tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] Calling method '.version_select at 0x7f4e55c88c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:50.025336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:50.044093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e699e7e8-f499-440e-8324-5ab279358cf3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1221 microversion: 2.1 time: 0.854548 Aug 30 18:28:50.047439 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1605/3335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:49 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1221 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:50.495276 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b087e0d-b513-4e69-bd00-0d3b6a727f4a tempest-QuotasAdminTestV236-36163509 tempest-QuotasAdminTestV236-36163509-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0?user_id=32840d71b94245cd81b3308b4607432d" status: 200 len: 282 microversion: 2.36 time: 0.681316 Aug 30 18:28:50.526571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1731/3336] 10.222.0.25 () {60 vars in 1364 bytes} [Tue Aug 30 18:28:49 2022] GET /compute/v2.1/os-quota-sets/50c14bee15fe4262aa09ab46b3bf23d0?user_id=32840d71b94245cd81b3308b4607432d => generated 282 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:28:51.088179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:51.088937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:51.097109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:51.097109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:51.097770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:51.100232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:51.101282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:51.101282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:51.602605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:51.615635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64d2222a-c33b-430f-bce5-a0f47759d9c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1275 microversion: 2.1 time: 0.547465 Aug 30 18:28:51.631305 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1606/3337] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:51 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1275 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:52.653545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:52.654792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:52.685188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.686242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.686759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.688739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.691260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.691777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.954410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:52.955045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:52.971116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.971747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.972187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.972913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:52.973366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:52.973787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:52.981620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:52.998186 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34367288-1410-440f-8f2c-483fb660c398 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1275 microversion: 2.1 time: 0.348551 Aug 30 18:28:53.003524 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1732/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:52 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1275 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:53.037739 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd3eefdf-c32b-451f-9e94-9eded8703cfa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/ips" status: 200 len: 150 microversion: 2.1 time: 0.087980 Aug 30 18:28:53.048206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1607/3339] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:28:52 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:53.301889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ccfee16f-c516-4f48-b3e0-b006cf0ee81e tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Action: 'create', calling method: .version_select at 0x7f4e55cf3af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1327572351"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:54.027227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:54.028481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:54.053300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:54.056246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:54.057001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:54.061759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:54.064636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:54.067730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:54.216409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ccfee16f-c516-4f48-b3e0-b006cf0ee81e tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.175439 Aug 30 18:28:54.217331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1733/3340] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Aug 30 18:28:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1177 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 18:28:54.242071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7aa7206a-98e6-4957-ba5d-dab6fd0104ab tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55cf14c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:54.446743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7aa7206a-98e6-4957-ba5d-dab6fd0104ab tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.215436 Aug 30 18:28:54.448495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1734/3341] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:28:54 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:55.463595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c511f355-7b34-4015-9991-58bb6fb9f711 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55ceadc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:55.593851 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c511f355-7b34-4015-9991-58bb6fb9f711 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.135646 Aug 30 18:28:55.595161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1735/3342] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:28:55 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:55.997063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:56.006550 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7991942-8bc4-447d-a6d7-697ed43f65e7 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.984006 Aug 30 18:28:56.014324 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1608/3343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:54 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:28:56.618711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eea0162f-81d9-4581-bc94-cab1ebad2fdf tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55cf11f0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:56.764437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eea0162f-81d9-4581-bc94-cab1ebad2fdf tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 346 microversion: 2.1 time: 0.157500 Aug 30 18:28:56.769172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1736/3344] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:28:56 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:56.790955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e46b5c07-7747-4066-97a1-5eb7db09aad9 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Action: 'create', calling method: .version_select at 0x7f4e56656d30>, body: {"snapshot": {"volume_id": "8b39e449-e5dc-4e05-a20d-f0a0a8087571", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1974108077"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:57.040613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:57.041872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:57.057902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.061725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.064119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.066667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.068618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.069714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.267201 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e46b5c07-7747-4066-97a1-5eb7db09aad9 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.469561 Aug 30 18:28:57.267201 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1609/3345] 10.222.0.25 () {60 vars in 1162 bytes} [Tue Aug 30 18:28:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:57.270054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2dc9b2a7-290e-45d4-a0a6-a722b1730acd tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e566f3e50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:57.394590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2dc9b2a7-290e-45d4-a0a6-a722b1730acd tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 287 microversion: 2.1 time: 0.130104 Aug 30 18:28:57.395696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1610/3346] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:28:57 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:57.421260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34566b41-45eb-4629-9bea-f78ca4a8ae1f"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:57.435837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:57.464624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.468163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.473016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:57.474323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:57.477731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:57.478486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:58.143949 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d125b85-49bf-4b22-af38-2f42c5880727 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745654 Aug 30 18:28:58.146410 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1611/3347] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:28:57 2022] POST /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:58.162007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:28:58.181219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9bc5b49-2862-4954-b1a4-92b1229261cd tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e5663d700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:58.195142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb9241ce-ec0e-4fc5-90fa-8f054dacac71 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.161186 Aug 30 18:28:58.207154 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1737/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:57 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:28:58.430649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9bc5b49-2862-4954-b1a4-92b1229261cd tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.279732 Aug 30 18:28:58.432838 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1612/3349] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 18:28:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:28:58.456720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c454049-46f4-4c88-9c08-f7eef0561d20 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55cea8b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:58.553366 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c454049-46f4-4c88-9c08-f7eef0561d20 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 287 microversion: 2.1 time: 0.105018 Aug 30 18:28:58.555696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1738/3350] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:28:58 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:59.229066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:59.230005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:28:59.246368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:59.251840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:59.255259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:59.267185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:59.267989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:59.268965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:59.269635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:59.270254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:59.570020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9aacc7a-2a4c-41dd-97c0-c474ed2aeb33 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55c859d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:28:59.647128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9aacc7a-2a4c-41dd-97c0-c474ed2aeb33 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 287 microversion: 2.1 time: 0.082742 Aug 30 18:28:59.648245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1739/3351] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:28:59 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:28:59.929563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=7 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:28:59.935219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35012740-0ef0-4613-a997-a8766ea297a1", "tag": "7a34e91d-0f9c-4daf-af6e-9d54c769c1ca"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:28:59.967513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:28:59.968338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:28:59.976459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:28:59.994685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] Creating event network-changed:7a34e91d-0f9c-4daf-af6e-9d54c769c1ca for instance 35012740-0ef0-4613-a997-a8766ea297a1 on n-h2-854119-10 Aug 30 18:29:00.009152 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bf82b932-6702-4607-b9f9-3bd1c51680f3 req-32f51b57-e08b-4530-89b6-a37358f45eca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080590 Aug 30 18:29:00.010306 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1740/3352] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:00.659262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:00.666618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c983fe21-6dfb-4e28-bb90-526072a2c72c tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55ca0f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:00.756543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c983fe21-6dfb-4e28-bb90-526072a2c72c tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 287 microversion: 2.1 time: 0.098251 Aug 30 18:29:00.757214 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1741/3353] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:29:00 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:00.911920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:00.932784 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6e695208-3a16-4328-ad88-2a02d8ec246d tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.709266 Aug 30 18:29:00.933396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1613/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:28:59 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:01.470023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-739459347", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a43d14fc-4753-4553-8d04-df60af14fa3d"}], "security_groups": [{"name": "tempest-securitygroup--489408484"}], "key_name": "tempest-keypair-1866961532", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:01.769046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2791b00-af8e-49e9-80a6-d44bef4232f3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e566f30d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:01.828220 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2791b00-af8e-49e9-80a6-d44bef4232f3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 288 microversion: 2.1 time: 0.062886 Aug 30 18:29:01.829374 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1614/3355] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:29:01 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 288 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:01.839630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] validate_networks() for [('a43d14fc-4753-4553-8d04-df60af14fa3d', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:01.843219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f2700ef-408e-4936-ba62-47ec08f859aa tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e564ba820>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:01.977625 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f2700ef-408e-4936-ba62-47ec08f859aa tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 202 len: 0 microversion: 2.1 time: 0.140767 Aug 30 18:29:01.979087 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1615/3356] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 18:29:01 2022] DELETE /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:01.985333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:01.986592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:02.005170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:02.005592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:02.006029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:02.007950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:02.011334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:02.012721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:02.590719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:02.605756 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67d5435d-ddd0-4bfe-aefb-1e96247563d3 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 0.625011 Aug 30 18:29:02.606493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1616/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:01 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:02.898333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b0a0858-f3cd-4610-9bab-8b2b0c0d8cc4 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Calling method '.version_select at 0x7f4e5663db80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:03.047551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b0a0858-f3cd-4610-9bab-8b2b0c0d8cc4 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 371 microversion: 2.1 time: 0.423810 Aug 30 18:29:03.051141 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1617/3358] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:29:02 2022] GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:03.065342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ab4b155-4ff3-475b-b571-dd7e3fb8d872 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e566f30d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:03.151363 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ab4b155-4ff3-475b-b571-dd7e3fb8d872 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 200 len: 287 microversion: 2.1 time: 0.095767 Aug 30 18:29:03.156728 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1618/3359] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:29:03 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:03.166846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e564ba3a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:03.330955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.333888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.334467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.338094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.338855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.340623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.497265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-082e29d2-3eb9-4032-bad7-c0ddcb1de9ce tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 328 microversion: 2.1 time: 0.339226 Aug 30 18:29:03.499716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1619/3360] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:03 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 328 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:03.629738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:03.635878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:03.649048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.649605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.651331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.657278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.662620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.663672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.798092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:03.799141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:03.799840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:03.800262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:03.800690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:03.824584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.825098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.825562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.829738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:03.832851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:03.839290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:03.885489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:03.909555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:03.933994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:29:03.938697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:29:04.082890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8172969a-61c3-4466-a219-8e2c8338e782 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.616749 Aug 30 18:29:04.094447 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1742/3361] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 2630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:29:04.287811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1168172989", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:04.374820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:05.141332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:05.180534 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2330cf44-b055-4f97-b9f6-d97d9a64b6dc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.553820 Aug 30 18:29:05.182625 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1620/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:03 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:05.210320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6dc9e703-fe12-4263-9c89-df096fb8c418 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:05.216461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6dc9e703-fe12-4263-9c89-df096fb8c418 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:05.366606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6dc9e703-fe12-4263-9c89-df096fb8c418 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:05.376971 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6dc9e703-fe12-4263-9c89-df096fb8c418 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1238 microversion: 2.1 time: 0.189076 Aug 30 18:29:05.377597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1621/3363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:05.395591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb733069-b562-4a9f-98ee-6618b8abca6f tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55d17430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:05.436708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-bb733069-b562-4a9f-98ee-6618b8abca6f tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] HTTP exception thrown: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb733069-b562-4a9f-98ee-6618b8abca6f tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Request method failure captured: Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 HTTP/1.1 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbkxVfSaf5gnL6lL7cLGl5EzRp94kuMb52rp4AoPdvZeQhaxI7ohwqa4l5sz6YOY7x_1GWgNuvBQntan-Eld_K4jNpcX3Y4GJfggkUUdFEto4WY1TDJQyrb-KWl4SrH4QLDD51kyNrzfoH3MUCblNYPxbru3Bw9wY63hJQgBkCmS0o Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ba5086b1ad914b0096ee2e8e43f51272 Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: exception: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'adcfb3b1-6cd3-407b-8dd9-2f83808c4f02'} Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. (HTTP 404) (Request-ID: req-9a6e8930-afae-4ce6-9ad7-b1968330a40a) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:29:05.479331 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb733069-b562-4a9f-98ee-6618b8abca6f tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Returning 404 to user: Snapshot adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb733069-b562-4a9f-98ee-6618b8abca6f tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02" status: 404 len: 111 microversion: 2.1 time: 0.102724 Aug 30 18:29:05.484802 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1622/3364] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 18:29:05 2022] GET /compute/v2.1/os-snapshots/adcfb3b1-6cd3-407b-8dd9-2f83808c4f02 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:05.491587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ab240b6-4b57-446b-9bfd-79424acadf82 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e5644de50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:05.625761 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ab240b6-4b57-446b-9bfd-79424acadf82 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 202 len: 0 microversion: 2.1 time: 0.139119 Aug 30 18:29:05.631097 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1623/3365] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:29:05 2022] DELETE /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:29:05.656425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f8135742-ffff-4bc7-afe5-177109ec5009 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e5645a280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:05.778109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f8135742-ffff-4bc7-afe5-177109ec5009 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.141735 Aug 30 18:29:05.779400 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1624/3366] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:05 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:06.205774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:06.207286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:06.241083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.241881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.243987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.245358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.249415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.252323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.474217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:06.475332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:06.476198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:06.476790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:06.477434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:06.496749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.498683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.499279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.509858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.511972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.512636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.569771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:06.583357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for user 78db8d2ea37748dc8d28647df6ec1079 and project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:06.613361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.utils [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] cores quota exceeded for 621c71c2cf284ad78eb3f72a457685b5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122589) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 18:29:06.613938 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Request method failure captured: Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 145 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbsGIyusoA4_uYAgZsH3uqB_UDrDyQL4ZsHDgUTW5N9qxDFGJpnfVg5nv_f2-5k8WL13-tL5wA3IQL_FiafDVaT9EPp3990ULcz6Ay5PU9-YN20a8gtqt_MNLg259Bpqmf3xUrcFS4j-VjjV2QV1I6OT2inwDrteTXHI4XmBD4zNGw Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 78db8d2ea37748dc8d28647df6ec1079 Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1168172989", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1168172989', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452'}}} Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:29:06.628373 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6400b4ba-0602-4fef-87b3-18e425b1b078 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.534338 Aug 30 18:29:06.634599 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1743/3367] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:04 2022] POST /compute/v2.1/servers => generated 111 bytes in 2536 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:06.639033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:06.639033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:06.656439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.657125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.657353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.658062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:06.658552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:06.658964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:06.802713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:06.820616 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2ed0ec4-67b0-4908-b633-c40b81cbffa1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1296 microversion: 2.1 time: 0.186599 Aug 30 18:29:06.838283 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1744/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:06 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:06.854281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e56e4e940>, body: {"quota_set": {"cores": 20}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:07.185660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:07.201788 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7d5f347-a00e-4c55-b64f-e58522956aca tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 0.999511 Aug 30 18:29:07.221551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1625/3369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:06 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:07.249964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ecaa524-133b-47c1-9647-83007a26d3a5 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55d17700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:07.573126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:07.577325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:07.578289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:07.580850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:07.582717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:07.584219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:07.657017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ecaa524-133b-47c1-9647-83007a26d3a5 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.430443 Aug 30 18:29:07.657922 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1626/3370] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:07 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:07.775136 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d84cfd8-be1d-4c37-b381-5b804b4caa1d tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 329 microversion: 2.1 time: 0.934056 Aug 30 18:29:07.775757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1745/3371] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:06 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 329 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:07.788806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a11dcffb-8777-4b88-99f9-753d9c67c7fb tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Calling method '.version_select at 0x7f4e5644d0d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:07.844105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:07.844999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:07.867834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:07.875504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:07.879599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:07.880674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:07.883275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:07.885363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:08.070092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:08.104340 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a11dcffb-8777-4b88-99f9-753d9c67c7fb tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 371 microversion: 2.1 time: 0.317733 Aug 30 18:29:08.111347 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1627/3372] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:29:07 2022] GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:08.119072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e566f3040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:08.528330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:08.548937 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32cb144c-54c7-4fb9-961e-c932ae081221 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1296 microversion: 2.1 time: 0.711119 Aug 30 18:29:08.556142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1746/3373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:07 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1296 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:08.586919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:08.593673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:08.594329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:08.595041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:08.595974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:08.596616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:08.597530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:08.600564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:08.638660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:08.638660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:08.638660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:08.638660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:08.639694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:08.642134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:08.775293 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6835324-a5fc-4f20-9235-fea58458fbf1 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 328 microversion: 2.1 time: 0.661650 Aug 30 18:29:08.777450 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1628/3374] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:08 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 328 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:08.798936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36000268-72a0-4cb5-8981-cbb49c2ece2c tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e5667b550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:09.018304 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36000268-72a0-4cb5-8981-cbb49c2ece2c tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.226511 Aug 30 18:29:09.026146 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1629/3375] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:08 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:09.165451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-652408044", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:09.262027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:09.436705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:09.449129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eebbb45e-dcef-4d62-9153-53acd7e97441 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 0.887591 Aug 30 18:29:09.449627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1747/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:08 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:09.576465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:09.577086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:09.586071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:09.586596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:09.587039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:09.587761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:09.588218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:09.588646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:09.880188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:09.895693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43d59efa-7d96-4cae-ba2c-b499cc0e6a97 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.323041 Aug 30 18:29:09.896768 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1748/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:09 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:10.037786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9240451-436b-483f-a0d6-c434a0d98fd5 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e55c88ca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:10.183439 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9240451-436b-483f-a0d6-c434a0d98fd5 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 200 len: 345 microversion: 2.1 time: 0.150229 Aug 30 18:29:10.184739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1749/3378] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:10 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:10.290759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:10.291337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:10.291657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:10.292075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:10.293120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:10.343286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:10.345299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:10.346958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:10.349803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:10.350302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:10.353438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:10.470855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:10.472077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:10.481164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:10.485064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:10.485704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:10.486471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:10.487465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:10.488190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:10.490279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:10.495289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for user 78db8d2ea37748dc8d28647df6ec1079 and project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:10.563635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.utils [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] instances quota exceeded for 621c71c2cf284ad78eb3f72a457685b5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122590) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 18:29:10.565297 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Request method failure captured: Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 144 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbsGIyusoA4_uYAgZsH3uqB_UDrDyQL4ZsHDgUTW5N9qxDFGJpnfVg5nv_f2-5k8WL13-tL5wA3IQL_FiafDVaT9EPp3990ULcz6Ay5PU9-YN20a8gtqt_MNLg259Bpqmf3xUrcFS4j-VjjV2QV1I6OT2inwDrteTXHI4XmBD4zNGw Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 78db8d2ea37748dc8d28647df6ec1079 Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-652408044", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-652408044', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452'}}} Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:29:10.574652 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:10.579959 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86752bc4-e6ea-42ed-a9ef-598f6d86ef41 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.420374 Aug 30 18:29:10.588443 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1630/3379] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:09 2022] POST /compute/v2.1/servers => generated 119 bytes in 1424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:10.596802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e564b5f70>, body: {"quota_set": {"instances": 10}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:11.218694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:11.221035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:11.221510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:11.227993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:11.230295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:11.231903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:11.376862 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c25bf219-0bb6-4270-b4e9-f3f184fff83f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 329 microversion: 2.1 time: 0.791363 Aug 30 18:29:11.379641 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1631/3380] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:10 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 329 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:11.394460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:11.394986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:11.419646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:11.420170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:11.421213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:11.422118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:11.425128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:11.425801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:11.968962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:11.985537 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e32f5326-a9b5-49fd-80d0-46643155c574 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.600218 Aug 30 18:29:11.988718 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1632/3381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:11 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:12.024208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35012740-0ef0-4613-a997-a8766ea297a1", "name": "network-vif-plugged", "status": "completed", "tag": "7a34e91d-0f9c-4daf-af6e-9d54c769c1ca"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:12.071021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:12.075411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:12.076166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:12.101948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] Creating event network-vif-plugged:7a34e91d-0f9c-4daf-af6e-9d54c769c1ca for instance 35012740-0ef0-4613-a997-a8766ea297a1 on n-h2-854119-10 Aug 30 18:29:12.126674 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d0ec562a-bf94-4932-a5ba-919ceac28bf9 req-e1f06068-ba92-4b41-8bb2-526e77a975ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133043 Aug 30 18:29:12.128001 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1633/3382] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:12.134011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05bcca5c-8503-466e-9568-41c5ff40ff2a tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e56afeaf0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:12.201842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:12.218484 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-215d45a5-b1d1-407c-bad3-0b1fb96e9942 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.751315 Aug 30 18:29:12.237862 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1750/3383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:10 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:12.238518 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-05bcca5c-8503-466e-9568-41c5ff40ff2a tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] HTTP exception thrown: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.243871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e1f6c25-f51f-4243-83d9-720c04efc11f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Calling method '.version_select at 0x7f4e55cd65e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05bcca5c-8503-466e-9568-41c5ff40ff2a tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Request method failure captured: Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 HTTP/1.1 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbkxVfSaf5gnL6lL7cLGl5EzRp94kuMb52rp4AoPdvZeQhaxI7ohwqa4l5sz6YOY7x_1GWgNuvBQntan-Eld_K4jNpcX3Y4GJfggkUUdFEto4WY1TDJQyrb-KWl4SrH4QLDD51kyNrzfoH3MUCblNYPxbru3Bw9wY63hJQgBkCmS0o Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ba5086b1ad914b0096ee2e8e43f51272 Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: exception: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '8b39e449-e5dc-4e05-a20d-f0a0a8087571'} Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. (HTTP 404) (Request-ID: req-abb3d77a-051d-4a08-8fec-77c386de2469) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:29:12.244111 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05bcca5c-8503-466e-9568-41c5ff40ff2a tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Returning 404 to user: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05bcca5c-8503-466e-9568-41c5ff40ff2a tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 404 len: 109 microversion: 2.1 time: 0.116183 Aug 30 18:29:12.248390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1634/3384] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:12 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:12.258493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:12.283743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:12.285417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:12.286878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:12.316772 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] Creating event network-changed:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:29:12.335970 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d740289a-6274-44a9-83ee-9532279c0e8f req-18fea45f-e9de-4cac-bd33-dde06dcc3ed2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084565 Aug 30 18:29:12.336970 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1635/3385] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:12.352080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b6aee0c-3d17-4607-b426-8e6e727e94a3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e566f3f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:12.404827 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e1f6c25-f51f-4243-83d9-720c04efc11f tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 371 microversion: 2.1 time: 0.155094 Aug 30 18:29:12.405733 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1751/3386] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 18:29:12 2022] GET /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5b6aee0c-3d17-4607-b426-8e6e727e94a3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] HTTP exception thrown: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b6aee0c-3d17-4607-b426-8e6e727e94a3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Request method failure captured: Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 HTTP/1.1 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbkxVfSaf5gnL6lL7cLGl5EzRp94kuMb52rp4AoPdvZeQhaxI7ohwqa4l5sz6YOY7x_1GWgNuvBQntan-Eld_K4jNpcX3Y4GJfggkUUdFEto4WY1TDJQyrb-KWl4SrH4QLDD51kyNrzfoH3MUCblNYPxbru3Bw9wY63hJQgBkCmS0o Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ba5086b1ad914b0096ee2e8e43f51272 Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: exception: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '8b39e449-e5dc-4e05-a20d-f0a0a8087571'} Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. (HTTP 404) (Request-ID: req-97eaa171-2246-4a0a-8182-a35d7ff9a634) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:29:12.412347 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b6aee0c-3d17-4607-b426-8e6e727e94a3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Returning 404 to user: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b6aee0c-3d17-4607-b426-8e6e727e94a3 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 404 len: 109 microversion: 2.1 time: 0.073174 Aug 30 18:29:12.421653 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1636/3387] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:29:12 2022] DELETE /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:12.425266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f349d39-3afb-47ff-bea4-d9830fc69fa6 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Calling method '.version_select at 0x7f4e56656160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:12.430641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e55decf70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:12.489081 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-6f349d39-3afb-47ff-bea4-d9830fc69fa6 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] HTTP exception thrown: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f349d39-3afb-47ff-bea4-d9830fc69fa6 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Request method failure captured: Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 HTTP/1.1 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbkxVfSaf5gnL6lL7cLGl5EzRp94kuMb52rp4AoPdvZeQhaxI7ohwqa4l5sz6YOY7x_1GWgNuvBQntan-Eld_K4jNpcX3Y4GJfggkUUdFEto4WY1TDJQyrb-KWl4SrH4QLDD51kyNrzfoH3MUCblNYPxbru3Bw9wY63hJQgBkCmS0o Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0e068e04dc34447bb6a4eb163384373"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b0e068e04dc34447bb6a4eb163384373 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-350003285 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ba5086b1ad914b0096ee2e8e43f51272 Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-350003285-project Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: exception: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '8b39e449-e5dc-4e05-a20d-f0a0a8087571'} Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. (HTTP 404) (Request-ID: req-a66b5ced-2c30-48e2-8d4e-52abec436425) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:29:12.495351 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f349d39-3afb-47ff-bea4-d9830fc69fa6 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] Returning 404 to user: Volume 8b39e449-e5dc-4e05-a20d-f0a0a8087571 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f349d39-3afb-47ff-bea4-d9830fc69fa6 tempest-VolumesSnapshotsTestJSON-350003285 tempest-VolumesSnapshotsTestJSON-350003285-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571" status: 404 len: 109 microversion: 2.1 time: 0.079042 Aug 30 18:29:12.500597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1637/3388] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:29:12 2022] GET /compute/v2.1/os-volumes/8b39e449-e5dc-4e05-a20d-f0a0a8087571 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:29:12.625967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:12.626425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:12.628012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:12.629129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:12.629796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:12.630410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:12.766299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a1a9bee-6a3c-45a9-a398-dd203d715eff tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 325 microversion: 2.1 time: 0.352099 Aug 30 18:29:12.782143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1752/3389] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:12 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:12.937557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-296276279", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:13.015620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:13.016356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:13.043483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:13.044162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:13.045195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:13.046182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:13.051499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:13.052085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:13.063575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=60 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:13.095826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:13.771576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:13.784186 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d677b13-73e1-439a-9c20-543a4d170e20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.774552 Aug 30 18:29:13.789191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1753/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:13 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:13.812111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:13.812731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:13.828065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:13.830001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:13.830505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:13.831259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:13.844297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:13.849673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.297583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:14.310636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:14.311672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:14.312491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:14.314268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:14.331331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.331915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.332417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.333645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.334540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.336941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.355212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:14.382288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:14.397009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Getting quotas for user 78db8d2ea37748dc8d28647df6ec1079 and project 621c71c2cf284ad78eb3f72a457685b5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:14.426108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.utils [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] ram quota exceeded for 621c71c2cf284ad78eb3f72a457685b5, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122590) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 18:29:14.427246 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Request method failure captured: Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 144 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbsGIyusoA4_uYAgZsH3uqB_UDrDyQL4ZsHDgUTW5N9qxDFGJpnfVg5nv_f2-5k8WL13-tL5wA3IQL_FiafDVaT9EPp3990ULcz6Ay5PU9-YN20a8gtqt_MNLg259Bpqmf3xUrcFS4j-VjjV2QV1I6OT2inwDrteTXHI4XmBD4zNGw Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 78db8d2ea37748dc8d28647df6ec1079 Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-296276279", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-296276279', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452'}}} Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:29:14.431178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 18:29:14.440629 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:14.448832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:14.450401 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f638361-4bba-4a29-9638-13cc5c00b4c5 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.517510 Aug 30 18:29:14.455895 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1638/3391] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 1523 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:14.462940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Action: 'update', calling method: .version_select at 0x7f4e564bae50>, body: {"quota_set": {"ram": 51200}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:14.742487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.743072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.744999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.746701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.748592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.749622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.909938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-40d41434-08d3-4422-bd0e-479ada3fd5a0 tempest-QuotasAdminNegativeTest-1296724290 tempest-QuotasAdminNegativeTest-1296724290-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 200 len: 329 microversion: 2.1 time: 0.452215 Aug 30 18:29:14.910625 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1639/3392] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:14 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:14.917744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:14.924097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:14.934485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.935225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.938373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:14.939427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:14.940113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:14.941228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:15.053786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:15.078150 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ff58635-6258-4220-8fff-1714af2936ff tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1317 microversion: 2.1 time: 1.286743 Aug 30 18:29:15.078781 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1754/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:13 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1317 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:15.098712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0226ca6f-5246-4432-a4bb-dbdc8e34e6f8 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Action: 'update', calling method: .version_select at 0x7f4e55d5d700>, body: {"quota_set": {"ram": 0}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:15.108649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0226ca6f-5246-4432-a4bb-dbdc8e34e6f8 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '78db8d2ea37748dc8d28647df6ec1079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621c71c2cf284ad78eb3f72a457685b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0226ca6f-5246-4432-a4bb-dbdc8e34e6f8 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Request method failure captured: Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 HTTP/1.1 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 25 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbsGIyusoA4_uYAgZsH3uqB_UDrDyQL4ZsHDgUTW5N9qxDFGJpnfVg5nv_f2-5k8WL13-tL5wA3IQL_FiafDVaT9EPp3990ULcz6Ay5PU9-YN20a8gtqt_MNLg259Bpqmf3xUrcFS4j-VjjV2QV1I6OT2inwDrteTXHI4XmBD4zNGw Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621c71c2cf284ad78eb3f72a457685b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 621c71c2cf284ad78eb3f72a457685b5 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1173079574 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 78db8d2ea37748dc8d28647df6ec1079 Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-QuotasAdminNegativeTest-1173079574-project Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: {"quota_set": {"ram": 0}} Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '621c71c2cf284ad78eb3f72a457685b5', 'body': {'quota_set': {'ram': 0}}} Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:29:15.118037 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0226ca6f-5246-4432-a4bb-dbdc8e34e6f8 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0226ca6f-5246-4432-a4bb-dbdc8e34e6f8 tempest-QuotasAdminNegativeTest-1173079574 tempest-QuotasAdminNegativeTest-1173079574-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5" status: 403 len: 116 microversion: 2.1 time: 0.028154 Aug 30 18:29:15.123849 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1755/3394] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:29:15 2022] PUT /compute/v2.1/os-quota-sets/621c71c2cf284ad78eb3f72a457685b5 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:15.476580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:15.495192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d39468d-5fa6-4112-8ad8-ba984341b8f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.582973 Aug 30 18:29:15.498713 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1640/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:14 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:16.101473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.102271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.124893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.133437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.135504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.137921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.141130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.142499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.465091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:16.476240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2107c8b7-f7d1-4999-9c92-453d05d79248 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1506 microversion: 2.1 time: 0.380233 Aug 30 18:29:16.492565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1756/3396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:16 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:16.501388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.502898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.519049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.520933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.521401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.523266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.523946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.526411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.528293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.530727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.558073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.562958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.567294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.570681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.577388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.578632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.648337 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fdd59bb-de46-408d-9763-bcbe6504f740 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips" status: 200 len: 109 microversion: 2.1 time: 0.145225 Aug 30 18:29:16.649538 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1641/3397] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:29:16 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips => generated 109 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:16.664694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.665681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.673890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.675047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.675827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.677478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.679761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.680327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.738981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-38e88a1f-cd4d-4f87-ab46-4a40994b2fec tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips" status: 200 len: 109 microversion: 2.1 time: 0.078846 Aug 30 18:29:16.742281 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1642/3398] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:29:16 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips => generated 109 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:16.755636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.756586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.774159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.775107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.780755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.781823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.782519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.783358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.916302 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d6e8cf9-1989-4a67-8090-f652bccb8ad1 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips/tempest-ServerAddressesTestJSON-1104995222-network" status: 200 len: 94 microversion: 2.1 time: 0.162659 Aug 30 18:29:16.918831 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1643/3399] 10.222.0.25 () {58 vars in 1401 bytes} [Tue Aug 30 18:29:16 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1/ips/tempest-ServerAddressesTestJSON-1104995222-network => generated 94 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:29:16.937662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:16.941787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:16.972165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.973154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.973829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:16.979830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:16.981645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:16.984651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:17.055605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:29:17.192915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:17.204602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e4171ea-4206-4f95-8627-2e7e35522026 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.689876 Aug 30 18:29:17.208570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1757/3400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:16 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:17.311883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7fc9d5a4-7ea0-4d8c-95e1-73ba4e631955 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 204 len: 0 microversion: 2.1 time: 0.383319 Aug 30 18:29:17.313742 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1644/3401] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:29:16 2022] DELETE /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:29:17.323265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:17.323890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:17.340043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:17.340558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:17.340995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:17.342186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:17.345437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:17.348017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:17.650639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:17.662988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83f4313d-5fec-43cb-80b3-c941be11dfef tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1512 microversion: 2.1 time: 0.344765 Aug 30 18:29:17.663903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1758/3402] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:17 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:17.729203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-060b7d90-f29b-48dc-91a6-9a95d13f2a13 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: .version_select at 0x7f4e564bae50>, body: {"keypair": {"name": "tempest-keypair-442899764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8iQvddUbtHkQdbPt8LlOKH4INwGJF4TEtAtPTQLfFwIJBmEBLrCfVwaFaiIEQ84jocmnMKS3ImTbZyCy2Ls/cpzo7kk3yG9Us3w+ZjgNFsPEuyP2siLgWnfle87Vq+vQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:17.762524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-060b7d90-f29b-48dc-91a6-9a95d13f2a13 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:17.765250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:17.770645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-060b7d90-f29b-48dc-91a6-9a95d13f2a13 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:17.826856 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-060b7d90-f29b-48dc-91a6-9a95d13f2a13 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105403 Aug 30 18:29:17.829579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1645/3403] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:29:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:18.228008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:18.228642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:18.234538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:18.245317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:18.249256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:18.249911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:18.250877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:18.251552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:18.252424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:18.685273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:18.686199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:18.698165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:18.699011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:18.699611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:18.703365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:18.704052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:18.704739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:18.761184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:18.771065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-425ab8f2-2c41-436e-8279-17ee39fa6d5d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.547031 Aug 30 18:29:18.792368 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1759/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:18 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:18.906114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:18.922937 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3c89563-b4a5-4ec3-9220-f05c3e9ee76f tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1512 microversion: 2.1 time: 0.241314 Aug 30 18:29:18.923950 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1646/3405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:18 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:19.798324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:19.800511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:19.811765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:19.829204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:19.831107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:19.832965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:19.835635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:19.837145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:19.946472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:19.947234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:19.960940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:19.963921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:19.965307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:19.967506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:19.968353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:19.969210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:20.528418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:20.543480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5b9d4b5-21e9-4937-ad4f-d32cacabba9c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.749705 Aug 30 18:29:20.560390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1760/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:19 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:20.786277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-plugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:20.803344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:20.812266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:20.814387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:20.815586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:20.817031 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3e11035-e0cc-457a-b5f4-e651a42bd3fc tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1512 microversion: 2.1 time: 0.875872 Aug 30 18:29:20.819247 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1647/3407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:19 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:20.843248 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] Creating event network-vif-plugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:29:20.872763 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-48483461-888f-49c2-be3a-58273b879b94 req-67492c1e-8003-4b78-a7ff-e63141eae9d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091394 Aug 30 18:29:20.874110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1761/3408] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:21.511154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35012740-0ef0-4613-a997-a8766ea297a1", "name": "network-vif-deleted", "tag": "7a34e91d-0f9c-4daf-af6e-9d54c769c1ca"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:21.536186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.537099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.537810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.553723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] Creating event network-vif-deleted:7a34e91d-0f9c-4daf-af6e-9d54c769c1ca for instance 35012740-0ef0-4613-a997-a8766ea297a1 on n-h2-854119-10 Aug 30 18:29:21.560336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-59c98b5f-a947-4f53-8572-66f1c1b832f2 req-21f6f9eb-af02-4f61-8d8b-f0ef5d1c82a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054787 Aug 30 18:29:21.562320 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1648/3409] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:21.568746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:21.570601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:21.592388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.594485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.602091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.613459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.615816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.616574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.845707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:21.846757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:21.879438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.880203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.889124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.894753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.896358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.897594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.986082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:21.986674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:21.987101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:21.987556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lazy-loading 'fault' on Instance uuid 35012740-0ef0-4613-a997-a8766ea297a1 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:29:22.209512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:22.228657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d2d5f5d-e50d-4431-affa-6b1d965785f0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1363 microversion: 2.1 time: 0.664046 Aug 30 18:29:22.229264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1762/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:21 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1363 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:22.306581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada6c19cda644c79bada4093d45aa7a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be68bfe12584808b60cf5a04b30be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:22.317794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d44247bd-a205-4622-a92f-4356fb747bdd tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 200 len: 1307 microversion: 2.1 time: 0.476849 Aug 30 18:29:22.338248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1649/3411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:21 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:23.253190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:23.259978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:23.287681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:23.291665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=30 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:23.327288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:23.328909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:23.329926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:23.331178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:23.331990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:23.332686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:23.341146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:23.342067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] [instance: 35012740-0ef0-4613-a997-a8766ea297a1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:23.364794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:23.365542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:23.372456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:23.377004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:23.377808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:23.378475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:23.411883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] HTTP exception thrown: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Request method failure captured: Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 HTTP/1.1 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbcUqmhWj9n3_e6Z4OQAHQvOE1bxRWKYRmr_XUrn6fvI7AmNkd1ZiYv_OEobz6wrCjptUfmilZX15DCL-Ft2gqfUGtuIYt0WfxdagWuvNnR987w5CnDTEkN-gce5pt8MueeEc5F0vWsls6lsLs4EFsZUyNuxyit3Nxnfd-AOMHFevg Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 1be68bfe12584808b60cf5a04b30be11 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerAddressesTestJSON-632718449 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be68bfe12584808b60cf5a04b30be11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1be68bfe12584808b60cf5a04b30be11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1be68bfe12584808b60cf5a04b30be11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1be68bfe12584808b60cf5a04b30be11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerAddressesTestJSON-632718449 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 1be68bfe12584808b60cf5a04b30be11 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerAddressesTestJSON-632718449 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerAddressesTestJSON-632718449-project Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ada6c19cda644c79bada4093d45aa7a6 Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerAddressesTestJSON-632718449-project Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '35012740-0ef0-4613-a997-a8766ea297a1'} Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:23.413912 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:23.419210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] Returning 404 to user: Instance 35012740-0ef0-4613-a997-a8766ea297a1 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:23.428046 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-588fb5e8-fb10-4771-94da-967a86c0b8c9 tempest-ServerAddressesTestJSON-632718449 tempest-ServerAddressesTestJSON-632718449-project] 10.222.0.25 "GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1" status: 404 len: 111 microversion: 2.1 time: 0.091906 Aug 30 18:29:23.429506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1650/3412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:23 2022] GET /compute/v2.1/servers/35012740-0ef0-4613-a997-a8766ea297a1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:23.995632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:24.015446 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d61096fd-5915-4146-8002-cf090a3db6b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1550 microversion: 2.1 time: 0.766307 Aug 30 18:29:24.017385 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1763/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:23 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1550 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:24.044277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:24.046730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:24.054277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:24.063404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:24.064092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:24.070010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:24.070762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:24.071365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:24.372909 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f921b3c-0a95-41ee-ac79-42fced70d99a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332472 Aug 30 18:29:24.382511 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1651/3414] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:29:24 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:24.983264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:25.054332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-51039e64-1bcd-4999-9b97-e6ce7a1256f9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e55c858b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-290931362", "description": "tempest-description-428439763"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:25.085908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-412287649", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:25.164814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:26.238478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-51039e64-1bcd-4999-9b97-e6ce7a1256f9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.434740 Aug 30 18:29:26.257938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1764/3415] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:29:24 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:26.282264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-607740814", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5"}], "security_groups": [{"name": "tempest-securitygroup--1307162446"}], "key_name": "tempest-keypair-442899764", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:26.342404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:26.342404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:26.343273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:26.343453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:26.343974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:26.397400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:26.397911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:26.419282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:26.420167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:26.434619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:26.435222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:26.516963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Getting quotas for project 9be812fc90ad4226bb2cca821f8f0f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:26.533418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Getting quotas for user aa46d69577094a5ab9603dd69f1991ec and project 9be812fc90ad4226bb2cca821f8f0f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:26.582870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:29:26.588571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:29:26.685446 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62d954ac-e6cf-4ef9-874c-0ae35a6a0a6d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701240 Aug 30 18:29:26.686880 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1652/3416] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:29:26.697602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0343b66d-cd07-486f-aff0-2686d7c68fc2 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e56617f70>, body: {"security_group_rule": {"parent_group_id": "c1449269-ec82-499a-b613-ef4fa1d8ea7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:27.202410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] validate_networks() for [('5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:27.788882 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0343b66d-cd07-486f-aff0-2686d7c68fc2 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.100481 Aug 30 18:29:27.796197 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1653/3417] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:27.801212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74a2c1e4-96b7-4816-ba74-a58d6eda1d27 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:27.801834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74a2c1e4-96b7-4816-ba74-a58d6eda1d27 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:28.017326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74a2c1e4-96b7-4816-ba74-a58d6eda1d27 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:28.027031 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74a2c1e4-96b7-4816-ba74-a58d6eda1d27 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1221 microversion: 2.1 time: 0.229596 Aug 30 18:29:28.054473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1654/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:27 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:28.065023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72760186-4be8-4ed2-81ef-9b17a2c162e1 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e564b54c0>, body: {"security_group_rule": {"parent_group_id": "c1449269-ec82-499a-b613-ef4fa1d8ea7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:28.228267 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-72760186-4be8-4ed2-81ef-9b17a2c162e1 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72760186-4be8-4ed2-81ef-9b17a2c162e1 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 138 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: {"security_group_rule": {"parent_group_id": "c1449269-ec82-499a-b613-ef4fa1d8ea7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: exception: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c1449269-ec82-499a-b613-ef4fa1d8ea7d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:28.230066 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:28.235024 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:28.235024 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:28.235024 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d Aug 30 18:29:28.235024 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:28.236798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72760186-4be8-4ed2-81ef-9b17a2c162e1 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: This rule already exists in group c1449269-ec82-499a-b613-ef4fa1d8ea7d {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:28.237914 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72760186-4be8-4ed2-81ef-9b17a2c162e1 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.182245 Aug 30 18:29:28.238850 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1655/3419] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:29:28.245248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:28.277876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:28.281600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:28.282543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:28.315410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] Creating event network-changed:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:29:28.340923 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-76450987-9610-43a1-a31b-e33408a11f17 req-e6eb153b-c0be-4a73-8306-d0e6c44cf2c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100549 Aug 30 18:29:28.342021 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1656/3420] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:28.349801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44582c92-e6ec-4c11-a417-165e38b38f41 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e5632f0d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:28.682426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44582c92-e6ec-4c11-a417-165e38b38f41 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/521d39f9-871a-4d3d-876f-653dc3789660" status: 202 len: 0 microversion: 2.1 time: 0.338764 Aug 30 18:29:28.683347 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1657/3421] 10.222.0.25 () {58 vars in 1287 bytes} [Tue Aug 30 18:29:28 2022] DELETE /compute/v2.1/os-security-group-rules/521d39f9-871a-4d3d-876f-653dc3789660 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:28.698720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58800bc1-1690-4fa3-850c-91be035c16b0 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5667b310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-718591353", "description": "tempest-description-468435583"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:29.287480 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58800bc1-1690-4fa3-850c-91be035c16b0 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.592428 Aug 30 18:29:29.288278 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1658/3422] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:29:28 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:29.296365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:29.296365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:29.348678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:29.349348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:29.350191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:29.351240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:29.356939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:29.357527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:29.556428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:29.566580 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fdd04cab-62c9-41a7-819a-25f689f759b4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1273 microversion: 2.1 time: 0.276790 Aug 30 18:29:29.568927 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1659/3423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:29 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:29.595507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b55c89c-627b-42ea-a913-e6a782e4869f tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5632f940>, body: {"security_group_rule": {"parent_group_id": "996ae044-6d0d-46f1-93bc-cc101839f096", "ip_protocol": "tcp", "from_port": 275584991, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:29.834438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-9b55c89c-627b-42ea-a913-e6a782e4869f tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Invalid port range 275584991:22. Former value cannot be greater than the later Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b55c89c-627b-42ea-a913-e6a782e4869f tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 145 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: {"security_group_rule": {"parent_group_id": "996ae044-6d0d-46f1-93bc-cc101839f096", "ip_protocol": "tcp", "from_port": 275584991, "to_port": 22}} Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid port range 275584991:22. Former value cannot be greater than the later Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'security_group_rule': {'parent_group_id': '996ae044-6d0d-46f1-93bc-cc101839f096', 'ip_protocol': 'tcp', 'from_port': 275584991, 'to_port': 22}}} Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 275584991:22. Former value cannot be greater than the later Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 275584991:22. Former value cannot be greater than the later Aug 30 18:29:29.836366 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 275584991:22. Former value cannot be greater than the later Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b55c89c-627b-42ea-a913-e6a782e4869f tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: Invalid port range 275584991:22. Former value cannot be greater than the later {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b55c89c-627b-42ea-a913-e6a782e4869f tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.254320 Aug 30 18:29:29.840814 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1660/3424] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:29 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:29:29.855546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8075869e-214c-4ea9-ae0e-1c898c08b73e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e566f6430>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1380237163", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:29.857934 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8075869e-214c-4ea9-ae0e-1c898c08b73e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Security group id should be uuid Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8075869e-214c-4ea9-ae0e-1c898c08b73e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 131 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1380237163", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group id should be uuid Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1380237163', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:29.863986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:29.868896 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 30 18:29:29.868896 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:29.873112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8075869e-214c-4ea9-ae0e-1c898c08b73e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: Security group id should be uuid {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:29.874473 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8075869e-214c-4ea9-ae0e-1c898c08b73e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.029159 Aug 30 18:29:29.879707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1661/3425] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:29 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:29:29.888758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e588dc0-e1b0-49bc-9fbf-ecb7d8ff2fd6 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5667b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2036258333", "description": "tempest-description-497557548"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:30.426505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e588dc0-e1b0-49bc-9fbf-ecb7d8ff2fd6 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.543197 Aug 30 18:29:30.428292 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1662/3426] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:29:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:30.442122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d42c21dd-1d22-42a9-9421-60923a34f303 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e56656ca0>, body: {"security_group_rule": {"parent_group_id": "cb69fc25-ca34-4ca3-be59-bf6156631df1", "ip_protocol": "tempest-999-1071393817", "from_port": 22, "to_port": 22}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:30.689745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d42c21dd-1d22-42a9-9421-60923a34f303 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Invalid IP protocol tempest-999-1071393817. Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d42c21dd-1d22-42a9-9421-60923a34f303 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 157 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: {"security_group_rule": {"parent_group_id": "cb69fc25-ca34-4ca3-be59-bf6156631df1", "ip_protocol": "tempest-999-1071393817", "from_port": 22, "to_port": 22}} Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid IP protocol tempest-999-1071393817. Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cb69fc25-ca34-4ca3-be59-bf6156631df1', 'ip_protocol': 'tempest-999-1071393817', 'from_port': 22, 'to_port': 22}}} Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1071393817. Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1071393817. Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:30.691336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1071393817. Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d42c21dd-1d22-42a9-9421-60923a34f303 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: Invalid IP protocol tempest-999-1071393817. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d42c21dd-1d22-42a9-9421-60923a34f303 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.254691 Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1663/3427] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:30 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:30.703039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:30.727525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:30.728214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:30.728535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:30.729284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:30.729741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:30.730162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:30.905940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:30.916168 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-22ea5c89-074c-4c62-b963-340d1137f8df tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1279 microversion: 2.1 time: 0.220238 Aug 30 18:29:30.917023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1664/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:30 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:30.936199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4675680-5a86-4786-a0ac-f5c0243f522d tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5632f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1492051922", "description": "tempest-description-1409781932"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:31.374661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:31.375197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:31.375534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:31.375937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:31.376335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:31.401024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:31.404371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:31.405008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:31.406242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:31.411730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:31.412189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:31.439111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:31.445719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:31.477985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:29:31.485621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:29:31.583167 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5bc0d526-ffbe-4cd0-93fd-ddb98619f412 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.321990 Aug 30 18:29:31.584053 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1765/3429] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 5326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:29:31.595541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-964666f8-f9b1-45dd-87c4-b7f61fe56325 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:31.599212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-964666f8-f9b1-45dd-87c4-b7f61fe56325 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:31.763591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-964666f8-f9b1-45dd-87c4-b7f61fe56325 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:31.773988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-964666f8-f9b1-45dd-87c4-b7f61fe56325 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1240 microversion: 2.1 time: 0.182324 Aug 30 18:29:31.779590 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1766/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:31 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:31.937561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:31.938296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:31.948778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:31.954365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:31.955136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:31.956106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:31.956579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:31.957016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:31.972711 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4675680-5a86-4786-a0ac-f5c0243f522d tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.040312 Aug 30 18:29:31.974537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1665/3431] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:29:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:31.988097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3f77c5b-12ae-40a2-a729-fafbe6438c3e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5632a310>, body: {"security_group_rule": {"parent_group_id": "5f680319-efad-40dd-92c6-cb79f4849289", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:32.235312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:32.250316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-484afce2-5cc0-411a-9058-dc33fda2a6bc tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1279 microversion: 2.1 time: 0.316899 Aug 30 18:29:32.269399 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1767/3432] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:31 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:32.798647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:32.799951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:32.817985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:32.818919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:32.820025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:32.821005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:32.821715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:32.822387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:32.831530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d3f77c5b-12ae-40a2-a729-fafbe6438c3e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3f77c5b-12ae-40a2-a729-fafbe6438c3e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 138 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: {"security_group_rule": {"parent_group_id": "5f680319-efad-40dd-92c6-cb79f4849289", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5f680319-efad-40dd-92c6-cb79f4849289', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 18:29:32.833339 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 18:29:32.837869 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:32.842311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3f77c5b-12ae-40a2-a729-fafbe6438c3e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:32.843363 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d3f77c5b-12ae-40a2-a729-fafbe6438c3e tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.860421 Aug 30 18:29:32.844077 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1666/3433] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:31 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 862 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:29:32.857030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3543c212-b4ab-47e0-8554-e9cfaf2a95e4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e5632adc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1592070909", "description": "tempest-description-1309252361"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:33.178387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:33.195474 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1444c9ee-81c4-4b62-8f4e-23d9a1f29639 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1236 microversion: 2.1 time: 0.401592 Aug 30 18:29:33.197184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1768/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:32 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1236 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:33.276143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:33.276719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:33.292350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:33.294151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:33.295046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:33.299391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:33.302000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:33.302205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:33.952352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:33.989309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-85a2a405-9987-4191-bde5-1630ae9aa77c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.717863 Aug 30 18:29:34.001345 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1769/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:33 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:34.027504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3543c212-b4ab-47e0-8554-e9cfaf2a95e4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.175647 Aug 30 18:29:34.028823 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1667/3436] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:29:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:34.043627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a44c716-e730-45da-9920-e9b7d8f023e9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e55c608b0>, body: {"security_group_rule": {"parent_group_id": "a8d51d23-f708-4d25-9321-dc12a8c0399f", "ip_protocol": "tcp", "from_port": 22, "to_port": 120678643}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:34.216880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:34.217758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:34.228722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:34.229226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:34.229788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:34.234848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:34.235375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:34.235828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:34.388981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4a44c716-e730-45da-9920-e9b7d8f023e9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a44c716-e730-45da-9920-e9b7d8f023e9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 145 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: {"security_group_rule": {"parent_group_id": "a8d51d23-f708-4d25-9321-dc12a8c0399f", "ip_protocol": "tcp", "from_port": 22, "to_port": 120678643}} Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a8d51d23-f708-4d25-9321-dc12a8c0399f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 120678643}}} Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 Aug 30 18:29:34.390764 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a44c716-e730-45da-9920-e9b7d8f023e9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 400 to user: Invalid port range 22:120678643. Valid TCP ports should be between 1-65535 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a44c716-e730-45da-9920-e9b7d8f023e9 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.353785 Aug 30 18:29:34.397073 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1770/3437] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:34 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:29:34.403457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Action: 'create', calling method: .version_select at 0x7f4e55cf3f70>, body: {"security_group_rule": {"parent_group_id": "da696545-ee62-4b39-8f31-c18ce445d127", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:34.480116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:34.493624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08b12987-87e4-4655-b331-4ea5c642ddc2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1298 microversion: 2.1 time: 0.280684 Aug 30 18:29:34.495392 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1668/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:34 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:34.743693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG neutronclient.v2_0.client [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist", "detail": ""}} {{(pid=122589) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:29:34.744521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Neutron security group da696545-ee62-4b39-8f31-c18ce445d127 not found {{(pid=122589) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 18:29:34.745620 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.745620 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 138 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: {"security_group_rule": {"parent_group_id": "da696545-ee62-4b39-8f31-c18ce445d127", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: exception: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'da696545-ee62-4b39-8f31-c18ce445d127', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:29:34.749328 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] Aug 30 18:29:34.754309 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.762165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 404 to user: Security group da696545-ee62-4b39-8f31-c18ce445d127 does not exist Aug 30 18:29:34.762165 n-d-854119-10 devstack@n-api.service[122589]: Neutron server returns request_ids: ['req-9423c1b6-081e-44d9-a1e5-a71cefeb7bfc'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:34.762904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f82bcc13-fd62-4d55-8b7d-ceddc04746f8 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.363005 Aug 30 18:29:34.764065 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1771/3439] 10.222.0.25 () {60 vars in 1195 bytes} [Tue Aug 30 18:29:34 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:34.773863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e5632fca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:34.855275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:29:34.857169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.security_group_api [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Neutron security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 not found {{(pid=122590) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 30 18:29:34.859082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] HTTP exception thrown: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.859082 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Request method failure captured: Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-security-group-rules/1cc583c9-dd52-49ba-a432-3da55f580e44 HTTP/1.1 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcElHbosRTKsZ1blxppKjRYqi3DaNtJn7Are0NaKitqwTLqqnrG-pa8gEz-ok1EGiykA-a88PCCZf-CpDb2prspgrnaunSo_r7iuU0cezlwbQP4VwUvvN0B2Cb5EC9c_Xl-6kSq-ywb7_hyEgq-1VcnjvPYtKtyHVPAeZTRF1q3ZbU Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8b70e2bc5114b18a64b4e687014c54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e8b70e2bc5114b18a64b4e687014c54b Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 5217e7b209114d9fb7ed10e44312070e Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: exception: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1cc583c9-dd52-49ba-a432-3da55f580e44'} Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:29:34.873929 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Returning 404 to user: Security group rule 1cc583c9-dd52-49ba-a432-3da55f580e44 does not exist Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: Neutron server returns request_ids: ['req-7918216f-b6ad-49b9-a2da-8fc3a3d0f038'] {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:34.878895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-35e1fa43-3bd4-4817-b1c3-321bd9b75c4a tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/1cc583c9-dd52-49ba-a432-3da55f580e44" status: 404 len: 199 microversion: 2.1 time: 0.105848 Aug 30 18:29:34.883633 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1669/3440] 10.222.0.25 () {58 vars in 1287 bytes} [Tue Aug 30 18:29:34 2022] DELETE /compute/v2.1/os-security-group-rules/1cc583c9-dd52-49ba-a432-3da55f580e44 => generated 199 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:34.890972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a3c0352-4aa4-4b7a-807b-2e4b916200f4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e55c60ee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:35.015236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:35.016221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:35.028104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:35.029017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:35.029529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:35.030735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:35.031386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:35.032423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:35.536993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:35.552663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-79bbaa53-6785-45cb-80c6-0010ac6ebd45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.542352 Aug 30 18:29:35.554548 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1670/3441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:35 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:35.574459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:35.575531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:35.585448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:35.586328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:35.586983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:35.588402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:35.589072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:35.589764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:36.001151 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a3c0352-4aa4-4b7a-807b-2e4b916200f4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a8d51d23-f708-4d25-9321-dc12a8c0399f" status: 202 len: 0 microversion: 2.1 time: 1.116198 Aug 30 18:29:36.003281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1772/3442] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:29:34 2022] DELETE /compute/v2.1/os-security-groups/a8d51d23-f708-4d25-9321-dc12a8c0399f => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:36.012685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b02036b6-064c-49be-8d0b-fd205ac57a18 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e55c0e790>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:36.095534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:36.105002 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1e8594e-5abc-46a9-ab05-ff06d4ee3953 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1298 microversion: 2.1 time: 0.548152 Aug 30 18:29:36.119358 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1671/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:35 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1298 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:36.576570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:36.577317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:36.589209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:36.599585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:36.602673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:36.609183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:36.611002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:36.613449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:36.618821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:36.675570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:36.934005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b02036b6-064c-49be-8d0b-fd205ac57a18 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5f680319-efad-40dd-92c6-cb79f4849289" status: 202 len: 0 microversion: 2.1 time: 0.925678 Aug 30 18:29:36.937949 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1773/3444] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:29:36 2022] DELETE /compute/v2.1/os-security-groups/5f680319-efad-40dd-92c6-cb79f4849289 => generated 0 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:36.943694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3e30d91-bd8a-4f32-a5f7-5c182a8d95ed tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e55e01160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:37.186032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:37.205935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06b00139-d2fa-4ba3-8922-b519a38f9800 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.633396 Aug 30 18:29:37.207093 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1672/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:36 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:37.213414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:37.214555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:37.225303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:37.226532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:37.227392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:37.228299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:37.228919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:37.229542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:37.712048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:37.723844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75234aa2-e0e9-438e-92ee-a12426404ff3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.515338 Aug 30 18:29:37.726088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1673/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:37 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:37.734305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33c396-4802-42b3-81be-fc3ef63e0184", "tag": "10b42862-0e5f-404f-9518-da6935496b3d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:37.760127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:37.764065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:37.764523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:37.791794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] Creating event network-changed:10b42862-0e5f-404f-9518-da6935496b3d for instance 4a33c396-4802-42b3-81be-fc3ef63e0184 on n-h2-854119-10 Aug 30 18:29:37.800274 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ad67991f-f31f-46de-a4ea-6f6ca83eb3dd req-5e039587-4e16-43a2-95ad-150abb8cbad8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070753 Aug 30 18:29:37.800918 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1674/3447] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:38.088286 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3e30d91-bd8a-4f32-a5f7-5c182a8d95ed tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cb69fc25-ca34-4ca3-be59-bf6156631df1" status: 202 len: 0 microversion: 2.1 time: 1.148507 Aug 30 18:29:38.089488 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1774/3448] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:29:36 2022] DELETE /compute/v2.1/os-security-groups/cb69fc25-ca34-4ca3-be59-bf6156631df1 => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:29:38.100460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4dcee366-1e47-44d7-a182-903a4a619cc4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e56408160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:38.114733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=62 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:38.229543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:38.230197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:38.248985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:38.249476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:38.249918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:38.250768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:38.251231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:38.251652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:38.537197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:38.549873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4a38505-8b9f-422f-a6c6-91d61686435b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.326526 Aug 30 18:29:38.554290 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1775/3449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:38 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:38.752323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:38.753235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:38.779554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:38.796964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:38.797419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:38.798185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:38.798679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:38.799108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:39.366132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4dcee366-1e47-44d7-a182-903a4a619cc4 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/996ae044-6d0d-46f1-93bc-cc101839f096" status: 202 len: 0 microversion: 2.1 time: 1.271971 Aug 30 18:29:39.371468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1675/3450] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:29:38 2022] DELETE /compute/v2.1/os-security-groups/996ae044-6d0d-46f1-93bc-cc101839f096 => generated 0 bytes in 1278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:39.531755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:39.567191 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d55ea0de-3dbc-4633-9a7f-fd3d0a33580b tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.819963 Aug 30 18:29:39.567851 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1776/3451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:38 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:39.575948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27970896-b45b-4901-9ccd-520f7e58d3e7 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] Calling method '.version_select at 0x7f4e55c13310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:39.608610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141212f6-b08f-4f37-9f27-d62e6f8245e4", "tag": "e113b0b9-0fd6-4c54-ba85-64a9fd463679"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:39.621865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:39.622649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:39.623150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:39.636932 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] Creating event network-changed:e113b0b9-0fd6-4c54-ba85-64a9fd463679 for instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 on n-h2-854119-10 Aug 30 18:29:39.642891 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-35069586-96ca-4bd6-9a97-9ff536082581 req-058d611d-6be7-4698-9895-7aa6f38b64ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269607 Aug 30 18:29:39.644074 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1676/3452] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:39.657664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:39.658506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:39.667125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:39.667688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:39.668195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:39.668976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:39.670201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:39.670836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:40.414911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:40.426463 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf075d1a-d4fe-4c98-8473-a75a9260194b tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.780883 Aug 30 18:29:40.433737 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1677/3453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:39 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:40.558488 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27970896-b45b-4901-9ccd-520f7e58d3e7 tempest-SecurityGroupRulesNegativeTestJSON-1913963622 tempest-SecurityGroupRulesNegativeTestJSON-1913963622-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c1449269-ec82-499a-b613-ef4fa1d8ea7d" status: 202 len: 0 microversion: 2.1 time: 0.988004 Aug 30 18:29:40.560142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1777/3454] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:29:39 2022] DELETE /compute/v2.1/os-security-groups/c1449269-ec82-499a-b613-ef4fa1d8ea7d => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:29:40.594529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:40.595837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:40.634491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:40.638535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:40.642888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:40.647592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:40.648060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:40.648503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.229004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:41.242328 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae7bf127-46b3-4837-bd48-3aeb91468c49 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.656625 Aug 30 18:29:41.243350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1678/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:40 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:41.455356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:41.455989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:41.472781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:41.477456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.478591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.479037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.483731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:41.484454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:41.487197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:41.774291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:42.040066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:42.050880 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f4722a4-3ab4-41d8-a1f9-047e1138778a tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.599344 Aug 30 18:29:42.052226 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1778/3456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:41 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:42.265778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:42.266404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:42.275204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:42.275708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:42.276119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:42.277930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:42.278697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:42.279107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:42.812549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:42.825840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60c33ee4-6b16-4bee-b51c-52ebeee38a08 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.564829 Aug 30 18:29:42.838381 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1679/3457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:42 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:43.073185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:43.074219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:43.088312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:43.090165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:43.090165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:43.115832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:43.122494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:43.123446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:43.127759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=94 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:43.846387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:43.848463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:43.849697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:43.854764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b79d14f-07c6-499b-ba53-276bf032cc09 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.785614 Aug 30 18:29:43.855375 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1779/3458] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:43 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:43.858222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:43.859357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:43.859992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:43.860990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:43.861617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:43.862205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:44.109761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:44.119537 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-63f17f06-8fd8-4e47-96e4-c5cf41a23ebe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.274714 Aug 30 18:29:44.120361 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1680/3459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:43 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:44.879428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:44.880366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:44.895305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:44.895837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:44.896322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:44.897170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:44.897741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:44.904210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:45.141226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:45.141903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:45.155995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:45.156491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:45.157118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:45.158026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:45.158678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:45.159270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:45.398837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:45.407242 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e8e21ef-407a-4da8-aca1-c6eb85c892f3 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.534803 Aug 30 18:29:45.407848 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1780/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:44 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:45.585875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:45.594647 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dba89d3f-0247-4706-a829-efda85c67ced tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.457234 Aug 30 18:29:45.609274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1681/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:45 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:46.430789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:46.432051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:46.439706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:46.440419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:46.441055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:46.441958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:46.442629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:46.443338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:46.632263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:46.634147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:46.651259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:46.655644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:46.657924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:46.659836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:46.660576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:46.661268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:47.163859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:47.170413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:47.195298 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ea024e5d-0d45-4cc9-8501-0f9b51e572d7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.759699 Aug 30 18:29:47.196066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1781/3462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:46 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:47.196471 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-322ce88c-89ff-4a38-b17c-401e78b65ad0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 0.582107 Aug 30 18:29:47.197430 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1682/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:46 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:47.271159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141212f6-b08f-4f37-9f27-d62e6f8245e4", "name": "network-vif-plugged", "status": "completed", "tag": "e113b0b9-0fd6-4c54-ba85-64a9fd463679"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:47.313983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:47.319257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:47.320055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:47.347992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] Creating event network-vif-plugged:e113b0b9-0fd6-4c54-ba85-64a9fd463679 for instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 on n-h2-854119-10 Aug 30 18:29:47.355306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b1f6fa0d-0e59-48dd-938b-1c6c2c34faac req-8f21191e-bf3d-480b-afd6-a3f78eaa3672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088284 Aug 30 18:29:47.356602 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1782/3464] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:48.225755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:48.233520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:48.236141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:48.239236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:48.264067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:48.266987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:48.269480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:48.270546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:48.271277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:48.273209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:48.274374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:48.275174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:48.275959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:48.277218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:48.277662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:48.279629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:48.281341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:49.058838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:49.073080 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9053e8eb-d23b-478e-8805-55ff787578e2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 0.858230 Aug 30 18:29:49.073999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1683/3465] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:48 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:49.478203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33c396-4802-42b3-81be-fc3ef63e0184", "name": "network-vif-plugged", "status": "completed", "tag": "10b42862-0e5f-404f-9518-da6935496b3d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:49.505005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:49.507099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:49.507630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:49.555423 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] Creating event network-vif-plugged:10b42862-0e5f-404f-9518-da6935496b3d for instance 4a33c396-4802-42b3-81be-fc3ef63e0184 on n-h2-854119-10 Aug 30 18:29:49.572376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-94b347e4-14d2-4e98-b6dd-b12322532d9c req-7199b9c1-fa45-49b4-b116-180a2a9ebc12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100670 Aug 30 18:29:49.576060 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1684/3466] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:49.819310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:49.835609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e731528c-708d-435c-a727-eca32faef75f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1366 microversion: 2.1 time: 1.616450 Aug 30 18:29:49.846897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1783/3467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:48 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1366 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:50.109185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:50.110577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:50.126959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:50.128382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:50.129490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:50.130732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:50.131498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:50.136071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:50.861968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:50.863252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:50.867342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:29:50.889623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:50.891515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:50.892216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:50.893329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:50.894922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:50.896893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:51.245530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:51.279296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cea125a8-0cb3-447b-8a14-6d783da591e4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1555 microversion: 2.1 time: 0.422385 Aug 30 18:29:51.294919 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1784/3468] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:50 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1555 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:51.325250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:51.326133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:51.347926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:51.351558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:51.352380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:51.355141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:51.356282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:51.357601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:51.536226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be0989f6-43e8-4124-991e-f0c9afef2838 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218473 Aug 30 18:29:51.537327 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1785/3469] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:29:51 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:51.673822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:51.696205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33c6a53d-8866-4746-b826-8ffd4d28a6d2 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1321 microversion: 2.1 time: 1.599622 Aug 30 18:29:51.697246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1685/3470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:50 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1321 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:52.719373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:52.720853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:52.734893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.737989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.738840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:52.740290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:52.742649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:52.743348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:53.880263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:53.895639 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90219ccb-63bd-4f9c-b015-ecec91591ba9 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1471 microversion: 2.1 time: 1.179468 Aug 30 18:29:53.897088 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1786/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:52 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1471 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:54.298607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:54.299323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] [instance: 576bfbef-3efa-4832-b16b-078710297e7f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:54.307013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] HTTP exception thrown: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Request method failure captured: Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/576bfbef-3efa-4832-b16b-078710297e7f/action HTTP/1.1 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcEQE2Cm4ZE3HKgWQ9-N_fiFCtXvOdntskQKRBGA0Qi6pVphWiDoTnZFFk5VnB1rtoV-j_8PB6AxxUsOYMXe3FsnYF9SzZ4Z981r8MDQeRpIoey9nPlDlHUSBNEBLDFoZeF3kIwSHlXXo0TQWApOoEpurtDHJNVMbRFNEJEwZXM7zQ Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e33de25163db462b81540704d7730373 Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: {"migrate": {}} Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '576bfbef-3efa-4832-b16b-078710297e7f', 'body': {'migrate': {}}} Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:54.309755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Returning 404 to user: Instance 576bfbef-3efa-4832-b16b-078710297e7f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-493ca404-105e-4c90-b9f1-74c88b841469 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/576bfbef-3efa-4832-b16b-078710297e7f/action" status: 404 len: 111 microversion: 2.1 time: 0.372631 Aug 30 18:29:54.315539 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1686/3472] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:29:53 2022] POST /compute/v2.1/servers/576bfbef-3efa-4832-b16b-078710297e7f/action => generated 111 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:29:54.585926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1407058631", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:54.665157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:29:55.768812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141212f6-b08f-4f37-9f27-d62e6f8245e4", "tag": "e113b0b9-0fd6-4c54-ba85-64a9fd463679"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:55.797020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:55.797510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:55.797952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:55.818941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] Creating event network-changed:e113b0b9-0fd6-4c54-ba85-64a9fd463679 for instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 on n-h2-854119-10 Aug 30 18:29:55.850712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f09528bb-dfc8-43da-ba62-78e7dc274ab7 req-ca9a4154-ecac-4465-99ac-b6bcfcd2b94b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085641 Aug 30 18:29:55.851911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1687/3473] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:29:56.237438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:29:56.238172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:29:56.239409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:29:56.239975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:29:56.250033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:29:56.273426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:56.273689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:56.276848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:56.279863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:56.280559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:56.281492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:56.342431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Getting quotas for project 9be812fc90ad4226bb2cca821f8f0f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:29:56.348942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Getting quotas for user aa46d69577094a5ab9603dd69f1991ec and project 9be812fc90ad4226bb2cca821f8f0f46. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:29:56.380171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:29:56.383902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:29:56.535220 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60aefbc9-8294-4225-b066-cf806c8a1e63 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.953398 Aug 30 18:29:56.543282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1787/3474] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:29:56.550271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c36505e7-2324-4668-988d-72f0f2bf0679 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:56.551045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c36505e7-2324-4668-988d-72f0f2bf0679 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:57.074096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c36505e7-2324-4668-988d-72f0f2bf0679 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:57.088417 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c36505e7-2324-4668-988d-72f0f2bf0679 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1222 microversion: 2.1 time: 0.542472 Aug 30 18:29:57.109634 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1688/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:56 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1222 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:57.287758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Calling method '.version_select at 0x7f4e55cf3e50>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:57.289909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:57.290460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:57.290972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:57.338782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:57.339808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:57.341385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:57.380214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:57.385684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:57.386610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:57.411715 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb23c3bd-7b13-4bd8-a45f-296e24606db8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470 tempest-PortsAdminExtendedAttrsIpV6TestJSON-17880470-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.719625 Aug 30 18:29:57.412536 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1788/3476] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:29:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:29:58.111045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:58.111918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:58.119549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:58.120164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:58.120729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:58.121658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:58.122251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:58.123139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:58.259153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:58.269697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39612baf-e9ed-4f14-9058-8a9fefdd5ad8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1274 microversion: 2.1 time: 0.162827 Aug 30 18:29:58.274006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1689/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:58 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:29:59.297135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:29:59.297947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:29:59.317256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:59.317783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:59.318392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:59.319432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:29:59.319898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:29:59.320497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:29:59.446749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:29:59.474694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c64833d1-d889-494e-ac9c-28b0a49c038f tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1280 microversion: 2.1 time: 0.179774 Aug 30 18:29:59.477170 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1789/3478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:29:59 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:29:59.649001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1534336297", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "1bef2c79-674d-4756-81f8-a9afaf814f43"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:29:59.775455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] validate_networks() for [('1bef2c79-674d-4756-81f8-a9afaf814f43', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:30:00.503587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:00.504334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:00.514005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:00.519460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:00.521339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:00.525717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:00.526673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:00.529671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:00.861080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:00.887984 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23c3b118-f649-44a5-a986-9c137249d5d6 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1280 microversion: 2.1 time: 0.387704 Aug 30 18:30:00.888955 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1790/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:00 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:00.999457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:01.000555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:01.027162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.028184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.034960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:01.036707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.037905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.042982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:01.543713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:01.554376 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-891699d9-46fc-4676-8b9a-cc5352df6b32 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.567973 Aug 30 18:30:01.556816 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1791/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:01.583575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:01.584981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:01.601910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.604643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.607175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:01.609698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:01.611513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:01.613891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.082742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:02.094672 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1ac438d-a0e6-4ef3-8acf-8beed62df439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.521065 Aug 30 18:30:02.110723 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1792/3481] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:01 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:02.118490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:02.121742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:02.129445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.130359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.131567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.132624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.133267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.133859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.240602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:02.254435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90c25f12-b376-4cb8-b2ea-d308c85ad4ba tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1280 microversion: 2.1 time: 0.142224 Aug 30 18:30:02.257405 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1793/3482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:02 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1280 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:02.273794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:02.274444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:02.289233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.289571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.290212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.297486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.298245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.298585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.737013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:02.751520 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68e9ffc6-1183-4071-8480-44f10164334a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.492744 Aug 30 18:30:02.752144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1794/3483] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:02 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:02.780842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1812853556"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:02.789203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:02.808986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.809507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.809948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:02.816604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:02.817285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:02.818642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:03.307811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0ca8158-3c3f-4fc2-a134-004c78577307 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.532922 Aug 30 18:30:03.316588 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1795/3484] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:02 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 18:30:03.328183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:03.333915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:03.354827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:03.355712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:03.356458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:03.358632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:03.359138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:03.359536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:03.413342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:03.559500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:03.577332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d3e3661-8816-46d5-92bf-79c79e024531 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1280 microversion: 2.1 time: 0.259249 Aug 30 18:30:03.578101 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1796/3485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:03 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:03.979246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:30:03.981544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:30:03.983719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:30:03.984585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:30:03.985166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:30:04.014500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.023092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.023805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:04.024657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.025121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.030967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:04.077862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Getting quotas for project 8f0ae0ddbde642ff9a03f9b8449f49ce. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:30:04.092080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Getting quotas for user 6be91534ce524e14bd34ba86a10ec9e2 and project 8f0ae0ddbde642ff9a03f9b8449f49ce. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:30:04.114550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:30:04.123540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:30:04.225160 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1e707762-f563-4165-8878-06ef7f2b05bb tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.694888 Aug 30 18:30:04.227712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1690/3486] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:30:04.240992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e18617f-a954-4dcb-80be-c70fa9e82f61 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:04.242267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e18617f-a954-4dcb-80be-c70fa9e82f61 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:04.455943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e18617f-a954-4dcb-80be-c70fa9e82f61 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:04.469608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e18617f-a954-4dcb-80be-c70fa9e82f61 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1225 microversion: 2.1 time: 0.234333 Aug 30 18:30:04.478385 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1797/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:04 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:04.620517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:04.622139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:04.663907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.666115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.667552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:04.671139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:04.673742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:04.675060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:05.495366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:05.497296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:05.506749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:05.508346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:05.511108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:05.512537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:05.513202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:05.515776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:05.659407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:05.676115 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6a20bf34-c9b3-45da-b5e2-dc6e6942c56a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1221 microversion: 2.1 time: 0.184874 Aug 30 18:30:05.676727 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1798/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:05 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:05.946604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:05.983873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f4616279-5b9f-4777-b350-eb8259631a08 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.380577 Aug 30 18:30:05.999005 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1691/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:04 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:06.709729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:06.711137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:06.714663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:06.720564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:06.721433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:06.722140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:06.723182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:06.723944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:06.724598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:06.846519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:06.895577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ef995e3-3360-45b3-aaed-f1002dfc3d8b tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1283 microversion: 2.1 time: 0.188105 Aug 30 18:30:06.899178 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1799/3490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:06 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:07.032106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:07.045123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:07.062763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:07.063671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:07.066474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:07.067967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:07.068657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:07.069315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:07.078036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=82 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:07.952923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:07.955056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:07.993234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:07.995343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:08.000143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:08.004559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:08.007055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:08.012189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:08.323538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:08.333606 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ffef3ca9-c7d6-4dcd-9e66-ef3a1241ff87 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.315936 Aug 30 18:30:08.335245 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1692/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:07 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:08.636869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:08.705977 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a53bef71-da2d-4d8b-b4fd-5b3dfd9b9cf0 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1283 microversion: 2.1 time: 0.771741 Aug 30 18:30:08.707206 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1800/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:07 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1283 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:09.335759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-plugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:09.369622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:09.373786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.373950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:09.374701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.384052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.410256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] Creating event network-vif-plugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:30:09.424677 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b59bf6d5-6168-405c-82ec-042b022033eb req-ec35b19c-f7dd-4e9b-bbb0-a9f8530bb8a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271919 Aug 30 18:30:09.428458 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1693/3493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:09.431793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.432992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.433712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.440363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.441221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.451488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.733511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:09.734230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:09.754818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.756190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.756631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:09.757551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:09.758026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:09.758481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:10.044400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:10.059591 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5fc5289c-1401-4d8e-8991-a59665b5723e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1283 microversion: 2.1 time: 0.329552 Aug 30 18:30:10.061650 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1694/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:09 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1283 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:10.066996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e55858-031c-4bbc-90ec-c2d125a79f4f", "tag": "1304d689-c3ab-4ea5-93d7-22e0e1605817"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:10.078281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:10.079215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:10.079860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:10.131097 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] Creating event network-changed:1304d689-c3ab-4ea5-93d7-22e0e1605817 for instance e8e55858-031c-4bbc-90ec-c2d125a79f4f on n-h1-854119-10 Aug 30 18:30:10.146864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cd8f192a-e337-4fa4-8372-f341b4db7d68 req-83e95312-dd23-4e38-9239-958dbf956158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081956 Aug 30 18:30:10.148480 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1695/3495] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:10.717202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:10.728657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb5d7dfd-5097-4f58-8b89-d7c108272be4 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.375947 Aug 30 18:30:10.733254 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1801/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:09 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:11.086600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:11.087441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:11.136327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.144458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.145742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:11.153578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.158554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.161092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:11.543928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:11.557651 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-066fd558-475b-4070-b3fd-3e99b5385342 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1283 microversion: 2.1 time: 0.478282 Aug 30 18:30:11.558995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1696/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:11 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1283 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:11.785928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:11.787267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:11.806925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.825233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.825871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:11.826828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:11.835784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:11.836356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:12.589350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:12.589961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:12.621538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:12.622553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:12.634912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:12.635960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:12.636458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:12.647274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:13.210633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:13.222312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d664ec76-fee2-4af9-848a-452e7e37be0d tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.441009 Aug 30 18:30:13.225336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1802/3498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:11 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:14.056852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:14.105333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:14.249987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:14.250810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:14.314972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:14.317113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:14.317635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:14.319215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:14.319696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:14.320136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:14.466043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:14.522306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:14.534828 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4745031d-9711-4bef-9773-383002a886ec tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 1.949306 Aug 30 18:30:14.535663 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1697/3499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:12 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:15.572206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:15.573265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:15.600987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:15.601539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:15.608048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:15.614392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:15.615118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:15.615854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:15.837362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:15.847081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c448b055-60a1-4f08-b90f-5d0761f6e125 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.604338 Aug 30 18:30:15.848839 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1803/3500] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:14 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:16.557521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:16.577948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06e0f4f8-625b-4232-b00a-0f05f5d0053e tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 1.011784 Aug 30 18:30:16.599255 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1698/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:15 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:16.761619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e55858-031c-4bbc-90ec-c2d125a79f4f", "name": "network-vif-plugged", "status": "completed", "tag": "1304d689-c3ab-4ea5-93d7-22e0e1605817"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:16.787926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:16.788414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:16.792166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:16.842121 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] Creating event network-vif-plugged:1304d689-c3ab-4ea5-93d7-22e0e1605817 for instance e8e55858-031c-4bbc-90ec-c2d125a79f4f on n-h1-854119-10 Aug 30 18:30:16.857461 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-45c46858-2496-41ce-9f78-3689e89cd83e req-486c4541-6794-48dd-aae8-af94f3376b57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100377 Aug 30 18:30:16.859655 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1804/3502] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:16.875899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:16.877068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:16.920983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:16.925479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:16.926178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:16.928160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:16.929990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:16.930613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:17.604915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:17.612193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:17.627784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:17.628506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:17.631513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:17.633858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:17.634537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:17.635644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:18.115058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:18.154953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3cde29e-5c49-43eb-8fc9-32a0cedcbb09 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.552229 Aug 30 18:30:18.158101 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1805/3503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:17 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:18.804602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:18.828657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed0a6b48-481f-47ea-8c27-b80b8b028ac7 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1322 microversion: 2.1 time: 1.955264 Aug 30 18:30:18.830964 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1699/3504] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:16 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1322 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:19.179643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:19.190051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:19.216738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.217757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.219005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:19.220077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.225423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.227091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:19.259575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1430a9-5e97-44ff-a317-a8a7e9a7dde3", "tag": "6d280c50-a5bc-46e6-9157-f4a0c609dbdb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:19.283970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:19.302239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.311056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.312666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:19.377974 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] Creating event network-changed:6d280c50-a5bc-46e6-9157-f4a0c609dbdb for instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 on n-h1-854119-10 Aug 30 18:30:19.390436 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-823678ba-9a8a-4087-bf36-0ed2318eb6fc req-058cfbe2-2933-4f03-b77e-d8bc2df3e758 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136878 Aug 30 18:30:19.395903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1700/3505] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:19.612712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:19.626605 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0f490fc-ce29-4cce-95ec-434eb62a9924 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.448241 Aug 30 18:30:19.628162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1806/3506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:19 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:19.853456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:19.854724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:19.881257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.882116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.882859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:19.884014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:19.884682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:19.885318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.652391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:20.652994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:20.664223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:20.664712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:20.665150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.671092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:20.671825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:20.672117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.722917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:20.741820 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a41f79a0-1435-4cc6-9a49-129940210503 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1472 microversion: 2.1 time: 0.893690 Aug 30 18:30:20.743022 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1701/3507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:19 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1472 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:20.780044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:20.781798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:20.808307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:20.817046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:20.819101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.821917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:20.825826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:20.827149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:20.920606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lazy-loading 'flavor' on Instance uuid e8e55858-031c-4bbc-90ec-c2d125a79f4f {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:30:21.166834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17a52fad-3b55-47ab-b8a6-1e8b745cc81c tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f/action" status: 202 len: 0 microversion: 2.1 time: 0.400428 Aug 30 18:30:21.170853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1702/3508] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:20 2022] POST /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:30:21.189550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:21.191596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:21.226820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:21.230399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:21.232080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:21.236641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:21.237848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:21.241140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:21.493445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:21.511163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e160c546-a92c-4e17-b6e2-31e0a3b5d816 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.864119 Aug 30 18:30:21.512127 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1807/3509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:20 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:22.533554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:22.534986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:22.545164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:22.553456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:22.561656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:22.562363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:22.563341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:22.564017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:22.564674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:22.885123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed02ff31-d92f-499e-9839-a8ed7f349108 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1633 microversion: 2.1 time: 1.702446 Aug 30 18:30:22.900210 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1703/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:21 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1633 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:23.191569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:23.201185 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb890d8d-1068-4eda-8b03-076ef2070bb4 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.671828 Aug 30 18:30:23.201779 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1808/3511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:22 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:23.794748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4641f3fd-719b-4975-83f3-8414364017b4 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Action: 'create', calling method: .version_select at 0x7f4e5632a8b0>, body: {"keypair": {"name": "tempest-keypair-1940836959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnOlNijEcns/HL3Q6J2bSJoe0lc8zbxYyEAEHsK/hiGZeJojQvBt5pKKHvhtWjRUwcND6DwDfh5hr6efaDc/yWYPE2YZnT58lhR/PSKqCdFG9WvCMvFdz/docAsMz3X3Q=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:23.834045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4641f3fd-719b-4975-83f3-8414364017b4 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Getting quotas for project 260af50a1c7a4c5bab598d73a3426bc6. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:30:23.854754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4641f3fd-719b-4975-83f3-8414364017b4 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Getting quotas for user 6ce299c347cc4fc49c3b0cc55ba30637 and project 260af50a1c7a4c5bab598d73a3426bc6. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:30:23.917507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:23.919410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:23.923410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4641f3fd-719b-4975-83f3-8414364017b4 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.346677 Aug 30 18:30:23.926004 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1704/3512] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:30:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:23.934963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:23.936153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:23.937758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:23.948033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:23.948726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:23.950086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:24.228848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:24.229716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:24.248021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:24.248770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:24.249421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:24.250858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:24.252027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:24.252887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:24.694410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:24.706237 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8209c4d-9c87-4a54-ad11-963210767908 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.484947 Aug 30 18:30:24.709227 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1705/3513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:24 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:25.375404 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b2b385b-3a71-4e2c-b471-957df884ce64 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1616 microversion: 2.1 time: 1.462338 Aug 30 18:30:25.376556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1809/3514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:23 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1616 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:25.400440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:25.401021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:25.414383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.414893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.415325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.418390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.425024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.425680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.512331 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] HTTP exception thrown: Cannot 'migrate' instance e8e55858-031c-4bbc-90ec-c2d125a79f4f while it is in vm_state suspended Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Request method failure captured: Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f/action HTTP/1.1 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcEQE2Cm4ZE3HKgWQ9-N_fiFCtXvOdntskQKRBGA0Qi6pVphWiDoTnZFFk5VnB1rtoV-j_8PB6AxxUsOYMXe3FsnYF9SzZ4Z981r8MDQeRpIoey9nPlDlHUSBNEBLDFoZeF3kIwSHlXXo0TQWApOoEpurtDHJNVMbRFNEJEwZXM7zQ Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e33de25163db462b81540704d7730373 Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: {"migrate": {}} Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'migrate' instance e8e55858-031c-4bbc-90ec-c2d125a79f4f while it is in vm_state suspended Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e8e55858-031c-4bbc-90ec-c2d125a79f4f', 'body': {'migrate': {}}} Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f in vm_state suspended. Cannot resize while the instance is in this state. Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:25.515230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e8e55858-031c-4bbc-90ec-c2d125a79f4f while it is in vm_state suspended Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e8e55858-031c-4bbc-90ec-c2d125a79f4f while it is in vm_state suspended Aug 30 18:30:25.519265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.523387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Returning 409 to user: Cannot 'migrate' instance e8e55858-031c-4bbc-90ec-c2d125a79f4f while it is in vm_state suspended {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:25.529089 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7cb728b5-d9b2-4189-a016-a11b232d119b tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f/action" status: 409 len: 148 microversion: 2.1 time: 0.129163 Aug 30 18:30:25.530218 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1706/3515] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:25 2022] POST /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:30:25.541748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e73d3096-38ef-45fc-aa3d-7f4ebc9506f6 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e73d3096-38ef-45fc-aa3d-7f4ebc9506f6 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Request method failure captured: Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action HTTP/1.1 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 39 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlcEQE2Cm4ZE3HKgWQ9-N_fiFCtXvOdntskQKRBGA0Qi6pVphWiDoTnZFFk5VnB1rtoV-j_8PB6AxxUsOYMXe3FsnYF9SzZ4Z981r8MDQeRpIoey9nPlDlHUSBNEBLDFoZeF3kIwSHlXXo0TQWApOoEpurtDHJNVMbRFNEJEwZXM7zQ Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e33de25163db462b81540704d7730373 Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: {"os-resetState": {"state": "invalid"}} Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4a33c396-4802-42b3-81be-fc3ef63e0184', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:30:25.545855 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 18:30:25.549234 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.551985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e73d3096-38ef-45fc-aa3d-7f4ebc9506f6 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:25.557706 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e73d3096-38ef-45fc-aa3d-7f4ebc9506f6 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action" status: 400 len: 144 microversion: 2.1 time: 0.019664 Aug 30 18:30:25.561539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1810/3516] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:25 2022] POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:30:25.571985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05edb042-448c-4b03-b659-ee2e331cf674 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05edb042-448c-4b03-b659-ee2e331cf674 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Request method failure captured: Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action HTTP/1.1 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 31 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcEQE2Cm4ZE3HKgWQ9-N_fiFCtXvOdntskQKRBGA0Qi6pVphWiDoTnZFFk5VnB1rtoV-j_8PB6AxxUsOYMXe3FsnYF9SzZ4Z981r8MDQeRpIoey9nPlDlHUSBNEBLDFoZeF3kIwSHlXXo0TQWApOoEpurtDHJNVMbRFNEJEwZXM7zQ Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e33de25163db462b81540704d7730373 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: {"os-resetState": {"state": 1}} Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '4a33c396-4802-42b3-81be-fc3ef63e0184', 'body': {'os-resetState': {'state': 1}}} Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 1 Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 18:30:25.576953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 18:30:25.580825 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.600670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05edb042-448c-4b03-b659-ee2e331cf674 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:25.602329 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05edb042-448c-4b03-b659-ee2e331cf674 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action" status: 400 len: 120 microversion: 2.1 time: 0.035426 Aug 30 18:30:25.603531 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1707/3517] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:25 2022] POST /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184/action => generated 120 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:30:25.613144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:25.615751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Failed to fetch instance by id 999 {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:30:25.616517 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Request method failure captured: Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 37 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlcEQE2Cm4ZE3HKgWQ9-N_fiFCtXvOdntskQKRBGA0Qi6pVphWiDoTnZFFk5VnB1rtoV-j_8PB6AxxUsOYMXe3FsnYF9SzZ4Z981r8MDQeRpIoey9nPlDlHUSBNEBLDFoZeF3kIwSHlXXo0TQWApOoEpurtDHJNVMbRFNEJEwZXM7zQ Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e02f1d3dc5d45bd8fe5760bd0f37298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 7e02f1d3dc5d45bd8fe5760bd0f37298 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1648572699 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e33de25163db462b81540704d7730373 Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1648572699-project-admin Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: {"os-resetState": {"state": "error"}} Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 999 could not be found. Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:25.623514 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:25.630926 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:25.630926 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 18:30:25.630926 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:25.634166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:25.637280 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20c08911-74cc-4f95-85c1-a5f6b7da0242 tempest-ServersAdminNegativeTestJSON-1648572699 tempest-ServersAdminNegativeTestJSON-1648572699-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.028255 Aug 30 18:30:25.639488 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1811/3518] 10.222.0.25 () {60 vars in 1179 bytes} [Tue Aug 30 18:30:25 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:30:25.650592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:25.651480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:25.679029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.680910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.682829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.684801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.685949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.690141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.740527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:25.741784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:25.765887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.768375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.775052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.776049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:25.776662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:25.777997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:25.789997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:25.985649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e980450-3f69-45a7-9d76-161f76cbbcaa tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 204 len: 0 microversion: 2.1 time: 0.335188 Aug 30 18:30:25.987162 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1708/3519] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:25 2022] DELETE /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:30:26.000990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:26.004444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:26.015289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:26.017482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:26.019092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:26.021244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:26.025540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:26.027014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:26.476103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:26.487016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:26.498230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ddfe4904-f2dd-4cd8-bdc5-6c3f9af20ff8 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1469 microversion: 2.1 time: 0.504584 Aug 30 18:30:26.499095 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1709/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:25 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:26.604970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:26.615786 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d2c66939-59b2-4d7c-a28f-20a78fda0733 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.887842 Aug 30 18:30:26.623568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1812/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:25 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:26.917556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1430a9-5e97-44ff-a317-a8a7e9a7dde3", "name": "network-vif-plugged", "status": "completed", "tag": "6d280c50-a5bc-46e6-9157-f4a0c609dbdb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:26.946670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:26.947159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:26.947596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:26.993595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] Creating event network-vif-plugged:6d280c50-a5bc-46e6-9157-f4a0c609dbdb for instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 on n-h1-854119-10 Aug 30 18:30:27.009701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-60bcb763-4f61-4690-832b-070a86ee734a req-c766e69d-83f1-4b7e-a506-040f681018b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096254 Aug 30 18:30:27.013533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1710/3522] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:27.521151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:27.522072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:27.541227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.554771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.559839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.566487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.572276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.577308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.646160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:27.647981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:27.685890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.686718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.692364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:27.694960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:27.695459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:27.695909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:28.496115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:28.504758 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95680c35-0fcf-41c7-b989-a274489ddf79 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.864370 Aug 30 18:30:28.515656 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1711/3523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:27 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:29.527702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:29.529233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:29.553563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:29.559237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:29.560027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:29.560994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:29.563667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:29.565834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:29.851140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:29.862041 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-816ed65c-75d0-425f-9acf-74c9896deb4c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1469 microversion: 2.1 time: 2.345997 Aug 30 18:30:29.864927 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1813/3524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:27 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1469 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:29.875208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:29.877299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:29.892986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:29.897703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:29.898861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:29.900390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:29.901091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:29.901810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:29.981166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5702430b-3de4-4de3-b38b-64b0668db906 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/ips" status: 200 len: 148 microversion: 2.1 time: 0.105421 Aug 30 18:30:29.983240 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1814/3525] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:30:29 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/ips => generated 148 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:30.003084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34566b41-45eb-4629-9bea-f78ca4a8ae1f"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:30.011334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:30.032653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.035229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.041806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.043506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.046517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.047246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.240669 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/os-volume_attachments HTTP/1.1 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 74 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: {"volumeAttachment": {"volumeId": "34566b41-45eb-4629-9bea-f78ca4a8ae1f"}} Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '141212f6-b08f-4f37-9f27-d62e6f8245e4', 'body': {'volumeAttachment': {'volumeId': '34566b41-45eb-4629-9bea-f78ca4a8ae1f'}}} Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:30:30.255561 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f Aug 30 18:30:30.260050 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:30.261799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 400 to user: Invalid volume: volume 34566b41-45eb-4629-9bea-f78ca4a8ae1f is already attached to instances: 23458d56-3de6-4429-91bd-9d46736b5a3f {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:30.263012 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c4fedbc-baf8-4431-a9db-baaf2e6e191c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.272307 Aug 30 18:30:30.263833 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1815/3526] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:30:29 2022] POST /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4/os-volume_attachments => generated 174 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:30:30.275518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:30.276691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:30.292477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.295083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.297515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.300761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.306413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.307032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.373783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:30.381462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:30.405968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:30.425174 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cda5867e-79f9-4392-8196-833a419dc491 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1325 microversion: 2.1 time: 0.902315 Aug 30 18:30:30.430657 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1712/3527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:29 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1325 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:30.568677 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57b9930b-2c7a-49db-92d8-4dedf80cc83e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 204 len: 0 microversion: 2.1 time: 0.297911 Aug 30 18:30:30.574292 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1816/3528] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:30 2022] DELETE /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:30:30.580091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:30.587756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:30.608187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.610998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.612179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.613172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.614001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.614738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.623169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e55858-031c-4bbc-90ec-c2d125a79f4f", "name": "network-vif-unplugged", "status": "completed", "tag": "1304d689-c3ab-4ea5-93d7-22e0e1605817"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:30.664504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.665153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.665606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.699870 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] Creating event network-vif-unplugged:1304d689-c3ab-4ea5-93d7-22e0e1605817 for instance e8e55858-031c-4bbc-90ec-c2d125a79f4f on n-h1-854119-10 Aug 30 18:30:30.717025 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ec67c064-6c83-4c78-8621-4530d6e544bf req-744c5926-54c2-48ca-99cc-436b97a8a636 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097006 Aug 30 18:30:30.717025 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1817/3529] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:30.886869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:30.887580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:30.906519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.907352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.908670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:30.908670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:30.908953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:30.909544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:31.079869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:31.111481 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f6b8449-d813-4540-acbd-a4b66d2cf977 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 200 len: 1427 microversion: 2.1 time: 0.224900 Aug 30 18:30:31.114124 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1818/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:30 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 1427 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:31.172119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "587fc386-cb82-4d1a-a7d6-d68b35cf29e1"}], "security_groups": [{"name": "tempest-securitygroup--671864942"}], "key_name": "tempest-keypair-1940836959", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:31.632212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:31.671565 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bce1b064-9757-4abb-b8ef-b785a6505b41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1679 microversion: 2.1 time: 1.070978 Aug 30 18:30:31.672301 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1713/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:30 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1679 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:31.689935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:31.693109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:31.705241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] validate_networks() for [('587fc386-cb82-4d1a-a7d6-d68b35cf29e1', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:30:31.728233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:31.729463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:31.735220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:31.736404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:31.738702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:31.743216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.523425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:32.544804 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31b5a6a0-5dcf-4d06-8b9b-d18e689cef69 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1522 microversion: 2.1 time: 0.868709 Aug 30 18:30:32.548736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1714/3532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:31 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1522 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:32.589063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e55858-031c-4bbc-90ec-c2d125a79f4f", "name": "network-vif-deleted", "tag": "1304d689-c3ab-4ea5-93d7-22e0e1605817"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:32.616626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.618798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.621153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.680003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] Creating event network-vif-deleted:1304d689-c3ab-4ea5-93d7-22e0e1605817 for instance e8e55858-031c-4bbc-90ec-c2d125a79f4f on n-h1-854119-10 Aug 30 18:30:32.694395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c0e58b2f-d99b-4b54-8f3a-ec0f414bfdfe req-7f281dd9-f465-46a6-966d-55298e7fe8e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143897 Aug 30 18:30:32.699908 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1715/3533] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:32.710254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:32.715184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: e8e55858-031c-4bbc-90ec-c2d125a79f4f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:32.736277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.736784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.737303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.737945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.738423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.743198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.774195 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] HTTP exception thrown: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Request method failure captured: Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f HTTP/1.1 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcCip9wV43dEZSV4YWpOO4edQv5ptOIh372aTUbTZteFK_3YEi3hyUnlP3R1z6es9c3PrncbHVlWVNIU1YoC26bU3rmXGTnJL4W8WrFCmuB4Wy5Eb4OSa5ZtBW4G5E4Gh8RKtbmLopNkxiAemOGzfi9b-9QsKGFYMItUZgobGemG2U Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9be812fc90ad4226bb2cca821f8f0f46 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9be812fc90ad4226bb2cca821f8f0f46 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-184604261-project Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: aa46d69577094a5ab9603dd69f1991ec Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-184604261-project Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e8e55858-031c-4bbc-90ec-c2d125a79f4f'} Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.783126 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Returning 404 to user: Instance e8e55858-031c-4bbc-90ec-c2d125a79f4f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:32.787022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44a87b07-09a7-48e8-8607-43787c615073 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f" status: 404 len: 111 microversion: 2.1 time: 0.082621 Aug 30 18:30:32.788765 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1716/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:32 2022] GET /compute/v2.1/servers/e8e55858-031c-4bbc-90ec-c2d125a79f4f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:32.801529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:32.807688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:32.820769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.821628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.822306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.823640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.824523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.825178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.862694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] HTTP exception thrown: Instance is not a member of specified network Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Request method failure captured: Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3/ips/invalid HTTP/1.1 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcnjrYBJI_VqUCg9lvFIgK4nNfplawMIXbzNMC9FQHO6P5UDUTXnkzYdlLmKxVvQksLU2_eHxyuEjWuFSQyd6YKmrWgP05KAGv9Av7GAi89Inn4LkFRpZHgcUygWENJIjOLzlhuQe5pgPRITDcSorZCctBMmthANdbTBDVd0VmRSEk Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6be91534ce524e14bd34ba86a10ec9e2 Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance is not a member of specified network Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': '3c1430a9-5e97-44ff-a317-a8a7e9a7dde3', 'id': 'invalid'} Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 30 18:30:32.891075 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:32.893952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:32.893952 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ad456e6-af31-4f27-b356-31eb378b3c5f tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.101679 Aug 30 18:30:32.893952 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1717/3535] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:30:32 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3/ips/invalid => generated 91 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:30:32.902085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:32.903157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:32.911872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.913670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.914627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:32.915870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:32.916627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:32.926980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.265330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:33.285456 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-092cbdbd-fa03-4454-9c30-606430ef0575 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1679 microversion: 2.1 time: 0.383725 Aug 30 18:30:33.305403 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1718/3536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:32 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1679 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:33.324572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:33.328002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:33.348335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.352122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.352867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.356719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.364072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.364924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.434293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:33.669022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e93f5c8e-c83f-40b5-91fa-ea9ae118151c tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 204 len: 0 microversion: 2.1 time: 0.361689 Aug 30 18:30:33.670072 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1719/3537] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:33 2022] DELETE /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:30:33.676684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:33.682402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Failed to fetch instance by id 999 {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:30:33.687431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] HTTP exception thrown: Instance 999 could not be found. Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Request method failure captured: Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcnjrYBJI_VqUCg9lvFIgK4nNfplawMIXbzNMC9FQHO6P5UDUTXnkzYdlLmKxVvQksLU2_eHxyuEjWuFSQyd6YKmrWgP05KAGv9Av7GAi89Inn4LkFRpZHgcUygWENJIjOLzlhuQe5pgPRITDcSorZCctBMmthANdbTBDVd0VmRSEk Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6be91534ce524e14bd34ba86a10ec9e2 Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 999 could not be found. Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': '999'} Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 18:30:33.697096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:33.701785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:33.703049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-afd4bf02-628b-4a4d-a888-5392d383cdf6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.031634 Aug 30 18:30:33.706101 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1720/3538] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:30:33 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:30:33.716302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:33.724729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:33.741288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.741786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.742220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.745539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:33.746246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:33.748185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:33.886473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:34.602058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:34.620438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95324249-c85f-4abf-9116-40e0be4df332 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1477 microversion: 2.1 time: 0.911685 Aug 30 18:30:34.621732 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1721/3539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:33 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1477 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:34.638582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:34.639278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:34.652421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.653191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.653790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:34.654957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.655572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.656274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:34.696152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:34.897236 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6841b43f-c1ff-4ea0-9fb7-b0f553d536c6 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 204 len: 0 microversion: 2.1 time: 0.268740 Aug 30 18:30:34.906488 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1722/3540] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:34 2022] DELETE /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:30:34.915887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:34.916767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:34.925738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.926578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.927170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:34.930408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:34.931116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:34.931905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.490188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:30:35.496587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:30:35.497708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:30:35.498385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:30:35.499010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:30:35.528057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:35.545557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.546279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.547752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.548774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.550329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.550990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.560096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f17ffe27-1401-4f93-bf27-ca59ab454100 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1679 microversion: 2.1 time: 0.643207 Aug 30 18:30:35.571953 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1723/3541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:34 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1679 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:35.595546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:35.598003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Getting quotas for project 260af50a1c7a4c5bab598d73a3426bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:30:35.598706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:35.619234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Getting quotas for user 6ce299c347cc4fc49c3b0cc55ba30637 and project 260af50a1c7a4c5bab598d73a3426bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:30:35.622234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.628456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.628955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.634256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.635187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.635919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.649586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:30:35.652675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:30:35.739823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55a00fe3-fa47-43ae-af66-52e462b8f829 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.572617 Aug 30 18:30:35.741255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1819/3542] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:30:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 4575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:30:35.755020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:35.756073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:35.776090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.779882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.790130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:35.791243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:35.792959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:35.793716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.690700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:36.705197 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe14f1e7-f1db-4843-95c5-bc4af431443a tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1528 microversion: 2.1 time: 1.129258 Aug 30 18:30:36.706082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1724/3543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:35 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1528 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:36.736547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:36.745227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:36.765119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.766176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.766854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.767804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.768463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.769091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.806171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:36.837059 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c02c76f-187d-49fd-bb26-187f3af594e2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.092536 Aug 30 18:30:36.840678 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1820/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:35 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:36.864845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:36.884767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:36.908496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.909492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.910498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:36.911759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:36.912901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:36.913707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:37.097787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:37.116577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b752fa3-b847-4580-939a-0c11ebe75952 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1230 microversion: 2.1 time: 0.273366 Aug 30 18:30:37.118241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1821/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:36 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1230 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:37.130081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:37.133075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:37.167527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:37.168700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:37.169283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:37.173491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:37.174930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:37.176323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.143260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:38.177997 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-177f080b-e409-4c1c-a562-d2fa7fdd8a9c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1611 microversion: 2.1 time: 1.057592 Aug 30 18:30:38.217454 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1822/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:37 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1611 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:38.224360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1683605607"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:38.228895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:38.250179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.255355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.256260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.257688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.258463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.261835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.313683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:38.330858 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b50f5fc4-d015-4f01-a71d-163f72125d70 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1477 microversion: 2.1 time: 1.608418 Aug 30 18:30:38.355667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1725/3547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:36 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1477 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:38.379019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33c396-4802-42b3-81be-fc3ef63e0184", "name": "network-vif-unplugged", "status": "completed", "tag": "10b42862-0e5f-404f-9518-da6935496b3d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:38.439298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.443249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.444146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.486740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] Creating event network-vif-unplugged:10b42862-0e5f-404f-9518-da6935496b3d for instance 4a33c396-4802-42b3-81be-fc3ef63e0184 on n-h2-854119-10 Aug 30 18:30:38.511590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5560990d-da86-4bf7-aa9c-05fab628be08 req-923a617f-e9c2-4bc1-b325-fb69ab73c5e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154277 Aug 30 18:30:38.524232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1726/3548] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:38.530263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:38.555391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:38.584298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.584792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.585742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.585958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.586677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.587118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:38.691538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:38.908492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2cedde40-7ee2-44b1-90e2-13f6cf752daa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.670993 Aug 30 18:30:38.914400 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1823/3549] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:30:38 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 18:30:38.952554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:38.957770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:38.982391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:38.988491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:38.998007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.001197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.001197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.001197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.267080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:39.284404 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1f22da61-a97f-412b-bc8c-6c822fba0ae5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1284 microversion: 2.1 time: 0.369889 Aug 30 18:30:39.285187 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1824/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:38 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:39.301623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141212f6-b08f-4f37-9f27-d62e6f8245e4", "name": "network-vif-deleted", "tag": "e113b0b9-0fd6-4c54-ba85-64a9fd463679"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:39.328235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.329085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.329804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.360653 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] Creating event network-vif-deleted:e113b0b9-0fd6-4c54-ba85-64a9fd463679 for instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 on n-h2-854119-10 Aug 30 18:30:39.394907 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-85ab8f5a-b6ba-49a4-87b7-aea990b6cd03 req-b040cdbd-2a59-4dd3-91cf-5dc7bd238977 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107380 Aug 30 18:30:39.399149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1825/3551] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:39.423813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:39.431370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:39.465813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.466662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.467281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.468177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.468799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.469386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.558566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.559745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.560357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.561147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'fault' on Instance uuid 141212f6-b08f-4f37-9f27-d62e6f8245e4 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:30:39.759048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:39.769710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6cdc4543-b48e-4bef-a57d-4ed6ef7d86a4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 200 len: 1330 microversion: 2.1 time: 0.366832 Aug 30 18:30:39.771089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1826/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:39 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 1330 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:39.780979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:39.781781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:39.791595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.794018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.794675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.795420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:39.795883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:39.796565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:39.934083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:40.000049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a891499-c58d-4801-b26a-bcb9733ac619 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1528 microversion: 2.1 time: 1.468035 Aug 30 18:30:40.001246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1727/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:38 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1528 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:40.011721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33c396-4802-42b3-81be-fc3ef63e0184", "name": "network-vif-deleted", "tag": "10b42862-0e5f-404f-9518-da6935496b3d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:40.041100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa46d69577094a5ab9603dd69f1991ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be812fc90ad4226bb2cca821f8f0f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:40.046082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.048355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.048721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.063137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36a266f5-a6d8-43b9-aefd-e6d2d26b8b64 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 200 len: 1435 microversion: 2.1 time: 0.289251 Aug 30 18:30:40.066538 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1827/3554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:39 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 1435 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:40.105913 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] Creating event network-vif-deleted:10b42862-0e5f-404f-9518-da6935496b3d for instance 4a33c396-4802-42b3-81be-fc3ef63e0184 on n-h2-854119-10 Aug 30 18:30:40.119917 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c5843d99-4a0c-4c0a-8a2d-9e140b6f2881 req-6c5d6292-b97f-4482-b184-4b825cfb3d09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115955 Aug 30 18:30:40.121348 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1728/3555] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:40.318093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:40.319686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:40.363230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.368358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.369521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.372374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.373373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.375499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.656169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}, {"server_uuid": "3c1430a9-5e97-44ff-a317-a8a7e9a7dde3", "name": "network-vif-unplugged", "status": "completed", "tag": "6d280c50-a5bc-46e6-9157-f4a0c609dbdb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:40.689643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.690593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.691029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.732441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Creating event network-vif-unplugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:30:40.733407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] Creating event network-vif-unplugged:6d280c50-a5bc-46e6-9157-f4a0c609dbdb for instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 on n-h1-854119-10 Aug 30 18:30:40.750067 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5ca3648a-8b8d-41c7-a341-8ee91c50e83f req-a4863f0d-82eb-4c49-b585-7accbc3f2030 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.098888 Aug 30 18:30:40.750901 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1729/3556] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:40.797064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:40.798084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:40.812468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.813211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.815437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.816897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:40.817696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:40.818425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:40.862749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 HTTP/1.1 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '141212f6-b08f-4f37-9f27-d62e6f8245e4'} Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:40.866319 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:30:40.869590 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:40.873387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:40.874568 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd961013-2318-4aa2-a8eb-d7d18d9c0406 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 404 len: 111 microversion: 2.1 time: 0.085686 Aug 30 18:30:40.875703 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1730/3557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:40 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:40.884553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8467c66-7044-470d-82b4-20b6ef88ca73 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '.version_select at 0x7f4e55bbeb80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:40.912397 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8467c66-7044-470d-82b4-20b6ef88ca73 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442899764" status: 202 len: 0 microversion: 2.1 time: 0.031533 Aug 30 18:30:40.917253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1731/3558] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442899764 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:30:40.964333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:40.986255 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3607c6b-0f52-4300-a434-c4ac2700ec05 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1284 microversion: 2.1 time: 0.678952 Aug 30 18:30:40.988962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1828/3559] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:40 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1284 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:41.039821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:41.043569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:41.063961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:41.065080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:41.065738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.066949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:41.067627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:41.068348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.088526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:41.089254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] [instance: 4a33c396-4802-42b3-81be-fc3ef63e0184] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:41.098946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:41.099622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:41.102967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.103852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:41.104429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:41.106954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.134926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] HTTP exception thrown: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Request method failure captured: Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 HTTP/1.1 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlcCip9wV43dEZSV4YWpOO4edQv5ptOIh372aTUbTZteFK_3YEi3hyUnlP3R1z6es9c3PrncbHVlWVNIU1YoC26bU3rmXGTnJL4W8WrFCmuB4Wy5Eb4OSa5ZtBW4G5E4Gh8RKtbmLopNkxiAemOGzfi9b-9QsKGFYMItUZgobGemG2U Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 9be812fc90ad4226bb2cca821f8f0f46 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9be812fc90ad4226bb2cca821f8f0f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 9be812fc90ad4226bb2cca821f8f0f46 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-184604261 Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAdminNegativeTestJSON-184604261-project Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: aa46d69577094a5ab9603dd69f1991ec Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAdminNegativeTestJSON-184604261-project Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4a33c396-4802-42b3-81be-fc3ef63e0184'} Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:41.139041 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. Aug 30 18:30:41.142224 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:30:41.146419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:41.147900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:41.148352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] Returning 404 to user: Instance 4a33c396-4802-42b3-81be-fc3ef63e0184 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:41.150303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3b5a330-bad6-41a9-bf35-d472fbbe4f45 tempest-ServersAdminNegativeTestJSON-184604261 tempest-ServersAdminNegativeTestJSON-184604261-project] 10.222.0.25 "GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184" status: 404 len: 111 microversion: 2.1 time: 0.066143 Aug 30 18:30:41.151021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:41.151703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lazy-loading 'fault' on Instance uuid 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:30:41.152983 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1829/3560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:41 2022] GET /compute/v2.1/servers/4a33c396-4802-42b3-81be-fc3ef63e0184 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:30:41.489907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be91534ce524e14bd34ba86a10ec9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0ae0ddbde642ff9a03f9b8449f49ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:41.504915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a60ea00-6ea0-4cd4-a0a7-5e423d286eba tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 200 len: 1315 microversion: 2.1 time: 0.479522 Aug 30 18:30:41.523282 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1732/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:41 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:42.012908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:42.013430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:42.029981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.031861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.032610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.034566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.037029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.037467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.252753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1430a9-5e97-44ff-a317-a8a7e9a7dde3", "name": "network-vif-deleted", "tag": "6d280c50-a5bc-46e6-9157-f4a0c609dbdb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:42.278172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.278684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.280115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.295112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] Creating event network-vif-deleted:6d280c50-a5bc-46e6-9157-f4a0c609dbdb for instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 on n-h1-854119-10 Aug 30 18:30:42.300450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6bae4b80-3fa5-4e8a-8b37-b3b0da3c3334 req-5a94c9c4-243c-46cc-b880-71c5b1d26ae4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055486 Aug 30 18:30:42.302312 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1733/3562] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:42.368926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:42.377401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-551f8cd5-12d7-44c4-b356-75159cc3c8fb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1284 microversion: 2.1 time: 0.368711 Aug 30 18:30:42.383817 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1830/3563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:42 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1284 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:42.532190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:42.533128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] [instance: 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:42.546636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.551589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.552358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.559257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:42.560449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:42.561138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:42.594531 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] HTTP exception thrown: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Request method failure captured: Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 HTTP/1.1 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlcnjrYBJI_VqUCg9lvFIgK4nNfplawMIXbzNMC9FQHO6P5UDUTXnkzYdlLmKxVvQksLU2_eHxyuEjWuFSQyd6YKmrWgP05KAGv9Av7GAi89Inn4LkFRpZHgcUygWENJIjOLzlhuQe5pgPRITDcSorZCctBMmthANdbTBDVd0VmRSEk Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f0ae0ddbde642ff9a03f9b8449f49ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8f0ae0ddbde642ff9a03f9b8449f49ce Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-375016890 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6be91534ce524e14bd34ba86a10ec9e2 Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-375016890-project Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3c1430a9-5e97-44ff-a317-a8a7e9a7dde3'} Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:42.599992 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] Returning 404 to user: Instance 3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:30:42.603153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e8f91b48-5a89-4bf3-9286-72014213d230 tempest-ServerAddressesNegativeTestJSON-375016890 tempest-ServerAddressesNegativeTestJSON-375016890-project] 10.222.0.25 "GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3" status: 404 len: 111 microversion: 2.1 time: 0.077285 Aug 30 18:30:42.605396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1734/3564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:42 2022] GET /compute/v2.1/servers/3c1430a9-5e97-44ff-a317-a8a7e9a7dde3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:30:43.398175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:43.398865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:43.405519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:43.406226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:43.407139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:43.407997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:43.408612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:43.409042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:43.956731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:43.975439 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-30607f3d-62ff-4bdd-b7f3-f561446534ae tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.581111 Aug 30 18:30:44.007719 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1831/3565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:43 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:44.203715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:44.205547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:44.217873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.220840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.221461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.222202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.222701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.223427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.373768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'services' on Instance uuid 23458d56-3de6-4429-91bd-9d46736b5a3f {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:30:44.546784 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2255f1f-a63e-4f97-8f68-a2811e256933 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments/34566b41-45eb-4629-9bea-f78ca4a8ae1f" status: 202 len: 0 microversion: 2.1 time: 0.346962 Aug 30 18:30:44.547712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1735/3566] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:30:44 2022] DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments/34566b41-45eb-4629-9bea-f78ca4a8ae1f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:30:44.557199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:44.560650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:44.578854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.592529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.593518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.597375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.600066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.600840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.705528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:44.730083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-786c742a-74d6-42ab-9da8-32b0648a13d3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160278 Aug 30 18:30:44.736307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1832/3567] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:44 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:44.783557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-plugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:44.794072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:44.814781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:44.821669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:44.824113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:44.871189 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] Creating event network-vif-plugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:30:44.888653 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-242be8c8-e8c9-4e1e-9b3b-d17509a5fc41 req-62afbe5f-2079-4e84-ad07-a734af5857a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111421 Aug 30 18:30:44.893258 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1736/3568] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:45.008532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:45.009506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:45.028496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.033688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.038635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.039710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.041030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.043827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.508444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:45.517863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1948ee83-d757-40f1-bf53-cc2cc6521ebd tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.514268 Aug 30 18:30:45.523660 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1833/3569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:45 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:45.746863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:45.755123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:45.781531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.782327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.783163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.784123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:45.784832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:45.785569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:45.868350 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbb14fdf-e937-427a-aac0-b66931287ca6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129530 Aug 30 18:30:45.869653 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1737/3570] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:45 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:46.485886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00095-68fa-4919-9617-2e9af16b437e", "tag": "82cadd25-4d64-416e-8f70-b8f9dcd55e9c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:46.502576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:46.506674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:46.516298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.517206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.517803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.542656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:46.543560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:46.557001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.559315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.560502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.564289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.566137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.568882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.579182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] Creating event network-changed:82cadd25-4d64-416e-8f70-b8f9dcd55e9c for instance aaa00095-68fa-4919-9617-2e9af16b437e on n-h2-854119-10 Aug 30 18:30:46.615452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d6b122bc-888c-4979-aa30-c18a8fe51da8 req-56cceaed-11e4-4481-b722-72ca9abb6bb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130997 Aug 30 18:30:46.616714 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1834/3571] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:46.882174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:46.885684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:46.902427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.902992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.906513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.907340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:46.907834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:46.908644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:46.985913 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93ce5b6b-7c25-4dcc-878c-99ba01a5710e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108535 Aug 30 18:30:46.992336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1835/3572] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:46 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:47.085730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:47.099204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-793ac218-1b30-408e-a400-65d8f3fbe725 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.562909 Aug 30 18:30:47.102042 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1738/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:46 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:48.000100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:48.002404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:48.033717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.040527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.044077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.047807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.051756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.052527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.126584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:48.127729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:48.149516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.158543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.163831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.168678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:48.175141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:48.180052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:48.257173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1452961e-65d3-42fc-b3ac-fba5f01f8f6c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261779 Aug 30 18:30:48.271988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1836/3574] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:47 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:48.985653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:48.998924 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0462551b-c172-496c-83c4-f39ffe2d7657 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.877838 Aug 30 18:30:49.015636 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1739/3575] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:48 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:49.287370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:49.290054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:49.325579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:49.326101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:49.326611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:49.327368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:49.327830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:49.328310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:49.466417 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d96f6e5-7adb-4f3a-814e-6fef4db10fd7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186030 Aug 30 18:30:49.470204 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1837/3576] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:49 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:50.021278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:50.022026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:50.041379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:50.041942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:50.042415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:50.052241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:50.054981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:50.059820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:50.331925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-296379787", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:50.476341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:30:52.235677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:30:52.236616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:30:52.236797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:30:52.237311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:30:52.238326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:30:52.273311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.282647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.283416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.284567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.285281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.286093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.355143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:30:52.377578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:30:52.440418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:30:52.443493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:30:52.561182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:52.578740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40c80fec-2ec5-4d71-b6b4-68bb39b00cdb tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 2.559248 Aug 30 18:30:52.596947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1838/3577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:50 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:52.608985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:52.621058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:52.626486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a3f61f9-cb39-4628-9bc3-a0258ec4b47d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.668883 Aug 30 18:30:52.639168 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1740/3578] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:30:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:30:52.658926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:30:52.660836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.661297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a92663f-fb1d-4b4a-b077-3d12fdc7c6e6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:52.662255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a92663f-fb1d-4b4a-b077-3d12fdc7c6e6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:52.665512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.667093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.673917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:52.674616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:52.675494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:52.770245 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebc7d4f5-e6b4-43e4-b6c1-439481784186 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171303 Aug 30 18:30:52.783845 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1839/3579] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:52 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:53.326538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a92663f-fb1d-4b4a-b077-3d12fdc7c6e6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:53.338688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a92663f-fb1d-4b4a-b077-3d12fdc7c6e6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1216 microversion: 2.1 time: 0.698252 Aug 30 18:30:53.343761 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1741/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:52 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1216 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:53.604830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:53.605609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:53.627683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.632551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.633169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.634133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.635432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.635996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.791847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:53.795325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:53.810027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.810490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.810936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.814292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:53.814801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:53.819806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:53.921034 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00c6623b-adc3-462e-82cb-5b86d73e4e1f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133252 Aug 30 18:30:53.923528 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1742/3581] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:53 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:30:54.367234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:54.368772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:54.397286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.398082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.401690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.402737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.404406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.406472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.656054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:54.668957 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36506ee4-e63b-4bd2-8ec1-01e41425b809 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1220 microversion: 2.1 time: 0.308196 Aug 30 18:30:54.679295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1743/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:54 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1220 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:54.850017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:54.859553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5cbfe898-0663-40a6-85eb-2dfe423b3702 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 1.258709 Aug 30 18:30:54.862763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1840/3583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:53 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:54.936207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:54.939333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:54.956563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.957189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.963087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:54.978144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:54.978904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:54.979496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:55.093874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab42f9fe-4b84-4f75-b355-63384df5191a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161858 Aug 30 18:30:55.108448 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1744/3584] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:54 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:55.704960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:55.705597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:55.720194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:55.720708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:55.721154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:55.721895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:55.722369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:55.724320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:55.886452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:55.887668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:55.900213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:55.900820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:55.903425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:55.904862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:55.905561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:55.906210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:55.935878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:55.948926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e18d486a-5750-4d70-9806-c37ec4b5d07d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 0.250086 Aug 30 18:30:55.950920 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1841/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:55 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:56.116277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:56.119240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:56.129412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.130624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.131330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.132288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.132895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.134063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.199179 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93f7e3ea-2b76-4478-889a-88602e64edfe tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088865 Aug 30 18:30:56.203562 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1842/3586] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:30:56 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:30:56.323251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:56.323947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:56.331586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.332599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.333857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.334935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.335544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.336142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.372998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:30:56.532560 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44b31a3c-0af2-4183-8719-4a64d98f6699 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 204 len: 0 microversion: 2.1 time: 0.212975 Aug 30 18:30:56.538029 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1843/3587] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:30:56 2022] DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:30:56.546276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:56.549177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:56.560094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.560957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.561571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.562753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:56.563612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:56.564264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:56.840769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:56.868723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eec43ce8-8db8-49dc-aa5d-353ee576ae0e tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.987235 Aug 30 18:30:56.875157 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1745/3588] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:55 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:56.977938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:56.979046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:56.995738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.000288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.001030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.002166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.007483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.010157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.105766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:57.117087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-81a3174c-c154-45b2-8d95-3b681f4ef505 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1682 microversion: 2.1 time: 0.577173 Aug 30 18:30:57.124890 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1844/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:56 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1682 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:57.519975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:57.529209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06c35739-ff91-485f-83e9-261c1e51739b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 0.557284 Aug 30 18:30:57.535864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1746/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:56 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:30:57.896061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:57.896717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:57.924608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.925171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.926016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:57.926776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:57.949546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:57.953340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.149573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:58.150322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:58.168773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.169277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.169720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.170486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.170951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.171370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.763594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:58.772758 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a97581d0-9b06-40db-9eb1-e78026d11013 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 0.882372 Aug 30 18:30:58.779021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1845/3591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:57 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:58.784156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00095-68fa-4919-9617-2e9af16b437e", "name": "network-vif-plugged", "status": "completed", "tag": "82cadd25-4d64-416e-8f70-b8f9dcd55e9c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:30:58.794508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.795321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.819303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.833007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] Creating event network-vif-plugged:82cadd25-4d64-416e-8f70-b8f9dcd55e9c for instance aaa00095-68fa-4919-9617-2e9af16b437e on n-h2-854119-10 Aug 30 18:30:58.853164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e263d3ee-2f9a-4075-b4e0-a86713b34e0d req-e76084c2-9c9e-4b72-9784-f95018ebc485 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070562 Aug 30 18:30:58.854338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1846/3592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:30:58.864698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:58.867872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:58.915707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.916799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.921097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:58.923219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:58.927380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:58.932626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:59.216095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:30:59.229687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd9f0d32-519a-483e-81fd-1c834f92c522 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 0.372795 Aug 30 18:30:59.231033 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1847/3593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:58 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:30:59.806395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:30:59.808010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:30:59.832304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:59.835843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:59.836529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:30:59.840140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:30:59.840813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:30:59.841379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:00.902769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:00.925328 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f744cdd-216e-4b14-b648-e0d56e8c517f tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1351 microversion: 2.1 time: 1.126910 Aug 30 18:31:00.927172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1848/3594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:59 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1351 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:00.959992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:00.961052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:00.974080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:00.974987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:00.975610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:00.976500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:00.977103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:00.978664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:01.022634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:01.227341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:01.247941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e414c21-b941-4670-b1f2-e16f2bc3c568 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1682 microversion: 2.1 time: 3.102227 Aug 30 18:31:01.263182 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1747/3595] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:30:58 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1682 bytes in 3118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:01.956603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:01.957409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:01.976778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:01.985891 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5695bac0-dac8-4066-9ca7-2b96a2e2750f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 1.034834 Aug 30 18:31:01.989838 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1849/3596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:00 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:01.996536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:02.003903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:02.005660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:02.008375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:02.009944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:02.011361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:02.271365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:02.272827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:02.302072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:02.305155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:02.305594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:02.307181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:02.309300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:02.312262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:02.313108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:02.822623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:02.831257 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc814e5f-0975-437e-8167-d02a28ecab0a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1614 microversion: 2.1 time: 0.565395 Aug 30 18:31:02.847429 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1850/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:02 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1614 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:03.010386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:03.012014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:03.024655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.025576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.027813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.028767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.030957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.031604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.331759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:03.424204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:03.438867 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29e4a965-4dc8-4196-8575-6002116415a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 0.432314 Aug 30 18:31:03.440126 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1851/3598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:03 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:03.449635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23458d56-3de6-4429-91bd-9d46736b5a3f", "name": "network-vif-deleted", "tag": "385e253f-9581-4c5c-8aa5-941c3ef491b8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:03.485810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.489985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.493225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.536764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] Creating event network-vif-deleted:385e253f-9581-4c5c-8aa5-941c3ef491b8 for instance 23458d56-3de6-4429-91bd-9d46736b5a3f on n-h1-854119-10 Aug 30 18:31:03.545519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:03.564250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a5a77843-a19b-48fd-a688-2b554f295442 req-9da8a38e-ff2f-4d1f-8a39-76291463fef6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122574 Aug 30 18:31:03.565386 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1852/3599] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:03.587891 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30cb5ad6-c3e2-459e-b55c-ef29e0857353 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1542 microversion: 2.1 time: 1.636892 Aug 30 18:31:03.592371 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1748/3600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:01 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1542 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:03.627220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:03.631959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:03.645079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.646304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.647066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.648229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.649687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.650636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.871582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:03.872792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:03.884305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.885053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.886611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.887672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.888372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.889000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.919996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:03.935401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:03.936027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:03.936716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:03.937584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'fault' on Instance uuid 23458d56-3de6-4429-91bd-9d46736b5a3f {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:31:04.118569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:04.198328 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50a4a8d2-7280-49fb-9911-38a57540f849 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 200 len: 1331 microversion: 2.1 time: 0.330736 Aug 30 18:31:04.204732 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1749/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:03 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 1331 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:04.478014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:04.478853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:04.502218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:04.504096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:04.505083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:04.506255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:04.508955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:04.512493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:04.709558 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc3d6d14-c465-48be-a38a-ef622c382794 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.094750 Aug 30 18:31:04.710116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1853/3602] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:31:03 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e/os-interface => generated 285 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:04.797864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:04.808364 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2865775d-8185-4c59-bb8b-dfcdc36e7d11 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1274 microversion: 2.1 time: 0.337718 Aug 30 18:31:04.825388 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1750/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:04 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1274 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:05.242157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:05.252819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:05.302910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:05.309442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:05.310648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:05.318538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:05.319701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:05.320682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:05.358103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f HTTP/1.1 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '23458d56-3de6-4429-91bd-9d46736b5a3f'} Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:05.362099 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:31:05.373992 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:31:05.379800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:05.381852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ef82f07d-324a-44da-8c4f-58b8aeb19632 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 404 len: 111 microversion: 2.1 time: 0.159686 Aug 30 18:31:05.385018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1854/3604] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:05 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:31:05.408588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0795d283-fd5c-4536-9a73-31e62772ca19 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '.version_select at 0x7f4e5aea8550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:05.469638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0795d283-fd5c-4536-9a73-31e62772ca19 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-253145875" status: 202 len: 0 microversion: 2.1 time: 0.076231 Aug 30 18:31:05.473235 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1751/3605] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-253145875 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:31:05.843087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:05.852315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:05.908772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:05.918031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:05.931334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:05.935887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:05.939095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:05.943347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:07.618048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:07.639773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72c64b69-7326-437c-971f-84e04d557e14 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 1.813165 Aug 30 18:31:07.641161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1855/3606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:05 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:08.151760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00095-68fa-4919-9617-2e9af16b437e", "tag": "82cadd25-4d64-416e-8f70-b8f9dcd55e9c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:08.175586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:08.176358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:08.177352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:08.202461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] Creating event network-changed:82cadd25-4d64-416e-8f70-b8f9dcd55e9c for instance aaa00095-68fa-4919-9617-2e9af16b437e on n-h2-854119-10 Aug 30 18:31:08.215316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e7f03fa7-db3f-4d83-85c6-f92e56da3401 req-a1af489a-c0fd-4418-a380-8c8b456ccb03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067644 Aug 30 18:31:08.216623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1752/3607] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:08.662539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:08.663152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:08.677813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:08.678326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:08.680505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:08.681260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:08.684894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:08.686170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:10.513267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a24854-c37f-424f-b14c-1f7350b34928", "tag": "320c9108-beeb-433e-97c9-2b38cbd69ef5"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:10.528579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:10.550360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-762c60fc-802e-4fb6-9cdc-057801594f3b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 1.892463 Aug 30 18:31:10.557816 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1856/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:08 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:10.569926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:10.570455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:10.570907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:10.623865 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] Creating event network-changed:320c9108-beeb-433e-97c9-2b38cbd69ef5 for instance 50a24854-c37f-424f-b14c-1f7350b34928 on n-h1-854119-10 Aug 30 18:31:10.638396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1281f6f0-5cb5-4188-91dd-82c8b85b5ca6 req-017ac16b-da56-4cff-b252-bdcab0eebcfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128291 Aug 30 18:31:10.641028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1753/3609] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:11.594120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:11.598698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:11.621796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:11.625078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:11.625779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:11.630280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:11.631037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:11.631710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:12.466696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:12.481861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d74180ef-fd92-49b1-8afa-786a80756c77 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 0.900132 Aug 30 18:31:12.484472 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1857/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:11 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:12.991201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:12.993367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:13.011650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.012467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.014303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.015861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.019987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.021734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.157775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b2892ca-d5b6-4d57-af73-118c8350b823 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: .version_select at 0x7f4e55cc3f70>, body: {"keypair": {"name": "tempest-keypair-202854555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTcikFkSSyg92YeLSD2ugF4nQlTZW/8f9RdtfFn59QM+jSxWUs+X+R1/l+qMLyhWbg1cz732O6HyHbyqftIm0DALPDGoTt0zmmDIY3jwwGetgCwEW3176gshZn7BfgVhQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:13.175663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6b2892ca-d5b6-4d57-af73-118c8350b823 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:13.184622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6b2892ca-d5b6-4d57-af73-118c8350b823 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:13.221624 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b2892ca-d5b6-4d57-af73-118c8350b823 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068013 Aug 30 18:31:13.223462 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1858/3611] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:31:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:13.339098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:13.352849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e92b24ba-153c-4d8b-a4bb-681e26c1dbd4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.369071 Aug 30 18:31:13.353475 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1754/3612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:12 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:13.378150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-306493563"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:13.380913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:13.395280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.395787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.396227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.396969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.397429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.397853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.508938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:13.509569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:13.529380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.529884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.530321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.541355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.542033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.542799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.913831 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91652f47-1bec-40a2-9649-81206af5e3ae tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.540339 Aug 30 18:31:13.916770 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1859/3613] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:31:13 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 18:31:13.939325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:13.942279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:13.954969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.962027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.962559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:13.963506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:13.964125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:13.964697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:14.165534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:14.179708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7f3de57-cd10-4cd6-bf7a-3d1496df0801 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 0.679863 Aug 30 18:31:14.180850 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1755/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:13 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:14.621853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:14.632626 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b9ecb7c3-243d-494f-9989-2a7eccc9b4f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.712153 Aug 30 18:31:14.640912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1860/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:13 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:15.206081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:15.209938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:15.232532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.233557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.236564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:15.237736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.238917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.240987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:15.669638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:15.670412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:15.684493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.689809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.691162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:15.693124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:15.693864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:15.698242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:16.065347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:16.082008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00d00c4d-4c7c-4e19-bb0a-33065470e297 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1686 microversion: 2.1 time: 0.418132 Aug 30 18:31:16.102373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1861/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:15 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1686 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:16.934101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:16.976667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:16.978266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:16.982481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:17.030192 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] Creating event network-vif-unplugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:31:17.037752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-657e23ce-09da-4544-9e9b-bf9dd72927aa req-d5f77db5-af29-4182-a4bd-3fe3f362050d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107318 Aug 30 18:31:17.038916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1862/3617] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:17.112997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:17.113753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:17.127045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:17.127466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:17.128666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:17.129414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:17.133711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:17.134225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:17.438575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:17.447980 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb379ba9-b537-4aa5-84af-679a9d23e3b3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 2.250128 Aug 30 18:31:17.452232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1756/3618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:15 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:17.527140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:17.540065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad95b497-a938-4943-90b5-d68253c2dbd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1686 microversion: 2.1 time: 0.434384 Aug 30 18:31:17.544745 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1863/3619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:17 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1686 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:18.486512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:18.489005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:18.510308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:18.527055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.556330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.557352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.564739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.565691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.569374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.593184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:18.595123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:18.616473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.620860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.621349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.630545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:18.631188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:18.631644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:18.988121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:19.005665 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32d9c379-289e-4713-832d-a1fc6cffe4cc tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 0.535524 Aug 30 18:31:19.013773 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1757/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:18 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:19.501891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:19.551527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6080fbb8-ae41-43d3-bdac-11f7f7353f0f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 0.962892 Aug 30 18:31:19.557005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1864/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:18 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:20.037205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:20.038951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:20.071258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.077078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.079315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.080521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.083385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.087133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.396409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-plugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:20.419804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.420630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.421233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.448285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] Creating event network-vif-plugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:31:20.464259 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ed7d125d-1a1f-4c19-bd26-97062d06cfda req-951fbac2-dc9b-4db7-909c-ddf6df263fc3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072241 Aug 30 18:31:20.465220 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1865/3622] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:20.598273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:20.602845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:20.620914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.621424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.621863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.627572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:20.628662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:20.629056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:20.864099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:20.882964 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0947756d-41e5-4bc5-b5d0-7f83dd94d946 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 0.851768 Aug 30 18:31:20.884301 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1758/3623] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:20 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:20.896966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246768745", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5"}], "security_groups": [{"name": "tempest-securitygroup--184695799"}], "key_name": "tempest-keypair-202854555", "user_data": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:21.329812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:21.348722 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36f9beed-750f-4df4-a495-afdbdb08abb5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 0.768422 Aug 30 18:31:21.349361 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1866/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:20 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:21.352594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] validate_networks() for [('5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:31:21.929724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:21.932775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:21.972970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:21.976312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:21.977795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:21.980435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:21.981232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:21.981874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.225021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:31:22.225598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:31:22.226241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:31:22.227031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:31:22.227658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:31:22.270769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.277822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.278939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.285379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.290542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.291459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.397177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:22.424084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:22.485832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:31:22.491771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:31:22.528257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:22.539455 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3305354f-32ab-470e-9dee-ce82aad90431 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 0.637383 Aug 30 18:31:22.543935 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1867/3625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:21 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:22.548827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:22.549448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:22.589161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.589718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.590215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.593131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.594770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.596644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.646516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:22.666376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12708327-963e-49a2-bd18-b6078ddf64b9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.776042 Aug 30 18:31:22.673317 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1759/3626] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:31:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:31:22.680535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c3a5b85-ade7-4c15-9ee1-62e4346c0f0d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:22.681167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c3a5b85-ade7-4c15-9ee1-62e4346c0f0d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:22.870311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c3a5b85-ade7-4c15-9ee1-62e4346c0f0d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:22.880991 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c3a5b85-ade7-4c15-9ee1-62e4346c0f0d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1240 microversion: 2.1 time: 0.206446 Aug 30 18:31:22.881604 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1760/3627] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:22 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1240 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:22.906461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a24854-c37f-424f-b14c-1f7350b34928", "name": "network-vif-plugged", "status": "completed", "tag": "320c9108-beeb-433e-97c9-2b38cbd69ef5"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:22.947042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:22.947542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:22.951656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:22.990798 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] Creating event network-vif-plugged:320c9108-beeb-433e-97c9-2b38cbd69ef5 for instance 50a24854-c37f-424f-b14c-1f7350b34928 on n-h1-854119-10 Aug 30 18:31:23.002885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9f902f4e-7849-40cc-a91f-5639311ece81 req-49e162c1-ef74-4de6-8ce5-fef95e7a37d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119828 Aug 30 18:31:23.005350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1761/3628] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:23.197356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:23.569097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:23.570606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:23.593303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.594069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.594812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:23.595790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.596467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.597592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:23.653088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:23.667830 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1cf91f7-6ad7-46ad-ac84-b0924ea8e1f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.122665 Aug 30 18:31:23.672689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1868/3629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:22 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:23.920987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:23.923490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:23.939375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:23.942719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.943354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.944025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:23.945159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:23.945741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:23.946266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:24.185969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:24.215711 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb37c06a-777f-442f-b6ef-c86c0988e8c4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1236 microversion: 2.1 time: 0.312075 Aug 30 18:31:24.218891 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1869/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:23 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1236 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:24.692908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:24.694114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:24.706442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:24.707392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:24.708397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:24.710609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:24.711447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:24.712131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:25.522004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:25.531042 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-81d09d02-68e4-4a61-8392-0547684e8cd5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1316 microversion: 2.1 time: 1.970460 Aug 30 18:31:25.532356 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1762/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:23 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1316 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:25.538293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:25.539164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:25.574528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:25.589548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:25.590116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:25.590921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:25.596495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:25.597038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:25.858580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:25.873319 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e545062-bf96-4a74-9415-97c0b33d3af8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1310 microversion: 2.1 time: 0.339670 Aug 30 18:31:25.874705 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1763/3632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:25 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:26.298372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:26.309360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0bed51f7-5813-469d-8bd6-b53d1702d5b2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.621863 Aug 30 18:31:26.315146 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1870/3633] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:24 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:26.557715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:26.558386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:26.571835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.575152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.577515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:26.580128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.582117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.582859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:26.902750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:26.903497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:26.920857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.921868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.922650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:26.927524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:26.931717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:26.932763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.428251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:27.484224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-287f8f76-b34e-4771-8b6c-632e9da1ddf4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1298 microversion: 2.1 time: 0.586153 Aug 30 18:31:27.510540 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1871/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:26 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1298 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:27.550125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:27.552513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:27.581350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.582244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.591821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.593629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:27.594438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:27.595194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:27.693414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:27.718988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dacba817-e239-455c-b7ce-0e1dcbf6a4b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1466 microversion: 2.1 time: 1.159025 Aug 30 18:31:27.727579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1764/3635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:26 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1466 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:28.785476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:28.789235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:28.804103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:28.805576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:28.807439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:28.811470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:28.812219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:28.812898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.766045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:29.778731 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b6451f3-bb1a-47a5-bdb4-77c433378d41 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 2.266211 Aug 30 18:31:29.780176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1872/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:27 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:29.790547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:29.792186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:29.814053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.814949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.818323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.819576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:29.820682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:29.821511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:29.920589 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f07e943-d3be-43c1-bd3f-d68fe41c2217 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1619 microversion: 2.1 time: 2.163827 Aug 30 18:31:29.945187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1765/3637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:27 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1619 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:29.970870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: .version_select at 0x7f4e573320d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-552588276", "policies": ["affinity"]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:30.034412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:30.068953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:30.180032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:30.192466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:30.227710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bcb980ed-64ac-473f-bb24-53fb022be277 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.263452 Aug 30 18:31:30.231892 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1766/3638] 10.222.0.25 () {60 vars in 1174 bytes} [Tue Aug 30 18:31:29 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:30.477347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:30.492777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4bf7136-6476-4584-9ff6-8777aa74a92d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1298 microversion: 2.1 time: 0.711106 Aug 30 18:31:30.493385 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1873/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:29 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1298 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:30.592881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2007083359", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8edfed3b-258b-427d-a863-3d2573c1eb9e"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:30.718743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:31:30.802172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:30.803926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:30.827659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.829710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.832070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:30.834958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:30.837018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:30.837620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.703638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:31.720401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6a43242-addc-452d-b386-d752646c431d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 0.922879 Aug 30 18:31:31.729526 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1874/3640] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:30 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:31.744412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:31.745633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:31:31.746427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:31:31.746596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:31.747568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:31:31.747892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:31:31.748415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:31:31.796618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:31.799027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:31.801693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:31.805994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.808055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:31.809713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:31.810593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:31.811048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.811805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.815598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:31.819108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:31.823019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:31.917687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:31.935502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:31.995640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 2 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:31:31.998382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:31:32.143086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122590) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 18:31:32.206034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:32.222563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:32.334334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:32.349786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:32.365342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:32.421905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=e89d5899-a4c2-4d8d-9c20-f03eb4da8a89,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:31:32.657721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:32.683574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:32.831739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:32.846910 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5696f35e-458d-4eb5-a600-3b16d1e428ba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 1.111747 Aug 30 18:31:32.848393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:31:32.849268 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1875/3641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:31 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:32.860742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:32.875765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:32.879086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:31:32.883395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:32.884179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:32.885479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:32.886603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:32.887210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:32.887884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:33.037554 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9946ed8e-ef7a-45b8-847f-497e8cd95f36 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.448525 Aug 30 18:31:33.047347 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1767/3642] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:31:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 2456 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 18:31:33.077628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:33.120015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:33.139970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Searching by: {'deleted': False, 'project_id': 'f690e184dcdf48babd667cff7823cf40'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:31:33.207904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:33.230770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:33.233889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:33.235196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:33.238835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:33.242107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:33.323030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:31:33.443389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96f06d8d-0b0c-47f4-b119-7df2ecad1514 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.394190 Aug 30 18:31:33.469144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1768/3643] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:31:33 2022] GET /compute/v2.1/servers => generated 1003 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:33.490096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b8f9b6b-7e9c-44e1-9ccc-0ece0158cd09 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:33.505887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b8f9b6b-7e9c-44e1-9ccc-0ece0158cd09 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:33.885300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:33.929443 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c72679be-4cc8-4c29-8f28-fb182af3aedf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.077890 Aug 30 18:31:33.938810 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1876/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:32 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:33.970949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:33.972284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0b8f9b6b-7e9c-44e1-9ccc-0ece0158cd09 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:33.973790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:33.990704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b8f9b6b-7e9c-44e1-9ccc-0ece0158cd09 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1219 microversion: 2.1 time: 0.518972 Aug 30 18:31:34.001739 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1769/3645] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:33 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1219 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:34.005825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:34.006426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:34.006808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:34.014156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:34.019659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:34.021303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:34.960548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:34.961166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:35.018680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:35.029956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:35.035203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:35.040016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:35.045417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:35.046785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:35.140581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=84 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:36.110221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:36.125160 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4cb3fe5-4d18-4191-847f-3ee17cc67efb tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 2.184756 Aug 30 18:31:36.131096 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1877/3646] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:33 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:36.164542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:36.165392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:36.204606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:36.206536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:36.210405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:36.214561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:36.217991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:36.218993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:36.338810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:36.349617 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b56e18f-4e90-4bc3-8fad-bbb1636d08ee tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.394021 Aug 30 18:31:36.444524 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1770/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:34 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:36.464097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:36.508744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:36.557707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:36.559399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:36.565853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:36.572519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:36.579727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:36.582869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:36.727392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:36.732046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ca596b8-b980-4a7a-a4ef-f829e87dd124 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1271 microversion: 2.1 time: 0.597905 Aug 30 18:31:36.734064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1878/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:36 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1271 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:36.779371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:31:36.818480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6141780-70eb-40fa-97bf-011e9712354d", "tag": "64bf4300-d79c-42a6-b9bd-ae3fc1f4680e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:36.862931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:36.863470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:36.876917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:36.955856 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] Creating event network-changed:64bf4300-d79c-42a6-b9bd-ae3fc1f4680e for instance c6141780-70eb-40fa-97bf-011e9712354d on n-h2-854119-10 Aug 30 18:31:36.989362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-51f24744-c8b2-4e64-95c3-55962a8df2c9 req-b956820e-7c21-414d-bd15-8cfbaa35cbe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169068 Aug 30 18:31:36.992489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1879/3649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:37.130203 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba3536e1-3af2-472f-b006-954f8e936cbc tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 204 len: 0 microversion: 2.1 time: 0.683580 Aug 30 18:31:37.134246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1771/3650] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:31:36 2022] DELETE /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:31:37.144292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:37.144778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:37.162014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.162248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:37.163234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.166223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.169902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:37.172069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.173145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.175228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.199449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.203209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.203697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.204464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.204942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.205372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.759731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:37.774128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f6b6169c-228f-4e1a-92b5-1bca9c5c20a5 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1667 microversion: 2.1 time: 0.635431 Aug 30 18:31:37.774782 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1880/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:37 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1667 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:37.821404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:37.825612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:37.826762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:37.836075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.836790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.837433 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-25f305cb-1518-4e4f-b339-bce35037a0d8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 0.690513 Aug 30 18:31:37.837824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.838810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.839489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.840116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.852307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1772/3652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:37 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:37.859209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:37.859843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:37.880627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.882028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.883508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:37.884452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:37.886995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:37.891846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:38.017116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:38.032239 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e603a591-fc04-4e06-ad65-056e584e5ce4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1289 microversion: 2.1 time: 0.174585 Aug 30 18:31:38.032910 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1773/3653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:37 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:38.799072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:38.799816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:38.808274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:38.814316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:38.817724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:38.821578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:38.823831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:38.825637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:39.386762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:39.407704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-30e52c8f-6182-48b3-ad60-3679a57ac8a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.606426 Aug 30 18:31:39.416627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1881/3654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:37 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:39.438486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:39.439655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:39.466475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:39.471524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:39.472217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:39.473226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:39.476208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:39.481773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:39.562300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:39.577624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23160bc4-6d23-4b52-9c43-9037ea0ca289 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1667 microversion: 2.1 time: 0.783170 Aug 30 18:31:39.579203 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1774/3655] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:38 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1667 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:39.591414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:39.592512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:39.604383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:39.606969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:39.608081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:39.610758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:39.611545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:39.613237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:39.850025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:39.864084 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-685bf79a-4ffe-4aa7-9e34-48048bb47093 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 0.445282 Aug 30 18:31:39.865069 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1882/3656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:39 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:40.211378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:40.234102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a998d8ab-cfad-4698-a826-420c0bce7252 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1277 microversion: 2.1 time: 0.651811 Aug 30 18:31:40.237228 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1775/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:39 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1277 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:40.442374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:40.443838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:40.462169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:40.465294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:40.466409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:40.472720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:40.475723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:40.476466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:40.606089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:40.608169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:40.621271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:40.622908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:40.625228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:40.626171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:40.628237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:40.628895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:41.165764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:41.179541 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ec16966-7743-431e-ad01-64c9d29af7f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 0.742614 Aug 30 18:31:41.182041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1883/3658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:40 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:41.196316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:41.202388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:41.226652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:41.227412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:41.230927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:41.233443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:41.237381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:41.237982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:41.554137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:41.582884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7c0e66d-cbec-497f-9479-269f107e58bf tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1667 microversion: 2.1 time: 0.968141 Aug 30 18:31:41.585727 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1776/3659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:40 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1667 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:41.602206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:41.602869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:41.638719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:41.639277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:41.639665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:41.640395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:41.640855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:41.641282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:42.623522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:42.678678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a80d0c58-e982-4f51-b56b-23095b073304 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 1.494286 Aug 30 18:31:42.692762 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1884/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:41 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:42.742833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:42.750241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:42.775100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:42.778302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:42.789847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:42.796448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:42.798258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:42.800272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:43.257277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:43.735714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:43.789958 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dae34dc-3b2b-4188-a48c-6d694c8f9015 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 2.178811 Aug 30 18:31:43.791736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1777/3661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:41 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:43.812816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:43.823373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:43.849294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:43.854026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:43.855401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:43.859135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:43.883726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:43.884538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:44.013479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=40 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:44.144643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:44.155504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9a2ce43-481e-44ac-9f60-1993c2bd2450 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1600 microversion: 2.1 time: 0.361983 Aug 30 18:31:44.170689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1778/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:43 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1600 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:44.194562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00095-68fa-4919-9617-2e9af16b437e", "name": "network-vif-unplugged", "status": "completed", "tag": "82cadd25-4d64-416e-8f70-b8f9dcd55e9c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:44.259140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:44.266620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:44.267127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:44.313614 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] Creating event network-vif-unplugged:82cadd25-4d64-416e-8f70-b8f9dcd55e9c for instance aaa00095-68fa-4919-9617-2e9af16b437e on n-h2-854119-10 Aug 30 18:31:44.334410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4df782a7-a6d6-469c-a5f3-5a1560139e83 req-c7b474b0-9b93-4b1e-893a-30b5461e7144 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158445 Aug 30 18:31:44.335155 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1779/3663] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:44.351980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:44.354881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:44.371365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:44.371807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:44.372390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:44.373796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:44.374280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:44.374738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.017062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:46.025768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:46.028534 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c280a8b3-038f-48a7-a752-640a7a028123 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 3.318587 Aug 30 18:31:46.040210 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1885/3664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:42 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 3347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:46.045991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:46.055439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:46.093397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.097347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.101378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.105804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.109127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.112091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.358475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:46.383812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5cffb547-bcd6-435d-b079-1c5ae15d5e28 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 2.041685 Aug 30 18:31:46.386944 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1780/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:44 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:46.407240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:46.412337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:46.437870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.441847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.443022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.446450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.449560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.452533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.592448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.594210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.595054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.598310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lazy-loading 'fault' on Instance uuid aaa00095-68fa-4919-9617-2e9af16b437e {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:31:46.771612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce299c347cc4fc49c3b0cc55ba30637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260af50a1c7a4c5bab598d73a3426bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:46.787683 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e38c53f-68de-4b74-8b7f-f9bc03f19140 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 200 len: 1316 microversion: 2.1 time: 0.399220 Aug 30 18:31:46.789907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1781/3666] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:46 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:46.809261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00095-68fa-4919-9617-2e9af16b437e", "name": "network-vif-deleted", "tag": "82cadd25-4d64-416e-8f70-b8f9dcd55e9c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:46.859611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:46.860122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:46.860551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:46.953387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] Creating event network-vif-deleted:82cadd25-4d64-416e-8f70-b8f9dcd55e9c for instance aaa00095-68fa-4919-9617-2e9af16b437e on n-h2-854119-10 Aug 30 18:31:47.009247 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-96fed163-fe47-4280-a65b-7a9a8cc4894c req-955d9072-4c95-44d4-bdf0-2cd309cfd7bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209385 Aug 30 18:31:47.010573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1782/3667] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:47.056680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6141780-70eb-40fa-97bf-011e9712354d", "name": "network-vif-plugged", "status": "completed", "tag": "64bf4300-d79c-42a6-b9bd-ae3fc1f4680e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:47.129221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:47.131513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:47.134432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:47.179317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:47.197681 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] Creating event network-vif-plugged:64bf4300-d79c-42a6-b9bd-ae3fc1f4680e for instance c6141780-70eb-40fa-97bf-011e9712354d on n-h2-854119-10 Aug 30 18:31:47.207120 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c2d6eb0-10f7-44f7-871c-771dadff6710 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 1.163985 Aug 30 18:31:47.224109 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1886/3668] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:46 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:47.245052 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c11aabb8-e415-4fd5-9d53-eceeb9c1b3e1 req-691e5f7c-3c99-4507-8a6c-536818c02097 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228974 Aug 30 18:31:47.250099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:47.250874 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1783/3669] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:47.252419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:47.267260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:47.268203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:47.269569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:47.277291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:47.278189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:47.278900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:47.413319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:47.414018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:47.433071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:47.433628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:47.434072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:47.440143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:47.441556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:47.442018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.274021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:48.287396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4040d9a-a694-41fa-b645-ce2709c6ef61 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 0.879583 Aug 30 18:31:48.288187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1784/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:47 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:48.300318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:48.300993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] [instance: aaa00095-68fa-4919-9617-2e9af16b437e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:48.319426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:48.321084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:48.321634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.324014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:48.329608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:48.330084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.415528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] HTTP exception thrown: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Request method failure captured: Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e HTTP/1.1 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlc_s_GqQswv1tm0_hzsouCKo_F7Bhdu8exZUVoNgukbtqXmRyvfWmCSX6_-vaxYY5uUSCGxlXmVocVvG-c81xRM1otcm00G49QPpGajjr_yK6LfcvUw8k0FzQPcGXAZa7TQJ34p8lYk21iWt41s3wU9JfIgwbPAR58h6UlQjMSfJKM Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 260af50a1c7a4c5bab598d73a3426bc6 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestFqdnHostnames-1416728706 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/260af50a1c7a4c5bab598d73a3426bc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/260af50a1c7a4c5bab598d73a3426bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/260af50a1c7a4c5bab598d73a3426bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_260af50a1c7a4c5bab598d73a3426bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestFqdnHostnames-1416728706 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 260af50a1c7a4c5bab598d73a3426bc6 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1416728706 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestFqdnHostnames-1416728706-project Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6ce299c347cc4fc49c3b0cc55ba30637 Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestFqdnHostnames-1416728706-project Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'aaa00095-68fa-4919-9617-2e9af16b437e'} Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:31:48.417251 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. Aug 30 18:31:48.421712 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:31:48.427585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Returning 404 to user: Instance aaa00095-68fa-4919-9617-2e9af16b437e could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:31:48.430551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6fbe50c-5c3b-438b-ad1d-41865370c924 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e" status: 404 len: 111 microversion: 2.1 time: 0.139217 Aug 30 18:31:48.431114 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1785/3671] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:48 2022] GET /compute/v2.1/servers/aaa00095-68fa-4919-9617-2e9af16b437e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:31:48.445198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9da4b6e-63bb-43e1-b2fd-81b160b04b04", "tag": "96398ab4-cc0a-4858-b7af-9e2b54944891"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:48.461044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:48.461541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:48.461975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.503763 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] Creating event network-changed:96398ab4-cc0a-4858-b7af-9e2b54944891 for instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 on n-h2-854119-10 Aug 30 18:31:48.518021 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-08df1335-3bc9-4006-8877-a5bfb92f0b56 req-e45ab80b-6745-47b2-b910-6ccd06fde047 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083126 Aug 30 18:31:48.521045 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1786/3672] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:48.537262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:48.541158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:48.557920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:48.559054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:48.560846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.562511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:48.564979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:48.568188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:48.636127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:48.655974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb5f75a6-5a53-4b0b-9114-d3ca981afeab tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1681 microversion: 2.1 time: 1.420480 Aug 30 18:31:48.657213 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1887/3673] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:47 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1681 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:48.664288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4af5f0e-0d3c-438d-95d2-fc6ff0b5a731 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] Calling method '.version_select at 0x7f4e55dec820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:48.723144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4af5f0e-0d3c-438d-95d2-fc6ff0b5a731 tempest-ServersTestFqdnHostnames-1416728706 tempest-ServersTestFqdnHostnames-1416728706-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940836959" status: 202 len: 0 microversion: 2.1 time: 0.064017 Aug 30 18:31:48.724381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1888/3674] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940836959 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:31:49.234402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89d5899-a4c2-4d8d-9c20-f03eb4da8a89", "tag": "5be28d65-c6e8-408f-8114-66ddc6d5df85"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:49.257096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:49.257832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:49.259200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:49.278096 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] Creating event network-changed:5be28d65-c6e8-408f-8114-66ddc6d5df85 for instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 on n-h2-854119-10 Aug 30 18:31:49.285989 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5611039f-d6f8-4375-88fe-6b522b4d9d74 req-058f40fd-38e7-4d4e-b974-c94bce222191 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056509 Aug 30 18:31:49.287388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1889/3675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:49.312942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:49.314193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:49.323116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:49.323894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:49.324656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:49.325670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:49.326379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:49.326947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:49.462035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:49.476076 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33915dee-2eb1-4cb2-b2bb-6a37aa60f751 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 0.952507 Aug 30 18:31:49.478082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1787/3676] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:48 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:49.679349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:49.680155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:49.687424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:49.695143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:49.695837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:49.696721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:49.697335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:49.700503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:49.709508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:49.999657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:50.017677 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a68f2019-6352-4d52-b9de-dd22c84466e9 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1365 microversion: 2.1 time: 0.711084 Aug 30 18:31:50.020854 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1890/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:49 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1365 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:50.504334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:50.506603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:50.525418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:50.526419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:50.527066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:50.527454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:50.528583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:50.529302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:50.530171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:50.538006 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4366e1ac-4b68-4802-886c-bfe15a17aa08 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.863303 Aug 30 18:31:50.540997 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1788/3678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:49 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:50.668366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:50.669975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:50.677519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:50.678771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:50.679366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:50.680339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:50.681331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:50.682815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:51.180797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:51.191992 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03815ba6-47cc-4b5f-94bd-c4594fe0991a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.528204 Aug 30 18:31:51.198082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1789/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:50 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:51.216558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:51.217180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:51.244447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:51.244959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:51.245399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:51.246120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:51.255513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:51.258174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:51.611261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:51.621496 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3ea1af9-014a-4fe3-afa7-be75e15c9d16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 1.121411 Aug 30 18:31:51.629874 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1891/3680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:50 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:52.053074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:52.074996 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cfe562ed-17e6-4519-a62d-b4a4a9f21370 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1554 microversion: 2.1 time: 0.869902 Aug 30 18:31:52.080817 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1790/3681] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:51 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1554 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:52.099061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:52.099663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:52.110887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:52.114622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:52.116062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:52.117294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:52.120733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:52.121476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:52.334190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f874310-fa84-4933-a9c2-9e12e2557425 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.242968 Aug 30 18:31:52.335164 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1892/3682] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:31:52 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:52.650454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:52.651224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:52.662297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:52.663050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:52.664922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:52.665840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:52.668937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:52.670242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:52.887437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:52.902558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:52.903048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:52.903482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:52.926138 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] Creating event network-vif-unplugged:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:31:52.939773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2e85fc7c-b422-4e1d-99d1-297e0cca37ca req-cfc7faad-4793-4418-bfb4-c6b34cbdf916 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056789 Aug 30 18:31:52.948575 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1893/3683] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:31:53.506298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:53.507790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:53.540147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:53.544060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:53.545050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:53.546903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:53.548915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:53.552826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:53.747283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:53.788047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a3a6a8bd-2ce5-4211-b704-e4c417507a26 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 1.142781 Aug 30 18:31:53.790449 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1791/3684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:52 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:54.396628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:54.411959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c3f862f-47af-4e8e-9408-d1163589d568 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.913832 Aug 30 18:31:54.422503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1894/3685] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:53 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:54.437780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:54.438419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:54.456990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:54.457510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:54.457918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:54.458769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:54.459380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:54.459932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:54.818687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:54.819548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:54.831888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:54.837733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:54.838447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:54.839693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:54.840610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:54.842917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:54.843743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:55.379767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:55.393442 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f68a40d4-3eca-4dca-b8e9-77fec713e698 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 0.578580 Aug 30 18:31:55.395088 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1895/3686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:54 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:55.407275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6141780-70eb-40fa-97bf-011e9712354d", "tag": "64bf4300-d79c-42a6-b9bd-ae3fc1f4680e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:55.443791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:55.444355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:55.447918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:55.484028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] Creating event network-changed:64bf4300-d79c-42a6-b9bd-ae3fc1f4680e for instance c6141780-70eb-40fa-97bf-011e9712354d on n-h2-854119-10 Aug 30 18:31:55.498817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-be06ee23-c450-444f-ae9c-a8c77dbfc5af req-eb0c63cd-45b7-4874-9a76-3c7fcf56a270 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101126 Aug 30 18:31:55.503238 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1896/3687] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:55.529951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:55.550217 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-841e5f6a-ba71-4b5e-a3d0-dbe2caf0e284 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.116165 Aug 30 18:31:55.550836 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1792/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:54 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:31:55.589692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:55.593931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:55.623508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:55.625515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:55.627839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:55.631610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:55.635694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:55.639671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:56.417483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:56.418093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:56.430595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:56.431305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:56.431887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:56.435802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:56.436419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:56.437032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:56.848134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:56.857441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db1cef1b-ca2b-49ee-a1bf-d40791301bb9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 0.443769 Aug 30 18:31:56.862600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1793/3689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:56 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:57.104122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:57.142085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55f3894d-108c-4aac-abd0-38ae3b5a83fd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.566568 Aug 30 18:31:57.144169 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1897/3690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:55 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:57.177805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:57.185442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:57.196597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.197248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.197912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:57.198983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.199672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.200676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:57.441020 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3099ebea-459a-4524-8257-3d3326d836f4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.266004 Aug 30 18:31:57.444693 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1794/3691] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:31:57 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:31:57.454134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:57.456569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:57.467053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.467686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.469966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:57.472551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.473529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.474227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:57.886284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:57.915644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:57.963517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:31:57.980308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.982132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.984469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:57.989197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:57.990272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:57.993100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:58.164549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:58.173308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c557bab-a94f-43c2-9e0e-8334437ba069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1670 microversion: 2.1 time: 0.724330 Aug 30 18:31:58.205697 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1898/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:57 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1670 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:58.211137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89d5899-a4c2-4d8d-9c20-f03eb4da8a89", "name": "network-vif-plugged", "status": "completed", "tag": "5be28d65-c6e8-408f-8114-66ddc6d5df85"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:31:58.250035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:58.257337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:58.261112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:58.299450 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] Creating event network-vif-plugged:5be28d65-c6e8-408f-8114-66ddc6d5df85 for instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 on n-h2-854119-10 Aug 30 18:31:58.317030 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-62ec63c3-c9ec-4804-99cc-ab5fc9247114 req-f292fc80-3ae9-4935-9c09-8833c4dff2dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109856 Aug 30 18:31:58.321962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1899/3693] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:31:59.197087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:31:59.198733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:31:59.208843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:59.213058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:59.213757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:59.214972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:31:59.215446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:31:59.215887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:31:59.404793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:59.421410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d995518-dc5d-448e-a29c-9b2d10a7d706 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 1.540453 Aug 30 18:31:59.422863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1795/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:57 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:31:59.582496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:31:59.617595 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4c4e281-ccbc-421e-95ea-88f6203b485a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1670 microversion: 2.1 time: 0.424264 Aug 30 18:31:59.620797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1900/3695] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:31:59 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1670 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:00.375766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da4b6e-63bb-43e1-b2fd-81b160b04b04", "name": "network-vif-plugged", "status": "completed", "tag": "96398ab4-cc0a-4858-b7af-9e2b54944891"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:00.402916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:00.403784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:00.404002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:00.431780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] Creating event network-vif-plugged:96398ab4-cc0a-4858-b7af-9e2b54944891 for instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 on n-h2-854119-10 Aug 30 18:32:00.446941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:00.448212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:00.464583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:00.465077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:00.465514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:00.466226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:00.466873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ebaec6ee-ec8c-41c1-85d5-70e73e672eb5 req-f5dd3771-a053-4d36-a497-ed49ec6faed8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083726 Aug 30 18:32:00.469601 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1796/3696] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:00.475981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:00.486732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:00.642960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:00.643781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:00.659986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:00.660846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:00.661600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:00.664461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:00.665314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:00.665989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:01.195620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:01.203711 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eec436ff-6962-4a7f-b62d-7eb54c92d41c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 0.760945 Aug 30 18:32:01.218824 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1901/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:00 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:01.359561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:01.373004 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8084d36a-9667-4487-80ef-90be22b28660 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1675 microversion: 2.1 time: 0.734518 Aug 30 18:32:01.377929 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1797/3698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1675 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:02.226457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:02.227465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:02.247996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:02.248502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:02.248939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:02.249704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:02.250171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:02.256560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:02.397426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:02.398115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:02.410625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:02.411120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:02.411554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:02.412266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:02.412725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:02.413145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.170967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:03.195806 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d43e7ef8-7618-41b2-8945-8182aef107a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.801652 Aug 30 18:32:03.211951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1798/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:02 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:03.228513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:03.232513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:03.242673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.243514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.244941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.245933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.246628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.247347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.339812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6e6be8bb-2c8a-4aef-99a0-6d20fb1b7014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 200 len: 322 microversion: 2.1 time: 0.115550 Aug 30 18:32:03.346803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1799/3700] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:32:03 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 322 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:03.355104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:03.356261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:03.366192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.367234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.370498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.371553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.372391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.373023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.531472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:03.545392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c869425d-1585-4643-9384-ec3423b32b16 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1319 microversion: 2.1 time: 1.323750 Aug 30 18:32:03.559440 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1902/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:02 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1319 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:03.723286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:03.739435 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c64c9e8b-f3e0-4388-a9cf-2b003a7b7957 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.391229 Aug 30 18:32:03.750395 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1800/3702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:03.770454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:03.772219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:03.785865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.786808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.787497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:03.788460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:03.789141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:03.790063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.300493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:04.322025 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8434c84d-33cc-454b-b4c1-2a32c89fda83 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.555785 Aug 30 18:32:04.324963 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1903/3703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:04.346636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:04.347759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:04.356256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.357196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.357804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.358814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.359444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.360073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.568912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:04.569540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:04.579374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.579763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.584770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.589647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.590714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.591184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.849201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:04.883152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c06fdbab-9687-4eee-a5d0-72939232b101 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.522866 Aug 30 18:32:04.885449 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1801/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:04 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:04.921003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:04.922654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:04.949767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.952697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.953443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:04.956388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:04.958959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:04.959905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:05.257517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:05.298251 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-282a2211-9e42-4002-a5b8-87a9bea0b197 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.392499 Aug 30 18:32:05.310857 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1802/3705] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:04 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:05.322029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:05.331356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f214b472-9fc4-49a3-b81f-1062116578ed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1469 microversion: 2.1 time: 0.766140 Aug 30 18:32:05.349712 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1904/3706] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:04 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1469 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:05.364680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:05.365316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:05.381882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:05.382528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:05.383059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:05.384126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:05.384602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:05.385921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:05.512649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1696447199", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a43d14fc-4753-4553-8d04-df60af14fa3d"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:05.630074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] validate_networks() for [('a43d14fc-4753-4553-8d04-df60af14fa3d', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:05.681350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:05.689908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1405e5b7-2c9d-4518-b7ac-18a34cb97986 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1469 microversion: 2.1 time: 0.331266 Aug 30 18:32:05.696602 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1803/3707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:05 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1469 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:05.711147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:05.717159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:05.718612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Searching by: {'reservation_id': 'r-oawu12pe', 'deleted': False, 'project_id': 'f690e184dcdf48babd667cff7823cf40'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:32:05.724866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:05.725694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:05.726409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:05.727369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:05.728040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:05.728684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:05.875511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:32:05.882581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:05.973105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:05.983892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:05.984479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:05.984989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.229810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9004299-22a3-445d-bb26-8bb002796f1a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-oawu12pe" status: 200 len: 2931 microversion: 2.1 time: 0.523234 Aug 30 18:32:06.231667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1804/3708] 10.222.0.25 () {58 vars in 1197 bytes} [Tue Aug 30 18:32:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-oawu12pe => generated 2931 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:06.261668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:06.302381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_groups [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Querying cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) for 2 instances {{(pid=122590) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 18:32:06.304080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:06.304906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:06.305661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.356380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ad43058-3cf9-4646-8b8c-cca0ac864a62 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/8edfed3b-258b-427d-a863-3d2573c1eb9e" status: 200 len: 265 microversion: 2.1 time: 0.105971 Aug 30 18:32:06.359164 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1805/3709] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:32:06 2022] GET /compute/v2.1/os-server-groups/8edfed3b-258b-427d-a863-3d2573c1eb9e => generated 265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:06.384084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:06.384903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:06.409090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:06.411960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:06.413201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.414323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:06.415369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:06.420335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.649577 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dc3f2418-92b6-420d-9c17-c513fa3a56e1 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 200 len: 1622 microversion: 2.1 time: 0.283480 Aug 30 18:32:06.665292 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1806/3710] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:06 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 1622 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:06.676960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:06.677935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:06.686155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:06.686711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:06.687360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.688308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:06.688968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:06.689464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:06.953590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-113271a5-014b-4555-9a06-64b383a0e22b tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1622 microversion: 2.1 time: 0.281846 Aug 30 18:32:06.955711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1807/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:06 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1622 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:06.979132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: .version_select at 0x7f4e5667b4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-841624215", "policies": ["anti-affinity"]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:07.003251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:07.009469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:07.101489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:07.127659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_groups'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:07.150866 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a42eb38e-7e9a-49b4-9ec8-4d9c559e13f4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.170926 Aug 30 18:32:07.154811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1808/3712] 10.222.0.25 () {60 vars in 1174 bytes} [Tue Aug 30 18:32:06 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:07.440133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1487870318", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5d24059d-529d-461a-b25e-db8ed0928cd7"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:07.507514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:07.661301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:07.662374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:07.663003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:07.663636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:07.664048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:07.686380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:07.687102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:07.687757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:07.688717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:07.689502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:07.690316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:07.735208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:07.747868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:07.777571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:07.791543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:07.924368 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4fa40863-c136-4a64-adbe-282db84fb4bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419206 Aug 30 18:32:07.932158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1905/3713] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:32:07.939049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4538eaec-fb4e-42c9-8203-59929359b439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:07.940321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4538eaec-fb4e-42c9-8203-59929359b439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:08.053799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:08.054665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:08.054951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:08.055582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:08.056294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:08.097883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:08.102381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:08.102923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:08.104483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:08.104962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:08.105385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:08.160273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:08.190809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:08.267718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 2 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:08.270859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:08.429408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:08.451629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:08.470952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4538eaec-fb4e-42c9-8203-59929359b439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:08.483008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4538eaec-fb4e-42c9-8203-59929359b439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1215 microversion: 2.1 time: 0.549074 Aug 30 18:32:08.492293 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1906/3714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:07 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1215 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:08.531633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:08.547003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:08.585895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=417bb94f-0d75-48ab-9cc2-69cfcd49ca80,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:08.683953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:08.751296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:08.773014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:08.885256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:08.894059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'server_group_members'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:08.966170 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af52d871-f311-432a-a5da-8823c71491cb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.530177 Aug 30 18:32:08.970013 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1809/3715] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 18:32:08.989993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:09.006596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:09.009287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Searching by: {'deleted': False, 'project_id': 'f690e184dcdf48babd667cff7823cf40'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:32:09.095951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.109707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.113316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.119583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.122963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.126542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.215651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:32:09.297682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:09.306060 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7839ea24-35f7-4acd-833d-8937765d8fad tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.333449 Aug 30 18:32:09.307953 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1907/3716] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:32:08 2022] GET /compute/v2.1/servers => generated 1665 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:09.331311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06af3a32-d6bb-4936-93e8-32db01ddd2dd tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:09.332702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06af3a32-d6bb-4936-93e8-32db01ddd2dd tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:09.515052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:09.515751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:09.527190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.527686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.528125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.528836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:09.529290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:09.529714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:09.538192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06af3a32-d6bb-4936-93e8-32db01ddd2dd tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:09.548716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06af3a32-d6bb-4936-93e8-32db01ddd2dd tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1219 microversion: 2.1 time: 0.225845 Aug 30 18:32:09.551084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1810/3717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:09 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1219 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:09.796200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:09.816096 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba6e5974-a234-419e-945f-de7773b92895 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1267 microversion: 2.1 time: 0.314533 Aug 30 18:32:09.817642 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1908/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:09 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:10.576174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82532cf9-7a31-42f7-8d0f-5f44ebf0957d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:10.577605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-82532cf9-7a31-42f7-8d0f-5f44ebf0957d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:10.840658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:10.841677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:10.858774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:10.860415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:10.863518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:10.865693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:10.870441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:10.871513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:11.016779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82532cf9-7a31-42f7-8d0f-5f44ebf0957d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:11.076007 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82532cf9-7a31-42f7-8d0f-5f44ebf0957d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1219 microversion: 2.1 time: 0.496332 Aug 30 18:32:11.077249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1811/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:10 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1219 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:11.107539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:11.121545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-649a9365-c9d7-42e8-86ed-b2974dee60ec tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1273 microversion: 2.1 time: 0.285151 Aug 30 18:32:11.134764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1909/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:10 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:12.105689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:12.107994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:12.123637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.128682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.129440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.130899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.131995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.132690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.144260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:12.144958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:12.153784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.154281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.154757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.155512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:12.155990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:12.156412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:12.543829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:12.557988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-792e2adf-6017-4e67-bb26-b77d16bb211b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1271 microversion: 2.1 time: 0.464448 Aug 30 18:32:12.559332 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1812/3721] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:12 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1271 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:12.715814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:12.728991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f9e8eb5-a174-469b-986d-649ce6f90cb3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1273 microversion: 2.1 time: 0.588812 Aug 30 18:32:12.742377 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1910/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:12 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:13.593594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:13.604126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:13.640453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.655838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.666845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:13.668724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.670083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.671356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:13.758681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:13.759874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:13.791814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.793698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.796953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:13.799352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:13.801581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:13.805134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:14.210931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:14.271309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2faee108-973f-4d43-9ea6-8519f2e3fe15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1273 microversion: 2.1 time: 0.523528 Aug 30 18:32:14.272721 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1911/3723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:13 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1273 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:14.476382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:14.488468 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7b6947b-7c9a-44e7-8884-0736b1761e97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1277 microversion: 2.1 time: 0.905203 Aug 30 18:32:14.491102 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1813/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:13 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1277 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:15.307207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:15.308058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:15.321530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.324118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.325351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.326640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.330694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.331440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.513662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:15.514883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:15.531480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.532386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.533243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.535846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:15.536524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:15.537126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:15.737787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:15.790574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1d7c7d2-0f5a-424c-8669-1b4fa7f809e9 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1277 microversion: 2.1 time: 0.277254 Aug 30 18:32:15.808621 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1814/3725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:15 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1277 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:16.152208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:16.164600 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da17f63f-272a-4e0c-9f82-53090669153c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.863641 Aug 30 18:32:16.166751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1912/3726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:15 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:16.842949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:16.855078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:16.914017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.914872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.915633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:16.916578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:16.921707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:16.923436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:17.139644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:17.162831 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3407acfb-b0ce-4dfa-9621-d6b41ae8dbf1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1277 microversion: 2.1 time: 0.334371 Aug 30 18:32:17.182017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1815/3727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:16 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1277 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:17.191718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:17.192483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:17.209871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:17.212490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:17.213209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:17.216434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:17.217150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:17.217684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:17.537196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6db648-5a14-4bb5-b2db-52c22e357bf8", "tag": "42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:17.561415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:17.561906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:17.562387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:17.620070 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] Creating event network-changed:42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab for instance df6db648-5a14-4bb5-b2db-52c22e357bf8 on n-h1-854119-10 Aug 30 18:32:17.640887 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c0a44cbe-fd1f-417e-98cc-0a9b74e0485f req-e8df9e83-20b2-4747-9e27-c27f8fdf88b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107547 Aug 30 18:32:17.648024 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1816/3728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:18.194373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:18.195158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:18.211695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:18.215460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:18.216977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:18.217434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:18.218171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:18.218664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:18.219093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:18.476797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:18.925298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:18.957926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a0bec48-abe3-4cd6-ad1e-00cd264b13e4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.767052 Aug 30 18:32:18.960202 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1817/3729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:18 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:19.173895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:19.401388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:19.432497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1caba831-7ab6-425c-a3b1-d8c9614fb78b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 2.249062 Aug 30 18:32:19.446430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1913/3730] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:17 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:19.980345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:19.981332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:20.001117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:20.001880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:20.002588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:20.003420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:20.006037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:20.007131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:20.463206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:20.464000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:20.521955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:20.523219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:20.525559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:20.533222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:20.534373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:20.536091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:20.677250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:20.695336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca420e49-944a-4b20-a604-31392c729e55 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.718329 Aug 30 18:32:20.696953 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1818/3731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:19 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:20.914098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417bb94f-0d75-48ab-9cc2-69cfcd49ca80", "tag": "cbafb664-e868-43e8-8f2d-250f3e40b12d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:20.934155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:20.935078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:20.935957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:20.955588 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] Creating event network-changed:cbafb664-e868-43e8-8f2d-250f3e40b12d for instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 on n-h1-854119-10 Aug 30 18:32:20.962734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-041d3df5-143d-488f-b343-fe6bb5f14661 req-8eecf2ea-ab6d-4497-b132-679eab618e37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052515 Aug 30 18:32:20.964125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1819/3732] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:21.114859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:21.129069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a71908d-5dc7-4d9c-9cbc-559a9a0b0772 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.672110 Aug 30 18:32:21.134803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1914/3733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:20 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:21.715370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=36 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:21.726823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:21.729924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:21.747408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:21.755697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:21.759711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:21.764344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:21.770083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:21.772641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:22.153952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:22.154956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:22.178893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:22.179434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:22.185480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:22.185909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:22.188784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:22.189251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:22.409065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:22.422305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-619fcf4d-6353-4061-afae-06ae709805b2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.708755 Aug 30 18:32:22.423056 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1820/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:21 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:22.668758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:22.683171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ff43c2d-dbcb-4e53-a4b4-3a0854411991 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.533780 Aug 30 18:32:22.687695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1915/3735] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:22 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:23.456271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:23.457605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:23.505083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:23.510895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:23.511924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:23.513986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:23.517127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:23.519028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:23.715072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:23.722264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:23.739860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:23.748792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:23.749838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:23.750858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:23.753662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:23.755132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:24.289747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:24.299264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb3558af-4019-4a49-bf1d-a39137b41ae4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.587864 Aug 30 18:32:24.303515 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1916/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:23 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:25.052605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:25.069877 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-597da418-17dd-427c-80d5-89b210e411a1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 1.626157 Aug 30 18:32:25.074839 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1821/3737] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:23 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:25.325135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:25.325845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:25.336943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:25.341351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:25.341865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:25.342474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:25.347621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:25.348126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:25.348578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:25.670412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:25.682371 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cea8a4d9-4743-4c15-9a49-76df7ab8c177 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.361197 Aug 30 18:32:25.683684 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1917/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:25 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:26.008827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6379754-2b76-4a5e-b182-fc33a1ddfffe", "tag": "1ed730c5-4b85-47ec-a4d6-8540dc811942"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:26.079130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:26.087798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:26.088899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:26.094440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:26.096213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:26.112266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:26.112769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:26.113210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:26.113927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:26.136568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:26.137798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:26.158891 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] Creating event network-changed:1ed730c5-4b85-47ec-a4d6-8540dc811942 for instance f6379754-2b76-4a5e-b182-fc33a1ddfffe on n-h2-854119-10 Aug 30 18:32:26.181931 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a388c04c-36c2-47db-8861-378cbc50c676 req-fff54330-0e40-4ee2-b808-fee9fc517b48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178320 Aug 30 18:32:26.191082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1822/3739] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:26.641607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:26.657000 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f18009d9-5f04-4fbd-9d04-f4ac5b7e5179 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.564946 Aug 30 18:32:26.659538 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1918/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:26 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:26.705659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:26.706314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:26.724192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:26.724904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:26.725509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:26.733828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:26.734669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:26.735282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:27.679790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:27.681996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:27.695771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:27.696588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:27.697034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:27.698598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:27.699280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:27.702360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:27.743941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:27.761110 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-819101d1-c8f5-4020-9bdc-b5351413d71d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 1.060411 Aug 30 18:32:27.771279 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1823/3741] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:26 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:28.003750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:28.023910 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a6052c0-e219-4ffa-80b7-ef3f1256fd39 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.348743 Aug 30 18:32:28.030585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1919/3742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:27 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:28.107133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6db648-5a14-4bb5-b2db-52c22e357bf8", "name": "network-vif-plugged", "status": "completed", "tag": "42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:28.124515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:28.129504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:28.130050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:28.169156 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] Creating event network-vif-plugged:42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab for instance df6db648-5a14-4bb5-b2db-52c22e357bf8 on n-h1-854119-10 Aug 30 18:32:28.176372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9d5b9675-b128-4ced-a6d6-870a269d7382 req-ca939fe8-3a20-4b03-9234-6a824df12750 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074047 Aug 30 18:32:28.177330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1920/3743] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:28.641139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c3c08bf-0eff-4df7-be0d-773db8995011 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Action: 'create', calling method: .version_select at 0x7f4e55ae75e0>, body: {"keypair": {"name": "tempest-keypair-1046466047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf5BQTs6E+LJ7HF+OcjT5OoIyyHwa5PErIPT79hIup7aN9lUn6w4mfU/6X9NppGSGuV3uNlaMYmlrJy8wmWUyBfE4ArcVDhCmfc5Sk5SxkR6+UCYCKyHqQ5AjhcK+z+kw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:28.713053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3c3c08bf-0eff-4df7-be0d-773db8995011 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for project a3efb6dadcab4522b744e5ebce3182c8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:28.740718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-3c3c08bf-0eff-4df7-be0d-773db8995011 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for user 370732fe6b264874aea3eb4df9789733 and project a3efb6dadcab4522b744e5ebce3182c8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:28.787530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:28.788877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:28.809215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:28.810602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:28.811259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:28.814427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:28.816020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:28.820431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:28.824165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c3c08bf-0eff-4df7-be0d-773db8995011 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.994122 Aug 30 18:32:28.836529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1824/3744] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:32:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:29.050400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:29.051027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:29.062268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.073193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.073671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.074479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:29.074958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:29.075393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:29.458264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:29.476587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8eced8b4-554a-463e-97c5-159e636ab1ed tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1315 microversion: 2.1 time: 0.695540 Aug 30 18:32:29.478093 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1921/3745] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:28 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:30.030211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:30.040475 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fee37c7b-9f62-4554-842f-20eff53aa54a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.994020 Aug 30 18:32:30.051932 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1825/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:29 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:30.224249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:30.224764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:30.259266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.259895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.262621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.264239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.269655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.272659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.351826 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3067e283-14d7-4e08-9564-29372f609839 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/ips" status: 200 len: 149 microversion: 2.1 time: 0.132169 Aug 30 18:32:30.374055 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1922/3747] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:32:30 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/ips => generated 149 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:30.501313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:30.502121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:30.529022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.529706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.530155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.533856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.534372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.536492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:30.907391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:30.918915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-152373cf-b3c8-43d2-815f-c6ef0b74134b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1502 microversion: 2.1 time: 0.421412 Aug 30 18:32:30.921178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1826/3748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:30 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:30.941591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:30.959974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:30.960492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:30.961521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.041239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:32:31.073337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:31.074624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:31.095062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.096108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.114376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.115160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.127236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.128183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.202723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48361751-cc6e-47f2-a831-ba317bb25005 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8/action" status: 202 len: 0 microversion: 2.1 time: 0.263884 Aug 30 18:32:31.206440 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1923/3749] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:32:30 2022] POST /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:32:31.252606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:31.262781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:31.280345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.280865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.281310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.282109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.282583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.283701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.370379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:31.668485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:31.680836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:31.701607 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e130fdde-0fe2-48c1-b111-ea1f8ee8b5ca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.631333 Aug 30 18:32:31.704784 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1827/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:31 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:31.716539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417bb94f-0d75-48ab-9cc2-69cfcd49ca80", "name": "network-vif-plugged", "status": "completed", "tag": "cbafb664-e868-43e8-8f2d-250f3e40b12d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:31.748809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:31.752789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:31.754598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:31.789777 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] Creating event network-vif-plugged:cbafb664-e868-43e8-8f2d-250f3e40b12d for instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 on n-h1-854119-10 Aug 30 18:32:31.809167 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3a17dd06-d55a-4893-bd33-4560a77902a5 req-4766a329-28d3-46ef-87e6-fc809bc13f5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098341 Aug 30 18:32:31.810271 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1828/3751] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:31.931461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:31.950078 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99522682-57cb-40c1-87ca-fea4b9d546d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.723396 Aug 30 18:32:31.953393 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1924/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:31 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:32.727573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:32.728929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:32.761659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.763043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.764814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:32.768728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.770114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.776892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:32.975561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:32.976167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:32.997040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.997556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.997996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:32.998769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:32.999222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:32.999645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:33.697047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:33.714695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3191d655-7505-4f3d-be86-44da553a01ea tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.992086 Aug 30 18:32:33.716360 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1829/3753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:32 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:33.730184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e76724-2247-46c4-8d95-bc18d5d55508"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:33.736263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:33.748124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:33.748807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:33.749416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:33.750678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:33.751379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:33.752882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:33.795278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:33.805512 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7db1520e-b983-447c-a079-ec008cd953c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.835355 Aug 30 18:32:33.806110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1925/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:32 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:34.207908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c71dafd-4b79-4b7d-a67d-affd5de5b4f6 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490095 Aug 30 18:32:34.208820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1830/3755] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:32:33 2022] POST /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:34.740915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:34.741737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:34.755506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:34.762041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:34.762657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:34.764648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:34.766435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:34.767482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:34.828753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:34.829586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:34.853223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:34.853693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:34.854133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:34.874205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:34.879937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:34.880558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:35.215451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:35.231224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67637e1b-743d-4f68-a911-ca080812ea46 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.493822 Aug 30 18:32:35.243242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1926/3756] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:34 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:35.991752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6379754-2b76-4a5e-b182-fc33a1ddfffe", "name": "network-vif-plugged", "status": "completed", "tag": "1ed730c5-4b85-47ec-a4d6-8540dc811942"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:36.010199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:36.010804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:36.014037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:36.039056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] Creating event network-vif-plugged:1ed730c5-4b85-47ec-a4d6-8540dc811942 for instance f6379754-2b76-4a5e-b182-fc33a1ddfffe on n-h2-854119-10 Aug 30 18:32:36.054113 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-597d34ee-d930-4493-b776-f5969eaf94f9 req-6f53881a-395e-4829-bcb3-fab6789de130 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066623 Aug 30 18:32:36.054867 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1927/3757] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:36.077675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:36.099426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-197da006-0f35-43cf-a14a-1a4093ddf163 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 1.269913 Aug 30 18:32:36.122078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1831/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:34 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:36.254156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:36.254963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:36.272524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:36.273380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:36.274024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:36.275055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:36.275809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:36.276448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:36.791085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:36.804958 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e0171aa-a31d-4e28-8779-9993d97ae4fe tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.555238 Aug 30 18:32:36.837185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1928/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:36 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:37.121275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:37.122811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:37.141065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:37.142501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:37.143234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:37.144202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:37.150760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:37.151662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:37.386486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-96846880", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "38df2c76-7f1a-45c5-9bbb-fcb26e7d84bf"}], "security_groups": [{"name": "tempest-securitygroup--1614024260"}], "key_name": "tempest-keypair-1046466047", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:37.453764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:37.475481 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5fad1b9f-1872-4548-974d-a2c3ec1956a8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.358728 Aug 30 18:32:37.489411 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1832/3760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:37 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:37.831757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:37.832373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:37.842227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:37.854313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:37.854996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:37.855639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:37.856184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:37.856524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.169129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:38.181278 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32a496b3-1aac-432e-acb4-7b69379325a2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1319 microversion: 2.1 time: 0.350629 Aug 30 18:32:38.197507 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1833/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:37 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:38.275519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] validate_networks() for [('38df2c76-7f1a-45c5-9bbb-fcb26e7d84bf', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:38.496966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:38.497864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:38.507862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.515177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.516004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.517335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:38.517986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:38.518707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:38.772168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:38.792558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:38.825983 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-067743f4-e596-438f-aac5-d9158a032ec6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.332918 Aug 30 18:32:38.846697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1834/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:38 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:39.207416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:39.208007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:39.222530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=86 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:39.226733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.228251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.229034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.232467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.246212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.247643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.488110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:39.496579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0365c131-a6c1-46a3-8261-8532bc26b77f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1468 microversion: 2.1 time: 0.296150 Aug 30 18:32:39.498877 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1835/3763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:39 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:39.520002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:39.520873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:39.527806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.528855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.529459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.530325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.530955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.531525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.807047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:39.828777 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c08abfe-a768-44c6-9bbd-d1e9788f9700 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 200 len: 1468 microversion: 2.1 time: 0.302696 Aug 30 18:32:39.833624 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1836/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:39 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:39.865245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:39.875606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:39.885362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.888333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.893513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:39.894287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:39.894807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:39.895697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.054329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for project a3efb6dadcab4522b744e5ebce3182c8. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:40.064010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for user 370732fe6b264874aea3eb4df9789733 and project a3efb6dadcab4522b744e5ebce3182c8. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:40.083701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:40.084379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:40.085048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:40.085698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:40.086329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:40.103518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.104609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:40.106142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.107178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.107872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:40.108555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.137236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for project a3efb6dadcab4522b744e5ebce3182c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:40.145473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Getting quotas for user 370732fe6b264874aea3eb4df9789733 and project a3efb6dadcab4522b744e5ebce3182c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:40.161925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:40.165596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:40.239725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-361e9e4e-3cba-4522-8c3d-2f9fc1f803c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.857802 Aug 30 18:32:40.245040 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1929/3765] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:37 2022] POST /compute/v2.1/servers => generated 407 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:32:40.260009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:40.269112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:40.270690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Searching by: {'reservation_id': 'r-xlqizy06', 'deleted': False, 'project_id': 'f690e184dcdf48babd667cff7823cf40'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:32:40.279254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.281209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:40.282693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.284264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.284937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:40.285554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.415334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:32:40.504223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:40.523433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:40.524538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:40.525021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:40.541567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:40.551622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6eb738d8-d64b-437b-842f-c9d85b8eca37 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.703719 Aug 30 18:32:40.556357 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1837/3766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:39 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:40.568370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d730dd3c-bdcd-49b8-9d7b-f204aade7b18 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:40.574535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d730dd3c-bdcd-49b8-9d7b-f204aade7b18 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:40.801464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d730dd3c-bdcd-49b8-9d7b-f204aade7b18 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:40.821183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d730dd3c-bdcd-49b8-9d7b-f204aade7b18 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1268 microversion: 2.1 time: 0.263298 Aug 30 18:32:40.834393 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1838/3767] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:40 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1268 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:40.956414 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99a99992-1a80-4b30-91cc-2d0846f8d1d7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-xlqizy06" status: 200 len: 2929 microversion: 2.1 time: 0.709822 Aug 30 18:32:40.957421 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1930/3768] 10.222.0.25 () {58 vars in 1197 bytes} [Tue Aug 30 18:32:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xlqizy06 => generated 2929 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:40.987158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.081871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_groups [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Querying cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) for 2 instances {{(pid=122590) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 18:32:41.086255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.087189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.091072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.154709 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-19c1ec49-fc96-46f4-80f0-f383019f722a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/5d24059d-529d-461a-b25e-db8ed0928cd7" status: 200 len: 270 microversion: 2.1 time: 0.172322 Aug 30 18:32:41.156061 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1839/3769] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:32:40 2022] GET /compute/v2.1/os-server-groups/5d24059d-529d-461a-b25e-db8ed0928cd7 => generated 270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:41.166935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.168174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:41.191111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.193525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.194573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.201366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.206365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.211479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.576925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.578284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:41.603400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.603749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61518a35-8576-4f35-8302-9601c00fdaca tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 200 len: 1621 microversion: 2.1 time: 0.437711 Aug 30 18:32:41.605687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.610264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.612569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.613934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.617244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.627502 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1931/3770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:41 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 1621 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:41.636789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.637880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:41.661411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.662264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.662905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.663865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.664533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.665164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.939360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e30301f-8318-4c23-8ac4-d31b4c3dd6d5 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 200 len: 1621 microversion: 2.1 time: 0.310222 Aug 30 18:32:41.941058 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1932/3771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:41 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 1621 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:41.945960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:41.946891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:41.953966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.955155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.956077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:41.957039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:41.957766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:41.958552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.109672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:42.122988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32ac55eb-1ee2-4de3-be08-72b59a42a1e5 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1264 microversion: 2.1 time: 0.180500 Aug 30 18:32:42.123584 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1933/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:41 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:42.192881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1638447592", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "50a24854-c37f-424f-b14c-1f7350b34928"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:42.360293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:32:42.420914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:42.429287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1dba669b-570e-4554-8b65-ce1a7477b128 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.857810 Aug 30 18:32:42.445764 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1840/3773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:41 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:42.943753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:32:42.944316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:32:42.944858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:32:42.945278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:32:42.946330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:32:42.973719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.975153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.978332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:42.979187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:42.980219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:42.981811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.025344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:32:43.037262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:32:43.056949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:32:43.059791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:32:43.138181 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0483b6da-b21d-4b00-b005-50e9877ef6e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945966 Aug 30 18:32:43.146785 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1934/3774] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:32:43.153250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:43.155176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:43.160196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-111f2e00-4dc2-44a7-80db-97f9e792437a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:43.161022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-111f2e00-4dc2-44a7-80db-97f9e792437a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:43.195481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.201131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.201691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.202498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.206373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.212702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.369638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-111f2e00-4dc2-44a7-80db-97f9e792437a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:43.408879 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-111f2e00-4dc2-44a7-80db-97f9e792437a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1217 microversion: 2.1 time: 0.254183 Aug 30 18:32:43.428876 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1935/3775] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:43 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:43.455853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:43.456828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:43.476833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:43.491160 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77e186dc-585d-4cd7-9b5a-1b6cf8449f78 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1320 microversion: 2.1 time: 0.341554 Aug 30 18:32:43.491759 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1841/3776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:43 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:43.493951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.494530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.498992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.499941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:43.500352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:43.501009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:43.805014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:43.824697 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ef142d6-9c98-4911-bf3d-fd21e95e7d9a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.375138 Aug 30 18:32:43.826918 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1936/3777] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:43 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:44.439775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:44.442154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:44.463960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.464835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.465536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.470068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.470900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.471622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.512133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:44.515086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:44.537956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.539193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.540122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.545149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.546923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.547468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.715741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:44.729193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08799599-e170-4645-a851-2bfa394b22b4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1221 microversion: 2.1 time: 0.297482 Aug 30 18:32:44.744444 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1842/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:44 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:44.775216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:44.788807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b51bf50d-75cd-46d0-a771-0accbfd71544 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1326 microversion: 2.1 time: 0.279960 Aug 30 18:32:44.803671 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1937/3779] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:44 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1326 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:44.849369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:44.850327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:44.901066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.901837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.905350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:44.906465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:44.907610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:44.908242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.510970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:45.541731 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-29642ae9-b7f8-4e47-962a-3d47063e3b20 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.694725 Aug 30 18:32:45.544222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1843/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:44 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:45.760295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:45.762852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:45.785351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.786124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.789959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.791190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.792168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.792757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.824726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:45.825725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:45.840499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.841350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.841984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.842990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:45.844295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:45.845012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:45.961386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:45.979130 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3a36040-c99c-425f-9505-f041b9af3098 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1269 microversion: 2.1 time: 0.227632 Aug 30 18:32:45.981938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1938/3781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:45 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:46.047018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:46.069569 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b1698e0-799b-42b5-abb0-2260729e94e6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1326 microversion: 2.1 time: 0.248980 Aug 30 18:32:46.081270 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1844/3782] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:45 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:46.571962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:46.572800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:46.598233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:46.598825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:46.599269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:46.600002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:46.600462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:46.600974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.013837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:47.014493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:47.029344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.037565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.038232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.039038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.039679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.040263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.100510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:47.281469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:47.294301 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6809be1e-6838-48f4-b96f-a52781720d2a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1275 microversion: 2.1 time: 0.284243 Aug 30 18:32:47.297307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1845/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:47 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:47.305507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:47.307805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:47.337536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.345821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.346284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.351239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:47.352097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:47.352874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:47.376590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:47.385987 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-879cbd6d-232b-40de-b291-562240e16207 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.819132 Aug 30 18:32:47.386607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1939/3784] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:46 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:47.974959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:47.988648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1728ea8-31e1-4ba0-a8c8-ab7ff4e7c3bb tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.690059 Aug 30 18:32:47.989936 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1846/3785] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:47 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:48.320385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:48.321548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:48.335064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.335891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.336545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.338648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.341389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.342064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.407808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:48.408362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:48.431880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.432363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.432798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.436586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:48.445555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:48.446143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:48.883261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:48.894939 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a9e870a-b893-4c12-9030-97d169619364 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.578554 Aug 30 18:32:48.898963 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1940/3786] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:48 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:49.011309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:49.013522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:49.026032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.028050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.028755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.033969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.034937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.035592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.070449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:49.082959 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d65c72ba-914e-48d1-9c54-0f07a17b41c0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.675341 Aug 30 18:32:49.083993 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1847/3787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:48 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:49.493316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d71d5-a60a-42dd-86b2-cd5e613546b2", "tag": "c90042fd-db84-4529-963d-3dbd56bbf14c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:49.516304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.517489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.517927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.570370 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] Creating event network-changed:c90042fd-db84-4529-963d-3dbd56bbf14c for instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 on n-h2-854119-10 Aug 30 18:32:49.599908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-af1425d3-f2ea-4a54-9a17-d9c0d6b7995d req-e76259e5-d4b2-4523-8e36-7677f17b647f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110205 Aug 30 18:32:49.600765 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1848/3788] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:49.607962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:49.623598 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89e8ceaa-d73f-4ed2-9c3a-7c3a6d98b459 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.616040 Aug 30 18:32:49.626971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1941/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:49 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:49.924256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:49.925333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:49.979958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.981059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.985492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:49.989348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:49.993366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:49.994075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.106553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141ee28c-a38d-41e0-b219-f9047c629b3c", "tag": "d1641c66-89db-4cbd-9a29-efd2cfc37622"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:50.127452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.128232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.129318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.152360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] Creating event network-changed:d1641c66-89db-4cbd-9a29-efd2cfc37622 for instance 141ee28c-a38d-41e0-b219-f9047c629b3c on n-h2-854119-10 Aug 30 18:32:50.159658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f0f6361f-d4eb-40c7-aaa8-de95d6de498c req-850fe5ac-94f4-4e08-a914-15d4255cc175 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067528 Aug 30 18:32:50.162263 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1942/3790] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:50.174790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:50.175857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:50.184979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.185789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.186469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.187339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.188025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.188675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.597908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:50.616994 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-94529eb5-a5d1-4ae5-82c2-f6ff81a9ca0d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.452009 Aug 30 18:32:50.619695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1943/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:50 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:50.650056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:50.650975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:50.658064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.659201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.659936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.661350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.662088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.665876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.671065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:50.729803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:50.744334 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5be9840-95e8-4727-959d-09c8b9aec6f3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.827951 Aug 30 18:32:50.747503 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1849/3792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:49 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:50.948039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e76724-2247-46c4-8d95-bc18d5d55508"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:50.951425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:50.960450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:50.963415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.964427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.965363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:50.966473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:50.967450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:50.968388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.134656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:51.152109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-192081b3-3179-4cda-a520-855034e623c0 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.505456 Aug 30 18:32:51.152821 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1944/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:50 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:51.187192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments HTTP/1.1 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 74 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: {"volumeAttachment": {"volumeId": "c9e76724-2247-46c4-8d95-bc18d5d55508"}} Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': 'c6141780-70eb-40fa-97bf-011e9712354d', 'body': {'volumeAttachment': {'volumeId': 'c9e76724-2247-46c4-8d95-bc18d5d55508'}}} Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:32:51.203779 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 400 to user: Invalid volume: volume c9e76724-2247-46c4-8d95-bc18d5d55508 is already attached to instances: c6141780-70eb-40fa-97bf-011e9712354d {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:32:51.208396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b502415-5bf3-4381-99ff-b4b47179e7e0 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.264362 Aug 30 18:32:51.216665 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1850/3794] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:32:50 2022] POST /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:32:51.314773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.315161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.326895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.329324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.329830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.330921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.333578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.337208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.443807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'services' on Instance uuid c6141780-70eb-40fa-97bf-011e9712354d {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:32:51.575951 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9b79258-429e-4cb8-bb95-f768b90fab41 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments/c9e76724-2247-46c4-8d95-bc18d5d55508" status: 202 len: 0 microversion: 2.1 time: 0.266383 Aug 30 18:32:51.578323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1945/3795] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:32:51 2022] DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments/c9e76724-2247-46c4-8d95-bc18d5d55508 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:32:51.591340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.594027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.612224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.614535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.616715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.617894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.620835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.621473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.641768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.643610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.645920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:51.660440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.661590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.663151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.664867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.666769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.668906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.696409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b3c9c46b-33ef-4181-94ee-686a0f3b66b8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112399 Aug 30 18:32:51.697387 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1851/3796] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:51 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:51.769144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:51.769832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:51.782115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.783970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.784953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.786845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:51.787322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:51.789972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:51.958992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:51.971701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-921ede5c-503a-4592-a3cb-98ca13819edb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.335554 Aug 30 18:32:51.973569 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1946/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:51 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:52.143195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:52.151523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9981f83-0605-4ce7-beb8-3eaf53871540 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.387562 Aug 30 18:32:52.152623 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1852/3798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:51 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:52.175703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:52.176361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:52.193838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.194395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.197281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.198033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.200562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.201175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.552830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:52.561609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43c6f1d7-1ca9-416d-9230-51d9c3f46cba tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.389962 Aug 30 18:32:52.562504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1947/3799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:52 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:52.712754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:52.714999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:52.734445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.734736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.735247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.735987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:52.736554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:52.737046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:52.777757 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a392b8d9-8918-4bab-b3d2-05a680c96321 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068668 Aug 30 18:32:52.779060 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1853/3800] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:52 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:53.012862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:53.014803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:53.037269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:53.046309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.047726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.048296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.052644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.056292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.060002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.179260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:53.179892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:53.187924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.188422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.188860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.190044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.190044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.190730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.406438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=20 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:53.508174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:53.524607 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a56bf27c-059b-43c3-8c7f-58c39b3fa9a3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.533157 Aug 30 18:32:53.540792 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1948/3801] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:52 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:53.585034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:53.588107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:53.603605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.604548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.605262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.606229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.609924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.611026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.886557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:53.900911 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd7bf4e8-35e0-4cac-bc6b-b6705ba27dae tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.316187 Aug 30 18:32:53.900911 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1949/3802] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:53 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:53.905948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:53.908652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:53.917776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.918604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.919884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.922123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:53.923665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:53.924329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:53.956613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:53.971950 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2ae1727-8829-44fd-8c08-66de452f18f2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.802087 Aug 30 18:32:53.973694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-938a423a-4cae-4cd1-aaf6-dccf0677a954 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075806 Aug 30 18:32:53.976530 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1854/3804] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:53 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:53.979581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1950/3804] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:53 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:54.554741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:54.555366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:54.565543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:54.566046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:54.571799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:54.576177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:54.576773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:54.577305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:54.921983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:54.923596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:54.940822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:54.953113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:54.954859 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98a89b8b-8677-4c3c-adfe-06e16ff89ac0 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.400522 Aug 30 18:32:54.955967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1855/3805] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:54 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:54.957012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:54.957153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:54.964553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:54.965485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:54.970072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:54.988776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:54.993717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:55.017365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:55.018473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:55.023180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:55.024212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:55.024854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:55.025698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:55.096353 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12a343df-8ce9-4224-8e6a-2be1c8a71fae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113256 Aug 30 18:32:55.109681 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1856/3806] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:54 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:55.122374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:55.123194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:55.137486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:55.138198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:55.138811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:55.142197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:55.142896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:55.143804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:55.335221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:55.349784 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c08861f7-b7f3-4562-b2ce-150540a02589 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.238074 Aug 30 18:32:55.351772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1857/3807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:55 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:55.633245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:55.642305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6922eb61-a225-429d-a1bf-515a000a372a tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.727272 Aug 30 18:32:55.658423 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1951/3808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:54 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:55.980031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:55.982160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:56.031042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.035543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.039870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.044062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.051148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.054400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.120169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:56.135279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:56.190016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.195593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.197962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.207223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.208710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.209869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.308097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c143565-83e3-4199-89fb-267b7cf2ae2e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194688 Aug 30 18:32:56.310636 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1952/3809] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:56 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:56.379758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:56.384794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:56.412166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.413755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.414807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.416604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.423982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.425354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.692294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:56.703783 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0e81d9f-bd51-464a-8761-a35f79c10b93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.730034 Aug 30 18:32:56.705189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1858/3810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:55 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:56.711599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:56.712839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:56.725468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.726222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.726887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:56.727813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:56.728736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:56.729324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:57.141911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:57.153555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9d96190-b7be-4d65-b425-f6de74fa2635 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.446494 Aug 30 18:32:57.167034 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1859/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:56 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:57.324164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:57.327249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:57.343498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:57.347510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:57.348340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:57.349327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:57.350025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:57.353997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:57.429985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3abfc114-6d17-49f9-8ae7-46a878909c0f tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110623 Aug 30 18:32:57.446585 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1860/3812] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:57 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:57.451621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141ee28c-a38d-41e0-b219-f9047c629b3c", "name": "network-vif-plugged", "status": "completed", "tag": "d1641c66-89db-4cbd-9a29-efd2cfc37622"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:57.496877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:57.499799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:57.501617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:57.528407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] Creating event network-vif-plugged:d1641c66-89db-4cbd-9a29-efd2cfc37622 for instance 141ee28c-a38d-41e0-b219-f9047c629b3c on n-h2-854119-10 Aug 30 18:32:57.548601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-be414b4d-48a5-48d1-9df2-3ee5d545265c req-e69beb67-b97c-4e6e-bc8c-b4365eb0b297 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099876 Aug 30 18:32:57.554470 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1861/3813] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:57.705221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:57.719573 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c2205fb1-c170-4bc6-8b34-8eba6ae836ef tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 1.345433 Aug 30 18:32:57.725595 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1953/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:56 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:32:57.739185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:57.739896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:57.747404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:57.748506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:57.749107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:57.750028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:57.750754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:57.751389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.120945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:58.129695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0545868a-af02-4775-9dc7-37893e4694ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.395330 Aug 30 18:32:58.144479 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1862/3815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:57 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:58.178932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:58.179825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:58.187057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.187953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.188572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.189614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.190331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.191253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.456970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:58.461286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:58.470714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.471653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.472341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.479943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.482333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.483053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.503516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:32:58.582639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:58.597581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c959b8c2-3737-4454-9ce5-787675c20f8c tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.423629 Aug 30 18:32:58.604601 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0d9266f-1b7b-4136-8bdf-0e1b816fb9ee tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156899 Aug 30 18:32:58.607497 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1863/3816] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:58 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:32:58.615843 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1954/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:58 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:58.746953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:58.747978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:58.757703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.769420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.770144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:58.771131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:58.771601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:58.774168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.152358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:59.153148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:59.166695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.167200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.167708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.168432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.168894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.169319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.457182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:59.468027 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36904591-083b-4e73-a708-b75d0be4af3f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1317 microversion: 2.1 time: 0.725525 Aug 30 18:32:59.480567 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1864/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:58 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:59.556049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:32:59.574780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d71d5-a60a-42dd-86b2-cd5e613546b2", "name": "network-vif-plugged", "status": "completed", "tag": "c90042fd-db84-4529-963d-3dbd56bbf14c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:32:59.578956 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00b73e22-d243-41e5-bb21-3ad173da29b6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.422536 Aug 30 18:32:59.579607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1955/3819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:59 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:32:59.596318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.596792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.597215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.622191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:59.624579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:59.645739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.646239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.655618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.658574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] Creating event network-vif-plugged:c90042fd-db84-4529-963d-3dbd56bbf14c for instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 on n-h2-854119-10 Aug 30 18:32:59.659687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.660382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.661044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.677445 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bc11eefe-66b3-4530-b3e7-b7dee0001f9e req-133d391d-dd20-42b8-859b-9d6e13d88a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106359 Aug 30 18:32:59.679857 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1865/3820] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:32:59.696470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:32:59.699681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:32:59.732563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.733080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.733527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.759961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:32:59.761168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:32:59.762652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:32:59.800582 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-abefb861-4a23-4f66-8a8a-842dff2a2177 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184578 Aug 30 18:32:59.804824 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1956/3821] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:32:59 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:00.208753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:00.235115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53ab3de4-f8d1-42f0-a055-0a5e610140d2 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.550595 Aug 30 18:33:00.235930 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1866/3822] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:32:59 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:00.503412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:00.506895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:00.531395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.536590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.537369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:00.540451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.542199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.545678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:00.604380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:00.607440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:00.631638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.633364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.637258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:00.641175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.648392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.649023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:00.921345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:00.940308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afb9b82a-f6ad-4f5e-bef1-a1cbf4ed14b5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1467 microversion: 2.1 time: 0.442548 Aug 30 18:33:00.954377 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1957/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:00 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1467 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:00.954377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:00.956125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:00.971742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.973734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.975633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:00.978995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:00.980550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:00.981697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:01.076951 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57b140b5-e687-4d74-899e-0d454a1a012c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133869 Aug 30 18:33:01.081321 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1958/3824] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:00 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:01.089253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:01.090078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:01.097127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:01.097959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:01.098779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:01.099838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:01.101501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:01.102155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:01.338580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c76eaf87-261d-49fb-a3d8-9acaa6bdb001 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1620 microversion: 2.1 time: 0.254771 Aug 30 18:33:01.339900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1959/3825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:01 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1620 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:01.346135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:01.347039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:01.355099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:01.355919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:01.356549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:01.357449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:01.358062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:01.358830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:01.364217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:01.581425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:01.592676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9c1f2752-d7ce-4d59-b47f-b03be494f227 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1512 microversion: 2.1 time: 0.994477 Aug 30 18:33:01.593185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:01.597983 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1867/3826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:00 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1512 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:01.624052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8ded309-4606-4cf6-952b-62ebdd19bcb7 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1394 microversion: 2.1 time: 0.281162 Aug 30 18:33:01.625578 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1960/3827] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:01 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1394 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:01.675987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1595576955", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["50a24854-c37f-424f-b14c-1f7350b34928"]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:01.783798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:02.100818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:02.105610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:02.115988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.116920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.117612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.119506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.120271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.120924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.209304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c9d3b6c-ef0e-467f-b492-a8a901b43124 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118294 Aug 30 18:33:02.209940 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1961/3828] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:02 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:02.618769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:02.619922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:02.631557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.635798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.636269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.637101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.637534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.637970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.654753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:02.655482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:02.655979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:02.658284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:02.658886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:02.694222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.695282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.695282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.695938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.696414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.696827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:02.781791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:02.802767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:02.825987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:02.832229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:02.940825 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-179dfd41-52be-4982-a531-2382aac38550 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269566 Aug 30 18:33:02.946536 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1868/3829] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:33:02.954298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:02.956461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:02.981053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:02.981551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:02.981989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.020767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.021340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.028106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.089262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:03.103820 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b78aff8c-52af-414e-af24-09e1cecfbaef tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1489 microversion: 2.1 time: 0.488834 Aug 30 18:33:03.106492 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1962/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:02 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1489 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:03.118328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-49a1836c-ffc0-41b2-8c3b-c040575f3fe1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:03.120576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-49a1836c-ffc0-41b2-8c3b-c040575f3fe1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.238502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-49a1836c-ffc0-41b2-8c3b-c040575f3fe1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:03.267863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-49a1836c-ffc0-41b2-8c3b-c040575f3fe1 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1217 microversion: 2.1 time: 0.158281 Aug 30 18:33:03.273397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1963/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:03 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:03.293179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:03.301940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.321589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.323322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.325382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.329787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.330144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.331160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.409424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:03.419697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-297dd33a-2485-4aa9-af02-5526c2a51c6b tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1575 microversion: 2.1 time: 0.471879 Aug 30 18:33:03.423080 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1869/3832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:02 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1575 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:03.434231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:03.442158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.456742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.462317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.463227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.466632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.467345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.467973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.486022 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-74278091-09fd-4fe9-8487-be2b17196998 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 200 len: 138 microversion: 2.1 time: 0.209841 Aug 30 18:33:03.499696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1964/3833] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:03 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 138 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:03.522777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:03.525406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.545299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.547332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.548445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.549494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.550754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.551438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.577350 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6559fec0-fdca-4c5d-bdf0-14e397552915 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152162 Aug 30 18:33:03.578533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1870/3834] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:33:03 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:03.591287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:03.592423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:03.618390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.621827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.622613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:03.626839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:03.627736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:03.628497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.017934 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9177c97f-4f60-41dd-bc78-ea6e3f4d7dc1 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.513256 Aug 30 18:33:04.019693 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1965/3835] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:33:03 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2/os-interface => generated 284 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:04.020742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:04.030866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:04.032625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:04.035005 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55faba0a-e66c-4996-a114-bb142c1c13d8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.454490 Aug 30 18:33:04.050378 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1871/3836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:04.062957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.063553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.065539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.066372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.066878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.067307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.067484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:04.068866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:04.078054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.090835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.091432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.092218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.092689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.093107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.177582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:04.369177 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09501af4-6264-4d1c-875a-540a87188216 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 204 len: 0 microversion: 2.1 time: 0.347802 Aug 30 18:33:04.370106 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1966/3837] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:04 2022] DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:04.384193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:04.385505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:04.402988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.403547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.404023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.404644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.405099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.405514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.585869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:04.613170 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f35d853-9bce-4571-8ae0-a766cffb7cf4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1213 microversion: 2.1 time: 0.238113 Aug 30 18:33:04.618432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1967/3838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:04 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:04.628949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:04.634830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:04.653720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.654217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.655068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:04.658179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:04.659286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:04.661461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.051614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:05.070011 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c3faa97f-163a-4eda-b86a-d40fecd7b25a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.003452 Aug 30 18:33:05.070989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1872/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:04 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:05.096573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:05.097186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:05.112370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.113961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.114449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.118004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.119797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.124149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.327761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:05.351129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37e97564-a7ea-46af-8d11-c6e51aac18b3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1679 microversion: 2.1 time: 0.731274 Aug 30 18:33:05.353191 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1968/3840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:04 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1679 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:05.639797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:05.640775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:05.653652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.655165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.655787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.657590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.658493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.659455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.811498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:05.837467 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a37a8064-f326-4fce-b9fd-e842d8f323a0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1269 microversion: 2.1 time: 0.199861 Aug 30 18:33:05.840590 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1969/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:05 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:05.868003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:05.886633 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91fb4e7e-e263-41f7-98fc-e9f6cd50c5f1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.793758 Aug 30 18:33:05.887345 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1873/3842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:05.911443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:05.912397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:05.923705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.924332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.924791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:05.925525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:05.926256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:05.927156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:06.194055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:06.207174 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a2d0ef7f-e9e4-45b4-8a50-356d70ed252e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.300388 Aug 30 18:33:06.210232 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1970/3843] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:06.385224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:06.386762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:06.400201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:06.404054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:06.407992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:06.410052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:06.410922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:06.411600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:06.696685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1717401352", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a43d14fc-4753-4553-8d04-df60af14fa3d"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:06.924280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] validate_networks() for [('a43d14fc-4753-4553-8d04-df60af14fa3d', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:07.359238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:07.367888 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4924bad3-ef81-4469-8328-5f1333594825 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1679 microversion: 2.1 time: 0.986530 Aug 30 18:33:07.368845 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1874/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:06 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1679 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:07.398956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:07.400746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:07.409138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:07.409954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:07.410580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:07.411475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:07.412133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:07.413094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:07.559761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:07.591160 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ac921c9-0c66-4370-bbbb-4c0b32714b38 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1275 microversion: 2.1 time: 0.203601 Aug 30 18:33:07.595294 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1875/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:07 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:08.116855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:08.117909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:08.130615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:08.146918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.151201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.153294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.155876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.157831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.161327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.209367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:08.211391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:08.212120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:08.212690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:08.213314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:08.239141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.241357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.243451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.246431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.247537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.248775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.319475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:08.336704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:08.387051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:08.394768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:08.616758 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c914335-29d5-4f62-914a-69f25a286a18 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920868 Aug 30 18:33:08.624179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1971/3846] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:33:08.649950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8d71d5-a60a-42dd-86b2-cd5e613546b2", "tag": "c90042fd-db84-4529-963d-3dbd56bbf14c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:08.687653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.692437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.693173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.759815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] Creating event network-changed:c90042fd-db84-4529-963d-3dbd56bbf14c for instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 on n-h2-854119-10 Aug 30 18:33:08.775899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9b2985cb-7c45-4bfc-a4ea-3ff0f1a4f8e1 req-0a22c4a6-06b7-4dd0-b011-0834a27d5a14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150001 Aug 30 18:33:08.776533 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1972/3847] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:08.787281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:08.788006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:08.838090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:08.840642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.841165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.841650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.843948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.846140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.848303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.861202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-faf942ad-ae36-49ed-ae62-031e963149b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1575 microversion: 2.1 time: 0.748153 Aug 30 18:33:08.874642 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1876/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:08 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1575 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:08.894701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:08.895812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:08.918684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.919191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.924087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:08.925217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:08.925991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:08.930883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:09.121649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:09.155663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d6756cb-27b4-401a-9498-db211054f41b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1275 microversion: 2.1 time: 0.276542 Aug 30 18:33:09.155663 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1877/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:08 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:09.183711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de6b50bf-4d2b-494e-b03a-13c473a6b493 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:09.184329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de6b50bf-4d2b-494e-b03a-13c473a6b493 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:09.331016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:09.361133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6a79039-8324-494d-a12a-2647e79ed16e tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1612 microversion: 2.1 time: 0.580439 Aug 30 18:33:09.365835 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1973/3850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:08 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1612 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:09.620046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de6b50bf-4d2b-494e-b03a-13c473a6b493 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:09.671162 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de6b50bf-4d2b-494e-b03a-13c473a6b493 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1215 microversion: 2.1 time: 0.490391 Aug 30 18:33:09.674894 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1878/3851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:09 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1215 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:10.179479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:10.180198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:10.203514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:10.204853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:10.208348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:10.209426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:10.212142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:10.213358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:10.393204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:10.395225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:10.424936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:10.426974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:10.430384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:10.434041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:10.435797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:10.437255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:11.417729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:11.418511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:11.423121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:11.423773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'fault' on Instance uuid c6141780-70eb-40fa-97bf-011e9712354d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:11.542123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:11.565619 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-633ff709-0156-440f-9504-63ea0a7f2cf8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 1.380507 Aug 30 18:33:11.574757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1974/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:10 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:11.586879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:11.589573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:11.604301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:11.625643 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-20224806-147e-46a1-a5d0-abfe91a2be42 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 200 len: 1330 microversion: 2.1 time: 1.236825 Aug 30 18:33:11.647233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1879/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:10 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 1330 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:11.663835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:11.669286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:11.683246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:11.690530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:11.699422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:11.702364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6141780-70eb-40fa-97bf-011e9712354d", "name": "network-vif-deleted", "tag": "64bf4300-d79c-42a6-b9bd-ae3fc1f4680e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:11.709450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:11.779757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:11.788674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:11.794463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:11.823501 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] Creating event network-vif-deleted:64bf4300-d79c-42a6-b9bd-ae3fc1f4680e for instance c6141780-70eb-40fa-97bf-011e9712354d on n-h2-854119-10 Aug 30 18:33:11.839186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-da1a07ff-dbac-49f7-a908-2b108df2431d req-da2bea68-de87-4e36-9e1a-2cb2196ebfd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182897 Aug 30 18:33:11.843676 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1880/3854] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:12.200475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:12.249696 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a0b5eb6-c1c5-4bcf-8462-b7f03806b729 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1267 microversion: 2.1 time: 0.672926 Aug 30 18:33:12.255222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1975/3855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:11 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1267 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:12.593755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:12.594745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:12.621297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.632192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.632192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.637320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.638801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.644004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.657483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:12.658468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:12.672084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.679244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.680466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.683365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:12.685433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:12.687039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:12.750935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d HTTP/1.1 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'c6141780-70eb-40fa-97bf-011e9712354d'} Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:12.755878 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:12.764648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf28e367-2b4b-4538-ba78-204e4eb61598 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 404 len: 111 microversion: 2.1 time: 0.104079 Aug 30 18:33:12.766024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:12.770702 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1976/3856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:12 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:33:12.785268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b084d3a-1b48-4790-ad7d-3d0f3da4b130 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '.version_select at 0x7f4e5694d8b0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:12.829124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b084d3a-1b48-4790-ad7d-3d0f3da4b130 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202854555" status: 202 len: 0 microversion: 2.1 time: 0.057136 Aug 30 18:33:12.834630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1977/3857] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202854555 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:13.305103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:13.305737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:13.342029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:13.345947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:13.348405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:13.351576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:13.355001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:13.358672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:13.542992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:13.557391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27a2e6da-81ef-40eb-856a-e77536d8ef3b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1273 microversion: 2.1 time: 0.274403 Aug 30 18:33:13.567680 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1978/3858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:13 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:13.581935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:13.615636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2804f6f6-140f-46a7-a658-cbc61b5d8300 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 1.028910 Aug 30 18:33:13.622858 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1881/3859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:12 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:14.561819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041a382e-8f90-4042-9568-f12f58d74ca2", "tag": "a1be92f6-af4b-4bb9-9cb9-ded285caeb4c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:14.596205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.600548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.601315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.604691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:14.605682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:14.623654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.627333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.628132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.633755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.634903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.635651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.663792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] Creating event network-changed:a1be92f6-af4b-4bb9-9cb9-ded285caeb4c for instance 041a382e-8f90-4042-9568-f12f58d74ca2 on n-h2-854119-10 Aug 30 18:33:14.681432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:14.686247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bd1be09f-d693-4953-8e65-0eab2ea74e21 req-81b868ee-848d-409c-a944-46852dbd22ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.745600 Aug 30 18:33:14.692921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1979/3860] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:14.716829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:14.720493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:14.746005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.751803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.753622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.755699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:14.757456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:14.758229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:14.836150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:14.866298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:14.878463 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5127002d-0ac7-40f0-9ce9-6086d75163f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1273 microversion: 2.1 time: 0.275062 Aug 30 18:33:14.879464 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1882/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:14 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:15.298243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:15.311207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5dba4e1-edd2-40f7-8321-2df97bf3f9e5 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.613567 Aug 30 18:33:15.312131 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1980/3862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:14 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:15.908714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:15.909538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:15.928472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:15.929631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:15.930304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:15.933088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:15.935230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:15.936829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.083124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3d81dc69-25b7-47d8-888c-da55890f8927 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: .version_select at 0x7f4e56f23af0>, body: {"keypair": {"name": "tempest-keypair-746471969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvrEQbka8UKmcvQf2Iu9FQzePEDZ7iSyqozCioJEQIn238w6LgUOCk5g0mq+IE1RWG9abTK7puSy43NyFhg9QyrRRa+isgMwQOPbMtwblopxACSDnC2PHgnrnn+OgeGtQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:16.133618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3d81dc69-25b7-47d8-888c-da55890f8927 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:16.148506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-3d81dc69-25b7-47d8-888c-da55890f8927 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:16.157727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:16.236778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3d81dc69-25b7-47d8-888c-da55890f8927 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159391 Aug 30 18:33:16.247205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1981/3863] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:33:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:16.341720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:16.345096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:16.388982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.389577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.390032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.396451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:16.400964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:16.401503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:16.637784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:16.668979 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09be770b-3d95-49dd-a498-b1a26ad3b6ea tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.766514 Aug 30 18:33:16.670513 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1883/3864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:15 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:17.164065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:17.179649 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04e62bcb-dd3b-458f-a337-fa0bec195bd2 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.849067 Aug 30 18:33:17.180912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1982/3865] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:16 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:17.694064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:17.695704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:17.705576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:17.706688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:17.707686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:17.709084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:17.709969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:17.710816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.065667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec27802-f733-4bd8-b004-fe386ae5d8c7", "tag": "c8c9a761-d336-482c-9d6e-fbeeefd4691b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:18.078753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:18.079535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:18.080363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.095295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] Creating event network-changed:c8c9a761-d336-482c-9d6e-fbeeefd4691b for instance dec27802-f733-4bd8-b004-fe386ae5d8c7 on n-h1-854119-10 Aug 30 18:33:18.098221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:18.101772 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3fb456a0-6b5b-4512-9e58-8a6dd824018f req-77dfe8c7-30cb-45c1-adb0-2a7d93917948 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040084 Aug 30 18:33:18.103101 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1983/3866] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:18.118295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46975585-4677-4008-aeaf-2f071e4bf04c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.426377 Aug 30 18:33:18.130404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1884/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:17 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:18.202179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:18.204636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:18.220088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:18.221015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:18.222651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.225425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:18.226322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:18.227209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:18.303614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:18.903334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:18.913839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c242dbeb-6c9e-4d9f-8374-3e2c7c4ffd72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.716354 Aug 30 18:33:18.918747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1984/3868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:18 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:19.198213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:19.199084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:19.248286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.249342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.250422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.253593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.255613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.256351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.640837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:19.957101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:19.957856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:19.986126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.987280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.987962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:19.991458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:19.992256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:19.992897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:20.289543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:20.298573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2a00b61-ec44-4911-83c3-43cb1595e65e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 1.158053 Aug 30 18:33:20.314852 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1885/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:19 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:20.329981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:20.369362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38bce563-d85a-41af-9fa9-53b89d12a80f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.389685 Aug 30 18:33:20.371789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1985/3870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:19 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:21.325116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:21.325747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:21.344365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.347586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.348155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.348992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.349545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.349934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.393404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:21.394020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:21.401658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.402445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.403079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.403971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.404626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.405199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.689036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:21.701204 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b6be34e-7405-42ed-a7c6-fe558009d7f7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.312883 Aug 30 18:33:21.707951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1986/3871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:21 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:21.744859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:21.755469 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d61cb508-7f20-4ea4-8336-158635bcc8aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.436065 Aug 30 18:33:21.756369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1886/3872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:21 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:21.884863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a382e-8f90-4042-9568-f12f58d74ca2", "name": "network-vif-plugged", "status": "completed", "tag": "a1be92f6-af4b-4bb9-9cb9-ded285caeb4c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:21.906990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:21.907578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:21.908027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:21.937583 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] Creating event network-vif-plugged:a1be92f6-af4b-4bb9-9cb9-ded285caeb4c for instance 041a382e-8f90-4042-9568-f12f58d74ca2 on n-h2-854119-10 Aug 30 18:33:21.956339 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c8a19685-c2f9-4730-ac21-458d7400868d req-b98d3158-06cd-4fe7-aeea-7a1f736fff6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076024 Aug 30 18:33:21.956966 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1987/3873] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:22.650607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1643821937", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5"}], "security_groups": [{"name": "tempest-securitygroup--1774977918"}], "key_name": "tempest-keypair-746471969", "user_data": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:22.728714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:22.729380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:22.737634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:22.746585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:22.747085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:22.747856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:22.748333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:22.748758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:22.838665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] validate_networks() for [('5ef5a359-5e2c-4cb1-aa6b-df3083f3e3e5', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:23.607318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:23.622107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:23.623131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:23.623789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:23.624753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:23.625286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:23.635553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-724a4282-a350-4a84-b154-290832046c31 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1317 microversion: 2.1 time: 0.911287 Aug 30 18:33:23.638723 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1988/3874] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:22 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:23.652429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:23.653815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:23.654747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.655429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:23.656377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:23.656948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:23.657600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:23.658193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.664118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:23.666161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:23.667662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.668583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:23.670467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:23.671230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:23.700365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:23.719766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Getting quotas for user d155270f98b04f2ab64d364366b0eabf and project be050dfa2c85497e804a681513ab65a2. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:23.753467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:23.773884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:23.881719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33006fa6-88b4-49ba-acac-b46123ee13ca tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.238797 Aug 30 18:33:23.884220 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1887/3875] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:33:23.901954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5ac3336-2490-419c-bc21-05682d4b572d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:23.903892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f5ac3336-2490-419c-bc21-05682d4b572d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:24.016415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f5ac3336-2490-419c-bc21-05682d4b572d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:24.028296 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5ac3336-2490-419c-bc21-05682d4b572d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1241 microversion: 2.1 time: 0.135664 Aug 30 18:33:24.043683 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1888/3876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:23 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:24.050185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec27802-f733-4bd8-b004-fe386ae5d8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c8c9a761-d336-482c-9d6e-fbeeefd4691b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:24.065514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:24.066319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:24.067293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:24.081957 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] Creating event network-vif-plugged:c8c9a761-d336-482c-9d6e-fbeeefd4691b for instance dec27802-f733-4bd8-b004-fe386ae5d8c7 on n-h1-854119-10 Aug 30 18:33:24.104135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d346a668-857f-4600-b485-ba6863367555 req-5ade1cae-392b-4a3b-8568-1368ec3807de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050587 Aug 30 18:33:24.107710 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1889/3877] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:24.320247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:24.348238 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2d32445-2910-4136-b7ed-1ec3af995a0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.695464 Aug 30 18:33:24.351489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1989/3878] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:23 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:24.659886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:24.660888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:24.682790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:24.688236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:24.689070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:24.694612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:24.696909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:24.698754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.050026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:25.050927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:25.071339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.074324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.076309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.077245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.080008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.080639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.473474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:25.484943 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d6f2483-82c1-453f-9811-d1b221cc90c4 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1467 microversion: 2.1 time: 0.830598 Aug 30 18:33:25.485571 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1890/3879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:24 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1467 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:25.511400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:25.512426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:25.543316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.544705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.547942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.548986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.551708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.552367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.913348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:25.939844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2259be5-2f1e-452f-8e07-277f762159a2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1237 microversion: 2.1 time: 0.890542 Aug 30 18:33:25.940532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1990/3880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:25 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1237 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:25.976034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:25.977571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:25.992014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.995648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:25.996390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:25.998055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:25.999541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:26.000773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:26.081937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:26.094420 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a727232b-3579-4950-bf05-793513521c79 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.598672 Aug 30 18:33:26.095218 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1891/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:25 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:26.174296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:26.401753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2493f598-5d02-402d-9be1-4f4d4561051d tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1620 microversion: 2.1 time: 0.437019 Aug 30 18:33:26.403276 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1991/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:25 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1620 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:26.741891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-866908503", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "50a24854-c37f-424f-b14c-1f7350b34928"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:26.915825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:26.965456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:26.967185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:26.981331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:26.986949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:26.987780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:26.988790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:26.992061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:26.994265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.149677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:27.177339 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9582cbe-0ffe-4857-85d8-d94a6b9fe306 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1299 microversion: 2.1 time: 0.214986 Aug 30 18:33:27.180698 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1992/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:26 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:27.197691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:27.200967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:27.235152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.238259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.240502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.255246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.259343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.261617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.684644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:27.686079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:27.687344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:27.688808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:27.689424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:27.712123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.718780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.719722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.723943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.724666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.727209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.789390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:27.809376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Getting quotas for user 9c2f1e90faa441c4bc88d9c2f716c8d2 and project f690e184dcdf48babd667cff7823cf40. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:27.818288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:27.836317 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07a15d2a-74c1-463a-807e-93edd31b3591 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1503 microversion: 2.1 time: 0.654462 Aug 30 18:33:27.837184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1993/3884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:27 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1503 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:27.862876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:27.866227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:27.877768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:27.888524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:27.913512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.914045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.928398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:27.929989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:27.932561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:27.933735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:28.056778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-316cc1fb-ce94-4805-a081-dfb858ed3a92 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.196615 Aug 30 18:33:28.058640 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1994/3885] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:27 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:28.063260 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56b489ab-6f40-4db4-bafd-1ec18dc55a89 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325907 Aug 30 18:33:28.063978 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1892/3886] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:33:28.086563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4661130-fa94-48db-8e5e-02f5ddd9e05c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:28.089692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4661130-fa94-48db-8e5e-02f5ddd9e05c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:28.214697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:28.215823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:28.226727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:28.229732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:28.230693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:28.232555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:28.234139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:28.236063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:28.337876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4661130-fa94-48db-8e5e-02f5ddd9e05c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:28.347729 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4661130-fa94-48db-8e5e-02f5ddd9e05c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1216 microversion: 2.1 time: 0.274490 Aug 30 18:33:28.363139 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1995/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:28 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1216 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:28.493620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:28.519431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d407d6f4-2c8a-4ea2-b7a4-32fecd96fa3d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1299 microversion: 2.1 time: 0.309408 Aug 30 18:33:28.523501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1893/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:28 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:29.069861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:29.073562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:29.090855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.093281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.093970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.097326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.099504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.103698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.240256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-751a73e2-e1d7-4728-845c-536d796ba091 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.175192 Aug 30 18:33:29.241635 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1996/3889] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:29 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:33:29.376007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:29.377582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:29.397886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.399074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.399775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.401305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.402070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.402918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.553082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:29.554319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:29.568773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.581158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.584938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.588675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:29.590749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:29.594412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:29.708318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:29.720022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a47ee8f7-0373-4a59-bddd-2f1edefa6ad7 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1212 microversion: 2.1 time: 0.352917 Aug 30 18:33:29.735257 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1894/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:29 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1212 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:30.263481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:30.279504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:30.309088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:30.315102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:30.315922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:30.317022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:30.317807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:30.318448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:30.419406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:30.426138 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1103b3d3-8842-4106-9abb-48862ba06259 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.176042 Aug 30 18:33:30.427040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1895/3891] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:30 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:30.434369 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fea483d6-e500-4fad-89d1-8f2b0c7a3046 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 0.889900 Aug 30 18:33:30.435007 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1997/3892] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:29 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:30.750816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:30.751949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:30.769145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:30.769941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:30.770709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:30.772111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:30.772734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:30.774584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:30.814968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18226d6-d56c-4be4-b19c-a427e2da15ac", "tag": "85a1eaf3-b8f2-4210-9f1a-206ada02c4e0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:30.838666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:30.839150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:30.839581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:30.862678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] Creating event network-changed:85a1eaf3-b8f2-4210-9f1a-206ada02c4e0 for instance e18226d6-d56c-4be4-b19c-a427e2da15ac on n-h1-854119-10 Aug 30 18:33:30.875931 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-de57d6cd-81eb-4707-bcee-4cf88d44cbbb req-e9963949-042f-45be-b4ce-bafa5944cf88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065911 Aug 30 18:33:30.876736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1998/3893] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:30.938191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:30.955445 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04afde96-4f04-4e9a-964b-bba004b09f97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1274 microversion: 2.1 time: 0.216086 Aug 30 18:33:30.956265 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1896/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:30 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:31.443251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:31.446992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:31.456644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:31.457923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:31.469420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:31.470464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:31.471168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:31.472084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:31.472757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:31.473339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:31.474050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:31.474646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:31.475597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:31.479746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:31.480455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:31.483197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:31.574447 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1f15f4c1-8bd5-4237-9c80-9318c409d830 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.136415 Aug 30 18:33:31.575805 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 1999/3895] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:31 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:31.977632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:31.978734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:31.998317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:31.998964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:31.999684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:32.000369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:32.001053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:32.001682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:32.161115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:32.173983 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83f98c2c-2029-4355-97b6-a70d8f308f40 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1274 microversion: 2.1 time: 0.200464 Aug 30 18:33:32.175412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2000/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:31 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:32.286825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:32.311215 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04dab02c-3e0c-4808-9179-80626055ac1a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 0.858951 Aug 30 18:33:32.313899 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1897/3897] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:31 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:32.588281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:32.591244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:32.608208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:32.611802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:32.613119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:32.614042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:32.616468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:32.619114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:33.195619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:33.196231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:33.212313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:33.213100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:33.213702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:33.214624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:33.215778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:33.216361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:33.288577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4428b59a-2858-438c-974e-90cdc8c35aff tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.706016 Aug 30 18:33:33.289416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2001/3898] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:32 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:33.336526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:33.337585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:33.354898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:33.355726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:33.367373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:33.372032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:33.372735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:33.373886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:33.436663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:34.012823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:34.022827 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-328070fe-7779-437a-8ee7-794a8a1469e3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.830961 Aug 30 18:33:34.031630 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1898/3899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:33 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:34.301112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:34.304777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:34.332745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:34.333561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:34.334158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:34.337060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:34.337709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:34.338294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:34.442295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba6aea5c-b7d5-49ff-acc7-938847466282 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.144898 Aug 30 18:33:34.443102 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1899/3900] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:34 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:33:34.570106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:34.580211 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bc044d8-ea7b-4349-a949-4882538dcda7 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 1.247948 Aug 30 18:33:34.585168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2002/3901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:33 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:35.052104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:35.053173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:35.073088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.073624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.074554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.075397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.076077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.077579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.412044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb356314-072d-4cb8-ab26-19f2046f1eaa", "tag": "70a52f10-1d03-4832-9ffa-5093a4abfb8e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:35.443362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.450043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.450711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.504550 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] Creating event network-changed:70a52f10-1d03-4832-9ffa-5093a4abfb8e for instance bb356314-072d-4cb8-ab26-19f2046f1eaa on n-h1-854119-10 Aug 30 18:33:35.512745 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b38b930-f4d1-44fd-b613-cab6cdb350ec req-91506296-fded-4db0-ab16-5e339aaaf36f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104409 Aug 30 18:33:35.514206 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2003/3902] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:35.535400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:35.537838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:35.556057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.556798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.557381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.558308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.559140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.559738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.575436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:35.608850 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2faa65e8-c5f8-41e9-b360-3fc07e5c63c6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.559562 Aug 30 18:33:35.612566 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1900/3903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:35 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:35.626936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:35.630808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:35.650113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.651175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.651604 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-abb8bfaf-d1c8-4713-8958-7eec84c08499 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.132641 Aug 30 18:33:35.652806 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2004/3904] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:35 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:35.653425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.654257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:35.659337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:35.660237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:35.915685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:35.933765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4106b073-db7f-4ab5-8140-2cc05f15390c tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 0.319375 Aug 30 18:33:35.934380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1901/3905] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:35 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:36.632714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:36.633765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:36.645228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.645773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.646462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:36.647490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.648324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.649182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:36.663682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:36.665967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:36.685182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.685692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.686138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:36.687022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.687562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.688167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:36.905666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:36.918151 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-de0d9d5b-e4e1-4ca2-882d-9d6ca3cd9e72 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.291590 Aug 30 18:33:36.931822 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2005/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:36 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:36.956166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:36.956790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:36.965439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.965952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.966430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:36.967147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:36.967602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:36.968169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:37.172916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:37.183564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41707b29-42aa-431e-85d3-1365925ce401 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 0.232377 Aug 30 18:33:37.200099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2006/3907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:36 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:37.368414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18226d6-d56c-4be4-b19c-a427e2da15ac", "name": "network-vif-plugged", "status": "completed", "tag": "85a1eaf3-b8f2-4210-9f1a-206ada02c4e0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:37.383280 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dded979f-bc5f-4382-9c24-fb043036f014 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.723151 Aug 30 18:33:37.388186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1902/3908] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:36 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:37.400619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:37.401162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:37.401549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:37.444944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] Creating event network-vif-plugged:85a1eaf3-b8f2-4210-9f1a-206ada02c4e0 for instance e18226d6-d56c-4be4-b19c-a427e2da15ac on n-h1-854119-10 Aug 30 18:33:37.457309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f090a2fc-6d29-4176-809f-31f57ebbc331 req-8ed3b291-9bc4-48a6-823b-ac694f30ec05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093602 Aug 30 18:33:37.460551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2007/3909] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:37.945018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:37.946206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:37.964437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:37.968306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:37.979663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:37.981942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:37.984330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:37.985565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:37.987679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:37.990665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:37.994231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.214236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:38.214236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:38.225186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:38.225539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.226146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.231022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.232978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.234560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99b56d69-9c4b-4090-bf8b-fb6bc64adc6a tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.297865 Aug 30 18:33:38.235789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1903/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:37 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:38.236854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.237892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.343760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.398178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:38.401398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:38.408866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:38.418180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.420757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.421342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.422278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:38.422822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:38.423236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:38.498837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:38.514875 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5159f74c-575e-4c3c-abf7-4dcad0317e66 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1367 microversion: 2.1 time: 0.312516 Aug 30 18:33:38.517067 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2008/3911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:38 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:38.597013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f86a6ebd-31cf-461b-b3a8-7f2a5d4cc388 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 14 microversion: 2.1 time: 0.205179 Aug 30 18:33:38.601338 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1904/3912] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:38 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:33:39.256318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:39.257847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:39.268621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.270625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.273065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.275619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.277125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.278827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.547190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:39.548002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:39.576368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.581012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.584086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.591714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.593255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.593255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.652853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:39.665995 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dda38d45-0c81-4167-bed6-8e1deee51924 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.413928 Aug 30 18:33:39.666630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2009/3913] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:39 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:39.686002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:39.698775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:39.706854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.713393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.714074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.714997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.715767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.716376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.773510 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5562f83-048c-4725-b381-6c7d0d6c3e1f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action" status: 200 len: 8206 microversion: 2.1 time: 0.105461 Aug 30 18:33:39.782092 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2010/3914] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:39 2022] POST /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7/action => generated 8206 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:39.792843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:39.795427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:39.835686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.836980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.837824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:39.841554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:39.842333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:39.843371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.094324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:40.106811 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03a92941-14fc-477b-8f8d-59d638388cbc tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1556 microversion: 2.1 time: 0.571755 Aug 30 18:33:40.107654 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1905/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:39 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1556 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:40.114389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:40.132015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.132538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.133759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-399e0c1f-41a5-409c-9a5f-17106e5f468e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.349493 Aug 30 18:33:40.135330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2011/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:39 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:40.150468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.155231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.155973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.156743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.157268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.157704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.163151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.163790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.182000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.182541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.182987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.186467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.187580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.187926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.323734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f383bca-0ae4-400f-95ef-41b242364fe8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197769 Aug 30 18:33:40.325199 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1906/3917] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:40.381660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:40.392858 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11b5b02c-6aaf-43e3-8790-d075d30dd72f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.238877 Aug 30 18:33:40.394134 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2012/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:40.415505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.416399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.424013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.425074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.425890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.426991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.428293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.428942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.689036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.689751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.710577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.744443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:40.755717 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb6e7058-77d5-4bdb-8fdc-648208baf611 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.344915 Aug 30 18:33:40.767911 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1907/3919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:40.786131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:40.795603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:40.803960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.804773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.805492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.806564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:40.807283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:40.807917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:40.945743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:40.956441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-080877f3-713a-45a6-8674-7b8718051194 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.271894 Aug 30 18:33:40.968320 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2013/3920] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:41.500077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:41.516379 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8188cfd-24e5-4c76-9cac-5d20ab9c34fb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.733968 Aug 30 18:33:41.533477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1908/3921] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:40 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:41.545140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:41.545743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:41.562777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.562977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.571002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.574064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.574969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.576732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.679813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Locking {{(pid=122589) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 30 18:33:41.682265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb356314-072d-4cb8-ab26-19f2046f1eaa", "name": "network-vif-plugged", "status": "completed", "tag": "70a52f10-1d03-4832-9ffa-5093a4abfb8e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:41.712509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.715863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.716375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.753077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] Creating event network-vif-plugged:70a52f10-1d03-4832-9ffa-5093a4abfb8e for instance bb356314-072d-4cb8-ab26-19f2046f1eaa on n-h1-854119-10 Aug 30 18:33:41.780811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-590272c7-31c9-4f85-a9fc-3508f4eef05f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.241859 Aug 30 18:33:41.782068 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2014/3922] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:41 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:41.791780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:41.792540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:41.796634 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a5142118-eef8-4dbb-a3d1-46dd14b73cf3 req-62c22a7a-433c-48ad-bffc-29e0f8b3b62c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114171 Aug 30 18:33:41.805776 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1909/3923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:41.815619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.818028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.820022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.822823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:41.824477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:41.828561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:41.983013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:41.983950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:42.000084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.003959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.005628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.007763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.008833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.010667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.251346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:42.261007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a133565f-2d19-47a8-afb2-35da6d20bf7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.473826 Aug 30 18:33:42.262486 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2015/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:41 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:42.301709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:42.322241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.326305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.327921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.377423 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action HTTP/1.1 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 15 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: {"os-stop": {}} Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1e0cecb6-76aa-45e1-9508-81b2e4022a05', 'body': {'os-stop': {}}} Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked Aug 30 18:33:42.380162 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:42.390147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 409 to user: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 is locked {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:42.391316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5869237-e58a-43da-9a0e-ce85ceb58e81 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 409 len: 107 microversion: 2.1 time: 0.108736 Aug 30 18:33:42.392458 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2016/3925] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:42 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:33:42.405297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:42.406106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:42.417350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.418133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.418778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.420071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.420696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.421609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.537168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Unlocking {{(pid=122589) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 18:33:42.576520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:42.585761 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d84124a8-f997-4b84-b806-728494367234 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1316 microversion: 2.1 time: 0.609041 Aug 30 18:33:42.587082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:42.594645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1910/3926] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:41 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:42.625654 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-949479ea-9131-40df-aefa-9f084b90b88a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.226386 Aug 30 18:33:42.631205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2017/3927] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:42 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:42.639046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:42.653215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.653740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.654234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.695477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Going to try to stop instance {{(pid=122590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:33:42.776981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8f3aaf2-a2d7-499b-a217-5117ee1dd234 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.143718 Aug 30 18:33:42.785676 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1911/3928] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:42 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:42.792757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:42.793690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:42.809692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.815894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.822371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.823553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.824893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.828712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.844062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18226d6-d56c-4be4-b19c-a427e2da15ac", "tag": "85a1eaf3-b8f2-4210-9f1a-206ada02c4e0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:42.904281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:42.905396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:42.906118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:42.944693 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] Creating event network-changed:85a1eaf3-b8f2-4210-9f1a-206ada02c4e0 for instance e18226d6-d56c-4be4-b19c-a427e2da15ac on n-h1-854119-10 Aug 30 18:33:42.950446 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4f9aab7d-6986-47d6-bbdf-47df13c4b01d req-373fcf0c-6583-4a41-8e98-28906c521440 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112861 Aug 30 18:33:42.951471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1912/3929] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:42.970487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1505099672", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:43.076151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:33:43.370780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:43.370938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:33:43.371201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:33:43.371669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:33:43.372158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:33:43.372466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:33:43.383096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.383582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.384016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.384734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.385184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.385693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.387694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-169ab466-2f59-4ea6-b366-a887a3fabe5b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.600369 Aug 30 18:33:43.388288 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2018/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:42 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:43.405604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Getting quotas for project d0d14f2ff7094da294686f06063e6e15. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:33:43.411559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Getting quotas for user cb6f3262c0434a7ba72a650c789ebe44 and project d0d14f2ff7094da294686f06063e6e15. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:33:43.433781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:33:43.436558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:33:43.499302 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d6b5d7a-fd99-44d4-87af-898e5fcb61c6 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546074 Aug 30 18:33:43.507188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1913/3931] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:33:43.511902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37685880-c809-4edd-83d2-15533e3187de tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:43.512526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37685880-c809-4edd-83d2-15533e3187de tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:43.614466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:43.615278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:43.628297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.628835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.629282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.630011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.630468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.630905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.776313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37685880-c809-4edd-83d2-15533e3187de tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:43.787491 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37685880-c809-4edd-83d2-15533e3187de tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1214 microversion: 2.1 time: 0.279770 Aug 30 18:33:43.788614 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2019/3932] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:43 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:43.809819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:43.823217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:43.824017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Searching by: {'deleted': False, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:33:43.849962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.850486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.850922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.857457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.864474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.866496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.917311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:43.931321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:33:43.941631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8813f17-b3c7-4411-9283-4ab2bb8f4b87 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1466 microversion: 2.1 time: 0.331299 Aug 30 18:33:43.955879 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1914/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:43 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1466 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:43.977619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:43.978551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:43.986261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:43.989972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:43.995089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:43.996895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.001715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.002256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.007468 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c25c84c1-0baa-4fa6-b321-8ffbc3a1e456 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.217567 Aug 30 18:33:44.018913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2020/3934] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:33:43 2022] GET /compute/v2.1/servers => generated 332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:44.024429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:44.031113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:44.032328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Searching by: {'deleted': False, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:33:44.041822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.042856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.043574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.044585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.045265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.045998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.085447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:33:44.222826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:44.237181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.249784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.250564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.332673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7b0d103-5856-4dcc-bd0d-05a5e203b801 tempest-ServersOnMultiNodesTest-1098762190 tempest-ServersOnMultiNodesTest-1098762190-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1619 microversion: 2.1 time: 0.358674 Aug 30 18:33:44.333280 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1915/3935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:43 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1619 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:44.359523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:44.360353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:44.380440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.380956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.381408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.382140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.382619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.383234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.430315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:44.598962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0eb7912c-cbd2-40fe-a827-9c88d239ca97 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 204 len: 0 microversion: 2.1 time: 0.243033 Aug 30 18:33:44.601065 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1916/3936] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:44 2022] DELETE /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:44.615935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:44.618985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:44.636390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.637957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.642215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.643977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:44.645170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:44.646680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:44.985867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:44.997667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff09b33d-994d-4936-ae80-3ed642c395a9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.394956 Aug 30 18:33:45.001505 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1917/3937] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:44 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:45.008910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:45.016352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:45.028765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.029374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.031584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.032453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.035022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.046602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.097117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-543599c7-33c5-4782-b256-cdb250c6d297 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 1.076451 Aug 30 18:33:45.116044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2021/3938] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:33:44 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:45.123287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:45.124321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:45.146979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.147759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.152598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.154255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.154915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.155556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.371930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:45.391585 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcb98ac3-13d7-4823-9104-e3be5d8f7186 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1266 microversion: 2.1 time: 0.274242 Aug 30 18:33:45.392598 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2022/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:45 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:45.400592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63e1c3f3-fac2-49ec-931a-0397d655a318 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:45.415971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63e1c3f3-fac2-49ec-931a-0397d655a318 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021590 Aug 30 18:33:45.417018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2023/3940] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:33:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:45.814521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:45.815280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:45.827588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.835460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.836708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.837667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:45.838293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:45.838887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:45.911064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:45.987486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:45.997619 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d1a0b20-2fdb-4055-b160-29fdbd7517de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1472 microversion: 2.1 time: 0.994684 Aug 30 18:33:45.999108 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1918/3941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:45 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1472 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:46.093435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:46.100961 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8ac9720-7b26-43c4-ad76-140f26f65bda tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 204 len: 0 microversion: 2.1 time: 0.290480 Aug 30 18:33:46.113520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2024/3942] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:45 2022] DELETE /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:46.129720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:46.131624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:46.140854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.142022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.143907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.145166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.145874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.146572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.434028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:46.434938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:46.447306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.447796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.448401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.449269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.449870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.450515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.595652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:46.606693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fcb1f1e6-4da4-4271-9845-f4bcf4b3c1ea tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1700 microversion: 2.1 time: 0.488438 Aug 30 18:33:46.611158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2025/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:46 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1700 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:46.620543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:46.621466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:46.636400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.639709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.640422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.641332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:46.643336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:46.646322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:46.750064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:46.750784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:46.752721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:46.761428 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93cf0534-f2ae-4c49-9ba2-ac2c94dcad75 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.742752 Aug 30 18:33:46.762031 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1919/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:46 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:46.776098 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c88b9617-cea0-436c-b2df-bc636fbe8e4e tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1284 microversion: 2.1 time: 0.163602 Aug 30 18:33:46.777081 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2026/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:46 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:47.024537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:47.025718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:47.045057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.046174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.047077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.054912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.055628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.056234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.095447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb356314-072d-4cb8-ab26-19f2046f1eaa", "name": "network-vif-deleted", "tag": "70a52f10-1d03-4832-9ffa-5093a4abfb8e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:47.126699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.127899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.128570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.144470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] Creating event network-vif-deleted:70a52f10-1d03-4832-9ffa-5093a4abfb8e for instance bb356314-072d-4cb8-ab26-19f2046f1eaa on n-h1-854119-10 Aug 30 18:33:47.150799 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-21891e78-f4de-46fd-99fb-f0d4652e695b req-63f57fa1-4455-4658-8a88-492cfc1f356d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059954 Aug 30 18:33:47.151748 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2027/3946] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:47.238402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:47.261343 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b06eb074-a074-4c85-b2d3-1fe0ffc94dc0 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 200 len: 1430 microversion: 2.1 time: 0.245748 Aug 30 18:33:47.262632 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1920/3947] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:47 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 1430 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:47.633531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:47.634376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:47.662710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.663111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.663539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.666950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.667642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.668392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.784009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:47.785092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:47.798997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.804146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.805880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:47.806865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:47.809757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:47.811767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.295498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:48.308034 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e41054a-8c2f-4de2-bc7d-f92270d4e069 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.529341 Aug 30 18:33:48.311318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1921/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:47 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:48.322255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:48.324190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:48.341561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.344957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.346909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.352404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.353161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.353764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.493539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:48.508580 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa9bea8e-0c3e-4cc9-8547-64313efa6afa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1272 microversion: 2.1 time: 0.195731 Aug 30 18:33:48.509613 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1922/3949] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:48 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:48.515702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:48.516582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: bb356314-072d-4cb8-ab26-19f2046f1eaa] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:48.525596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.526379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.527151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.528221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.528836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.529616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.583579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa HTTP/1.1 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bb356314-072d-4cb8-ab26-19f2046f1eaa'} Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:48.589124 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. Aug 30 18:33:48.594755 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:48.597610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance bb356314-072d-4cb8-ab26-19f2046f1eaa could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:48.604318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d45b20f3-9083-433a-9781-9f5d66645fed tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa" status: 404 len: 111 microversion: 2.1 time: 0.093407 Aug 30 18:33:48.610763 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1923/3950] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:48 2022] GET /compute/v2.1/servers/bb356314-072d-4cb8-ab26-19f2046f1eaa => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:48.623722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:48.625783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:48.636594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.638987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.639747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.644094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.645481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.646193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.690638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:48.703263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:48.705870 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06016841-ee05-4246-a0d7-accdd682ca87 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1700 microversion: 2.1 time: 1.077477 Aug 30 18:33:48.708071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2028/3951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:47 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1700 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:48.909424 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-853e9b75-e5d3-44eb-b350-485602f85f84 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 204 len: 0 microversion: 2.1 time: 0.296838 Aug 30 18:33:48.910057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1924/3952] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:48 2022] DELETE /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:48.920362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:48.921640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:48.933196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.933709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.936671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:48.937631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:48.941192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:48.942078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.197431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:49.208484 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb432386-28f6-4133-9b43-5953b398b5a3 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1473 microversion: 2.1 time: 0.294014 Aug 30 18:33:49.221923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2029/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:48 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:49.333193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:49.335681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:49.348024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.348802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.349397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.355585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.356276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.356876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.536479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:49.537556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:49.552239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.553273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.560230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.561718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.562408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.563120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.649257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:49.665318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b78cccc5-fa19-4a9c-ae28-3ee4f422a6cb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.335827 Aug 30 18:33:49.678386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1925/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:49 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:49.688059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:49.697552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00f32bee-6990-4a5a-831f-b95c66e4ddd9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1272 microversion: 2.1 time: 0.164937 Aug 30 18:33:49.698892 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2030/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:49 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:49.736880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:49.737665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:49.747714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.754404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.755007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:49.755789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:49.756287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:49.756682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.230401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:50.231334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:50.250790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.250980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:50.251188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.256044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.256989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.259077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.260070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.262146 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec408ec3-cd18-4535-8f31-5c020f554809 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1700 microversion: 2.1 time: 0.530204 Aug 30 18:33:50.264820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1926/3956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:49 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1700 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:50.627574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:50.637884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b188c59-4120-4eaa-b48c-3fe962943339 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1473 microversion: 2.1 time: 0.412349 Aug 30 18:33:50.644961 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2031/3957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:50 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:50.692037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:50.694723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:50.705887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.706411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.714784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.715600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.716085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.716522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.720488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:50.721379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:50.734250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.734944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.735479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:50.736284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:50.736832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:50.751070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.320031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:51.355743 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8f33aef-3be4-42c4-ad71-16367e21ab21 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.667558 Aug 30 18:33:51.360982 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1927/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:50 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:51.370193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8d71d5-a60a-42dd-86b2-cd5e613546b2", "name": "network-vif-deleted", "tag": "c90042fd-db84-4529-963d-3dbd56bbf14c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:51.406420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.418629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.431228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.456004 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] Creating event network-vif-deleted:c90042fd-db84-4529-963d-3dbd56bbf14c for instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 on n-h2-854119-10 Aug 30 18:33:51.461859 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6142ce39-ecf4-44ba-ae4e-3d219c0fbdf7 req-4b6b00a5-5d37-4548-96e2-5925a79fa2bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099687 Aug 30 18:33:51.462975 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1928/3959] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:51.463524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:51.469813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:51.470770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:51.478159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.478951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.479248 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f99e13fb-8169-4955-b00e-d381e0e110ea tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.763291 Aug 30 18:33:51.479705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.480518 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2032/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:50 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:51.481168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.481780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.492741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.565682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.566103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.566557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.567013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lazy-loading 'fault' on Instance uuid fa8d71d5-a60a-42dd-86b2-cd5e613546b2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:51.665958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:51.666905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:51.687501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.688326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.688915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.689853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:51.690588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:51.691162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:51.699548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370732fe6b264874aea3eb4df9789733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3efb6dadcab4522b744e5ebce3182c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:51.717784 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-191cdd49-27d1-4976-8e20-7f4540efab52 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 200 len: 1358 microversion: 2.1 time: 0.253096 Aug 30 18:33:51.723865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1929/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:51 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:51.745229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:52.107356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:52.127435 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb35eda6-e04c-49ad-8159-36c936acc8fa tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1473 microversion: 2.1 time: 0.462894 Aug 30 18:33:52.128145 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2033/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:51 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:52.332335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041a382e-8f90-4042-9568-f12f58d74ca2", "name": "network-vif-deleted", "tag": "a1be92f6-af4b-4bb9-9cb9-ded285caeb4c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:52.366877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:52.367625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:52.368248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:52.383128 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] Creating event network-vif-deleted:a1be92f6-af4b-4bb9-9cb9-ded285caeb4c for instance 041a382e-8f90-4042-9568-f12f58d74ca2 on n-h2-854119-10 Aug 30 18:33:52.386459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:52.387220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:52.399928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f6caa98b-398a-454a-b236-0c3b047a317b req-c4fb90d4-e2ab-4d06-8eb2-631b792afe87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073680 Aug 30 18:33:52.402596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1930/3963] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:52.419273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:52.420097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:52.420237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:52.424018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:52.426095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:52.428639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:52.503199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:52.504244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:52.520772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:52.521603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:52.522830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:52.525442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:52.527995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:52.530425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:52.978048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:52.990685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9050b3d5-252e-4ab8-9569-b7d4f9f5f440 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.617257 Aug 30 18:33:52.991740 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2034/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:52 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:53.004057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:53.004695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] [instance: fa8d71d5-a60a-42dd-86b2-cd5e613546b2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:53.019208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:53.019956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.020751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.021402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.025460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.027812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.030616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.042981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-684ea1ce-76fb-4ed5-9ce8-c0abfffec49b tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.543183 Aug 30 18:33:53.046884 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1931/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:52 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:53.068709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] HTTP exception thrown: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Request method failure captured: Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 HTTP/1.1 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDle73rhwZef5gphajl28dEjJE8F7eEuYGCJJl1H26lNEvVA7p4KfJ679z8L-0HzMULKI7qszFIoOA9nyMZBag2AQguJwxQgMiW7WMgNvpuzbjlZ1fXYjvAtW0Y4sgVM9wlhQjcVJNr8zu9x5hN_KZAiDC2glIxrSAWz9FjQKCFrPC1E Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: a3efb6dadcab4522b744e5ebce3182c8 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersTestJSON-2105007104 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3efb6dadcab4522b744e5ebce3182c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3efb6dadcab4522b744e5ebce3182c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3efb6dadcab4522b744e5ebce3182c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3efb6dadcab4522b744e5ebce3182c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersTestJSON-2105007104 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: a3efb6dadcab4522b744e5ebce3182c8 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersTestJSON-2105007104 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersTestJSON-2105007104-project Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 370732fe6b264874aea3eb4df9789733 Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersTestJSON-2105007104-project Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'fa8d71d5-a60a-42dd-86b2-cd5e613546b2'} Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:53.075549 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. Aug 30 18:33:53.080448 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:33:53.081776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Returning 404 to user: Instance fa8d71d5-a60a-42dd-86b2-cd5e613546b2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:53.083056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1779aaf4-74cf-432a-bf41-47a533c3c5b6 tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2" status: 404 len: 111 microversion: 2.1 time: 0.090112 Aug 30 18:33:53.087677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2035/3966] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:52 2022] GET /compute/v2.1/servers/fa8d71d5-a60a-42dd-86b2-cd5e613546b2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:33:53.093548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-40ffc109-00ba-484d-b465-a61a25e6cbaa tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] Calling method '.version_select at 0x7f4e55b8f160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:53.144691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-40ffc109-00ba-484d-b465-a61a25e6cbaa tempest-ServersTestJSON-2105007104 tempest-ServersTestJSON-2105007104-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046466047" status: 202 len: 0 microversion: 2.1 time: 0.056178 Aug 30 18:33:53.146698 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1932/3967] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:33:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046466047 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:53.153060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:53.153754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:53.196943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.197453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.201126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.201980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.202494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.204605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.305990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.308148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.308514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.309082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lazy-loading 'fault' on Instance uuid 041a382e-8f90-4042-9568-f12f58d74ca2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:53.584167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f351a2-9905-4472-8234-c1e10e1377e6", "tag": "b04496e4-4e49-4707-bc88-92179e6edf28"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:53.597192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:53.609372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a56b456-68fb-4610-8fe8-2d6f46f8fd81 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 200 len: 1307 microversion: 2.1 time: 0.464327 Aug 30 18:33:53.612041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2036/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:53 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:53.628215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:53.630079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:53.637733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:53.638408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:53.639079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:53.659710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] Creating event network-changed:b04496e4-4e49-4707-bc88-92179e6edf28 for instance e3f351a2-9905-4472-8234-c1e10e1377e6 on n-h2-854119-10 Aug 30 18:33:53.672269 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ee2070de-495e-4197-87a4-4f9cf1b6e402 req-90b8cf56-f12e-458e-98e6-05e26cfd4732 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094180 Aug 30 18:33:53.673962 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1933/3969] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:54.015869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.017127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:54.026872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.028658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.031076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.032443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.033909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.034558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.062977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:54.069304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.070147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:54.084438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.087245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.087714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.088488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.094284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.095089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.213803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:54.391625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:54.406308 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c03bbb90-a357-4da1-baab-cc600b9ddb77 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.341193 Aug 30 18:33:54.411884 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1934/3970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:54 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:54.635163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.635779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 041a382e-8f90-4042-9568-f12f58d74ca2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:54.654519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.655182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.663563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.664636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.665267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.665848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.672880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:54.700304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3661021f-d078-4d04-b5f8-5fc3d847c4b9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1655 microversion: 2.1 time: 0.687520 Aug 30 18:33:54.712473 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 HTTP/1.1 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '041a382e-8f90-4042-9568-f12f58d74ca2'} Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:33:54.714522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. Aug 30 18:33:54.718462 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:33:54.720384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance 041a382e-8f90-4042-9568-f12f58d74ca2 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:33:54.721380 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2037/3971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:54 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1655 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:54.721780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0fd6da0d-311f-41b7-9f29-3e44c493a230 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2" status: 404 len: 111 microversion: 2.1 time: 0.090542 Aug 30 18:33:54.722474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1935/3972] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:54 2022] GET /compute/v2.1/servers/041a382e-8f90-4042-9568-f12f58d74ca2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:33:54.730333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.730999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:54.731559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:54.740988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.741812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.744499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.744842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.746913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.747576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.748496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.759124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.759906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.781093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Going to try to start instance {{(pid=122589) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:33:54.819320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:33:54.894724 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c91d7140-36d3-49a5-b89e-2775c57f57ba tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.171479 Aug 30 18:33:54.897265 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2038/3973] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:54 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:54.908727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.909837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:54.918152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.919304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.920060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.921171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:54.923335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:54.924149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:54.930082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:54.955710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f15e2e9-279f-44bc-840a-90a356254091 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 204 len: 0 microversion: 2.1 time: 0.228689 Aug 30 18:33:54.959447 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1936/3974] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:33:54 2022] DELETE /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:33:54.983693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:54.984400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:55.000361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:55.000893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:55.003304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:55.004447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:55.004864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:55.005298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:55.054373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:33:55.278964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:55.291728 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36a7d4d9-7351-445e-9770-bbd35338a3d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1664 microversion: 2.1 time: 0.388156 Aug 30 18:33:55.295651 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2039/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:54 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1664 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:55.434015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:55.434659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:55.450561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:55.451331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:55.452427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:55.453405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:55.454097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:55.454561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:55.963371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:55.973625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ced5bcfc-eeba-4ee3-a8ec-0bdf7bc75a06 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.543442 Aug 30 18:33:55.974224 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2040/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:55 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:56.116816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:56.133112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-548b7536-09ea-4f0c-95df-b261be23bfcf tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1473 microversion: 2.1 time: 1.163940 Aug 30 18:33:56.134068 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1937/3977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:54 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1473 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:56.320490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:56.323116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:56.331772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:56.332408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:56.332946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:56.333765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:56.334441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:56.334904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:56.580096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:56.605185 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ebb5834-b056-4984-94da-7528536170cf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1664 microversion: 2.1 time: 0.293058 Aug 30 18:33:56.619739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2041/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:56 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1664 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:57.008821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:57.010441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:57.029710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.032756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.033924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:57.037926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.043278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.044187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:57.163113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:57.163934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:57.178549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.179548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.179996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:57.183412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.183936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.184385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:57.719924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:57.765075 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d5d2f5f-fae1-4bdd-9e21-9ee9a136f995 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.762512 Aug 30 18:33:57.782841 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1938/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:57 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:57.790971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:57.796691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:57.801398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:57.808409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5384fea4-88f6-4827-8171-9376a3a231ce tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1473 microversion: 2.1 time: 0.649513 Aug 30 18:33:57.809072 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2042/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:57 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1473 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:33:57.829106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.829618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.830062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:57.831229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:57.831934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:57.832718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.204671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:58.216050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47c92a7b-41ae-4590-944c-a8c313a8df39 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.443361 Aug 30 18:33:58.219394 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1939/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:57 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:58.240808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:58.242142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:58.277017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.278265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.282082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.286083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.288206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.290097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.595220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:58.604941 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a4f06e8-e66a-463f-8e05-05ecf3032bd3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.368617 Aug 30 18:33:58.611756 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2043/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:58 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:58.636554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:58.637129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:58.653320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.653929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.654454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.656101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.656573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.657586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.713449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141ee28c-a38d-41e0-b219-f9047c629b3c", "name": "network-vif-deleted", "tag": "d1641c66-89db-4cbd-9a29-efd2cfc37622"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:58.741120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.741606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.760663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.810753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] Creating event network-vif-deleted:d1641c66-89db-4cbd-9a29-efd2cfc37622 for instance 141ee28c-a38d-41e0-b219-f9047c629b3c on n-h2-854119-10 Aug 30 18:33:58.823594 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-15b98b00-2a7e-4783-921e-299824acbd6a req-d311de24-85fa-42d4-90c0-edc706374a9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114424 Aug 30 18:33:58.829967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2044/3983] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:33:58.843992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Unlocking {{(pid=122590) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 18:33:58.847482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:58.852326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:58.891944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.893197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.895948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:58.896901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:58.898263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:58.898928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.022290 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c8065c5-aeff-4488-8adc-9043814af431 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.390370 Aug 30 18:33:59.030696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1940/3984] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:33:58 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:33:59.043537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:59.044163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:59.061844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.071194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.071672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.072572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.073054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.073480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.169104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.169673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.170416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.171152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lazy-loading 'fault' on Instance uuid 141ee28c-a38d-41e0-b219-f9047c629b3c {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:33:59.344067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:59.358209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3805630e-afa2-4dab-8985-5a8f6ae2cb93 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 200 len: 1307 microversion: 2.1 time: 0.326512 Aug 30 18:33:59.359195 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1941/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:59 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:59.366052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:59.366933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:59.378394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.378909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.379343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.380214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.380762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.382963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.516943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:59.528929 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e06f506e-a40d-4765-9bdb-156c5cd9ce10 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.696694 Aug 30 18:33:59.531743 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2045/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:58 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:59.559493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f351a2-9905-4472-8234-c1e10e1377e6", "name": "network-vif-plugged", "status": "completed", "tag": "b04496e4-4e49-4707-bc88-92179e6edf28"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:33:59.573331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.574214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.574935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.589386 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] Creating event network-vif-plugged:b04496e4-4e49-4707-bc88-92179e6edf28 for instance e3f351a2-9905-4472-8234-c1e10e1377e6 on n-h2-854119-10 Aug 30 18:33:59.602109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-29d3bf3b-92d8-41d3-9597-54fa8116b31a req-d32e535a-513c-42d3-97b2-d3534d366aa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Aug 30 18:33:59.607478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2046/3987] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:33:59.839845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:33:59.858360 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-140477a3-8732-4070-80ae-d339d74f8508 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.497710 Aug 30 18:33:59.871122 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1942/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:59 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:33:59.883822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:33:59.885229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:33:59.896588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.903726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.904529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:33:59.905773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:33:59.906484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:33:59.907117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.342130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:00.353609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1022f456-25f7-4218-8319-4d5ba0e02414 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.474378 Aug 30 18:34:00.356807 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2047/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:33:59 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:00.386517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:00.388111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 141ee28c-a38d-41e0-b219-f9047c629b3c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:00.393228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:00.394569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:00.401731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.402691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.403347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.404280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.405125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.405954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.407641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.408179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.408627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.410236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.411717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.413424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.453954 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c HTTP/1.1 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '141ee28c-a38d-41e0-b219-f9047c629b3c'} Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:00.468391 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. Aug 30 18:34:00.473021 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:00.475148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance 141ee28c-a38d-41e0-b219-f9047c629b3c could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:00.476209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f6e7a0d7-2b43-4509-8d88-ebd8a2d77156 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c" status: 404 len: 111 microversion: 2.1 time: 0.096616 Aug 30 18:34:00.481831 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1943/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:00 2022] GET /compute/v2.1/servers/141ee28c-a38d-41e0-b219-f9047c629b3c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:00.489281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:00.494119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:00.511460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.512425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.513182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.514741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.516472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.517114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.597120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:00.813856 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-501c8977-9b89-4e10-88b8-4bda1977ff6d tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 204 len: 0 microversion: 2.1 time: 0.328157 Aug 30 18:34:00.815101 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1944/3991] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:00 2022] DELETE /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:00.830060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:00.831904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:00.842774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.849823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.850283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.851066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.851617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.851928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.893088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:00.908355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28fd8c3e-0129-4ea4-ad55-fc67eb37b8c8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.522253 Aug 30 18:34:00.908973 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2048/3992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:00.929806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:00.930300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:00.937679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.938162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.938835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.939698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:00.940144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:00.940723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:00.976145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:01.019251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:01.189095 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-02e0c11a-4d56-41a0-8222-0f0b9865a455 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 204 len: 0 microversion: 2.1 time: 0.264664 Aug 30 18:34:01.191416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2049/3993] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:00 2022] DELETE /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:01.211923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:01.212830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:01.230589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.231120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.235010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.235887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.236488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.237566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.292890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:01.326802 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb65e0fa-dc67-49c3-8e3f-53efe8f8d651 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1314 microversion: 2.1 time: 0.508999 Aug 30 18:34:01.327445 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1945/3994] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:00 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:01.344013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:01.345436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:01.363439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.366472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.367166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.368761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.369289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.369738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.383598 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0fed3d63-e40d-4c63-9d52-a84f96b0a7b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.189514 Aug 30 18:34:01.386389 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2050/3995] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:34:01 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:01.401025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:01.404233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:01.421835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.424307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.424755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.425486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:01.425946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:01.426752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:01.950011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:01.967717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-174a9c5e-2c83-4dbe-969c-d3d5caf83fbd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1673 microversion: 2.1 time: 0.575317 Aug 30 18:34:01.971468 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2051/3996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:01 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1673 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:02.111776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:02.137840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4eefa7ce-063a-4fe7-8b88-677de209b50b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 200 len: 1474 microversion: 2.1 time: 0.808971 Aug 30 18:34:02.139335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1946/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:01 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 1474 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:02.350065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:02.350905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:02.364512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:02.365383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:02.367009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:02.369148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:02.370075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:02.371808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.007020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:03.008336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:03.016540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.017360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.017804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.018564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.019210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.019795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.044358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:03.059220 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-33ca28a8-101a-42dc-94b8-35e936eb698d tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1464 microversion: 2.1 time: 0.714588 Aug 30 18:34:03.059827 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2052/3998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:02 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1464 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:03.086966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8272c052-163a-4404-9655-6f6add97dc02", "device": "/dev/sdb"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:03.090069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:03.096858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.097359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.097801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.098573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.099242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.099449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.446544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:03.455694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4effd964-929a-4f2b-b653-de538cc76ea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1653 microversion: 2.1 time: 0.454084 Aug 30 18:34:03.456478 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1947/3999] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1653 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:03.471464 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7fa9993b-eabe-450d-8679-1fca7d94203f tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "POST /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387805 Aug 30 18:34:03.473374 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2053/4000] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:34:03 2022] POST /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:03.485432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:03.486171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:03.487762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:03.488393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:03.494813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.495657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.496812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.497830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.498716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.499458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.508132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.508934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.509531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.510652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.511392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.512174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.640396 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6aeb5764-2c34-4648-989b-54bcfe9ea2e7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.156700 Aug 30 18:34:03.641338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2054/4001] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:34:03 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:03.651107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:03.654214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:03.676180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.677101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.678078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:03.679121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:03.679760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:03.680359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:04.075246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:04.084114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36d33e96-4b23-4bef-8899-4d595d1a2723 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1660 microversion: 2.1 time: 0.437536 Aug 30 18:34:04.084701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2055/4002] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1660 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:04.131244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:04.149200 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2f98ebc-07d6-42ec-a464-c5fd9b9cecca tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 200 len: 1474 microversion: 2.1 time: 0.676820 Aug 30 18:34:04.157880 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1948/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:03 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 1474 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:04.344446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6379754-2b76-4a5e-b182-fc33a1ddfffe", "name": "network-vif-deleted", "tag": "1ed730c5-4b85-47ec-a4d6-8540dc811942"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:04.369861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:04.375235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:04.376689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:04.401856 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] Creating event network-vif-deleted:1ed730c5-4b85-47ec-a4d6-8540dc811942 for instance f6379754-2b76-4a5e-b182-fc33a1ddfffe on n-h2-854119-10 Aug 30 18:34:04.418729 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-af5cd2b1-fd44-42c5-90de-1e90163aebaa req-25b05e5f-2d7d-491e-8da7-3a8cafd403b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080616 Aug 30 18:34:04.420144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2056/4004] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:04.927832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417bb94f-0d75-48ab-9cc2-69cfcd49ca80", "name": "network-vif-deleted", "tag": "cbafb664-e868-43e8-8f2d-250f3e40b12d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:04.942928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:04.943786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:04.944390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:04.966282 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] Creating event network-vif-deleted:cbafb664-e868-43e8-8f2d-250f3e40b12d for instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 on n-h1-854119-10 Aug 30 18:34:04.972578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-36b592fa-d0a6-481d-8291-de333f515e32 req-1e71530d-d364-4c33-ae20-ac930da09a81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048885 Aug 30 18:34:04.973473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1949/4005] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:05.123021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:05.126801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:05.192042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:05.196876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:05.204260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:05.205748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:05.206963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:05.211143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:05.214071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:05.216560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:05.266492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:05.267015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:05.267469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:05.268225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:05.268694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:05.269128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:05.340662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:05.411695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:05.413340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:05.414009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:05.414743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lazy-loading 'fault' on Instance uuid 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:34:05.936314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:05.938976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:05.950015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13c3acf2-6ffc-4591-8b03-1f51f346e8bb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 200 len: 1309 microversion: 2.1 time: 0.774904 Aug 30 18:34:05.950987 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1950/4006] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:05 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 1309 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:05.976671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bd5af83-89ad-47ff-b25a-0941c030f836 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.842950 Aug 30 18:34:06.003691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:06.004325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:06.010030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2057/4007] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:06.011832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:06.012345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:06.016636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:06.017534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:06.018036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:06.018525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:06.920872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:06.929835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-243c7b0e-894b-402e-a311-8608a05f9518 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.930449 Aug 30 18:34:06.930446 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1951/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:06.957684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:06.959633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:06.973031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:06.976250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:06.978116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:06.984472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 417bb94f-0d75-48ab-9cc2-69cfcd49ca80] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:06.985411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:06.986461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:06.990662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:06.991289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.003624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.007086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.007762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.008739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.009382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.014075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.049010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 HTTP/1.1 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '417bb94f-0d75-48ab-9cc2-69cfcd49ca80'} Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:07.050766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. Aug 30 18:34:07.055873 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.057212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance 417bb94f-0d75-48ab-9cc2-69cfcd49ca80 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:07.063112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f497bbc7-59ad-44f7-81e5-e5fd6ff26c85 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80" status: 404 len: 111 microversion: 2.1 time: 0.095063 Aug 30 18:34:07.064494 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1952/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:06 2022] GET /compute/v2.1/servers/417bb94f-0d75-48ab-9cc2-69cfcd49ca80 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:07.074416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.076593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: f6379754-2b76-4a5e-b182-fc33a1ddfffe] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:07.091261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.092084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.093056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.095273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.097112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.098934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.129148 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe HTTP/1.1 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f6379754-2b76-4a5e-b182-fc33a1ddfffe'} Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:07.140349 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. Aug 30 18:34:07.144299 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:07.149262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance f6379754-2b76-4a5e-b182-fc33a1ddfffe could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:07.153836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab1aca9e-1545-4845-8438-b1979f2d2a51 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe" status: 404 len: 111 microversion: 2.1 time: 0.082145 Aug 30 18:34:07.159302 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1953/4010] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:07 2022] GET /compute/v2.1/servers/f6379754-2b76-4a5e-b182-fc33a1ddfffe => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:34:07.184879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-effcbe43-cf1a-4a12-bd25-6e4733cc8b78 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.293609 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-effcbe43-cf1a-4a12-bd25-6e4733cc8b78 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/5d24059d-529d-461a-b25e-db8ed0928cd7" status: 204 len: 0 microversion: 2.1 time: 0.126507 Aug 30 18:34:07.296272 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1954/4011] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:34:07 2022] DELETE /compute/v2.1/os-server-groups/5d24059d-529d-461a-b25e-db8ed0928cd7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:34:07.313910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.317582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:07.338854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.343678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.345643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.349610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.350648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.355023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.430826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:07.608173 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57e47c1b-9a67-4a9e-a694-d545c08231a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 204 len: 0 microversion: 2.1 time: 0.306058 Aug 30 18:34:07.613684 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1955/4012] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:07 2022] DELETE /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:07.620593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.621495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:07.629313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.630279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.631023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.632649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.633299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.633971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.671597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:07.687566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:07.726133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-594d308b-4211-4000-8d43-597644d02c3a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.773940 Aug 30 18:34:07.756638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2058/4013] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:06 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:07.766171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.766827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:07.788282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.788791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.789235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.789963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.790470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.790898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.887538 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2a21b7b-a860-4977-b14f-f99cbeed8746 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 204 len: 0 microversion: 2.1 time: 0.270325 Aug 30 18:34:07.893460 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1956/4014] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:07 2022] DELETE /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:07.906131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:07.907237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:07.929478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.930095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.930773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:07.931523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:07.931976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:07.932397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:08.233804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:08.246872 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4bf02bae-13fa-4983-998d-06f85aa64439 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.484992 Aug 30 18:34:08.264256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2059/4015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:07 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:08.276073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:08.276711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:08.291070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:08.294051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:08.294723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:08.296479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:08.297977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:08.300334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:08.319713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:08.333178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-311c6328-acb2-40d0-ba54-a03ffdb25094 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1475 microversion: 2.1 time: 0.437207 Aug 30 18:34:08.335046 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1957/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:07 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1475 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:08.653559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:08.671421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a2bbfb51-8a24-4a38-810d-29484f2ebaf1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.402066 Aug 30 18:34:08.683050 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2060/4017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:08 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:08.703700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:08.704532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:08.737798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:08.740887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:08.745572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:08.749490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:08.749995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:08.752900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:09.127337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:09.145127 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-572da1c4-ab0b-41e3-aa3b-ad8a3a1d00a2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.445635 Aug 30 18:34:09.158527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1958/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:08 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:09.355686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:09.356990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:09.367986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:09.372464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:09.380023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:09.381138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:09.381816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:09.382551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:09.671556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:09.687939 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c5f8439-96ac-4731-88c4-abe5154e31af tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1475 microversion: 2.1 time: 0.332165 Aug 30 18:34:09.701097 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2061/4019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:09 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1475 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:10.709134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:10.709763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:10.718157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:10.727314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:10.727949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:10.728936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:10.729566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:10.730172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:11.148490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:11.163220 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1cb43591-ad0b-4a08-ac40-c84f6fe2569c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1475 microversion: 2.1 time: 0.458461 Aug 30 18:34:11.164218 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1959/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:10 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:11.452959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89d5899-a4c2-4d8d-9c20-f03eb4da8a89", "name": "network-vif-deleted", "tag": "5be28d65-c6e8-408f-8114-66ddc6d5df85"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:11.468653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:11.471373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:11.474266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:11.522934 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] Creating event network-vif-deleted:5be28d65-c6e8-408f-8114-66ddc6d5df85 for instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 on n-h2-854119-10 Aug 30 18:34:11.545848 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-86deecdd-d0d2-4b4c-a865-c2be28ca1300 req-0259b245-ae21-460d-bbb9-20e48626ef5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106131 Aug 30 18:34:11.557988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2062/4021] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:12.039715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9da4b6e-63bb-43e1-b2fd-81b160b04b04", "name": "network-vif-deleted", "tag": "96398ab4-cc0a-4858-b7af-9e2b54944891"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:12.095031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:12.095836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:12.096698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:12.112165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] Creating event network-vif-deleted:96398ab4-cc0a-4858-b7af-9e2b54944891 for instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 on n-h2-854119-10 Aug 30 18:34:12.141689 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1b8d0e3b-1f76-478b-9fd4-a5036fb00484 req-645b71ed-4317-4323-95f1-96b746f22bf0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130651 Aug 30 18:34:12.150678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1960/4022] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:12.188920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:12.190079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:12.205140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:12.206179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:12.207042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:12.208159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:12.208847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:12.209515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:12.256419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:12.325802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:12.326656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:12.327381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:12.328377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lazy-loading 'fault' on Instance uuid e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:34:12.514759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:12.544109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ef557997-49ac-43a8-884a-1e6a151af13f tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 200 len: 1309 microversion: 2.1 time: 0.358840 Aug 30 18:34:12.547285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2063/4023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:12 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:13.573630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:13.574630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: e89d5899-a4c2-4d8d-9c20-f03eb4da8a89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:13.596057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.597156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.598316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:13.602032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.607045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.607906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:13.633905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 HTTP/1.1 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e89d5899-a4c2-4d8d-9c20-f03eb4da8a89'} Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:13.635728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. Aug 30 18:34:13.640974 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.644080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:13.645197 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1641d74e-97bf-4865-a8fa-bf27ad2824eb tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89" status: 404 len: 111 microversion: 2.1 time: 0.077926 Aug 30 18:34:13.649569 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1961/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:13 2022] GET /compute/v2.1/servers/e89d5899-a4c2-4d8d-9c20-f03eb4da8a89 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:13.655903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:13.656773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: a9da4b6e-63bb-43e1-b2fd-81b160b04b04] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:13.670443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.675986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.676702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:13.677937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.679957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.680710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:13.718600 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 HTTP/1.1 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a9da4b6e-63bb-43e1-b2fd-81b160b04b04'} Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:13.720643 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. Aug 30 18:34:13.726806 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:13.727550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance a9da4b6e-63bb-43e1-b2fd-81b160b04b04 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:13.736521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5dcfa9f-5fd7-4350-95ce-2eb4af275a0b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04" status: 404 len: 111 microversion: 2.1 time: 0.085235 Aug 30 18:34:13.741808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2064/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:13 2022] GET /compute/v2.1/servers/a9da4b6e-63bb-43e1-b2fd-81b160b04b04 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:13.750866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48de86aa-c693-4608-b6ec-82239abce8f8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:13.836354 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48de86aa-c693-4608-b6ec-82239abce8f8 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/8edfed3b-258b-427d-a863-3d2573c1eb9e" status: 204 len: 0 microversion: 2.1 time: 0.091892 Aug 30 18:34:13.842236 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1962/4026] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:34:13 2022] DELETE /compute/v2.1/os-server-groups/8edfed3b-258b-427d-a863-3d2573c1eb9e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:13.851044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:13.851865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:13.879507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.895480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.901123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:13.905325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:13.915612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:13.917297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:14.065063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:14.305711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:14.315490 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5a97c79-14af-4e04-ae80-6eeb9057557b tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 204 len: 0 microversion: 2.1 time: 0.471800 Aug 30 18:34:14.317426 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2065/4027] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:13 2022] DELETE /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:14.333107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:14.334794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:14.356219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:14.357098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:14.359063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:14.360093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:14.363036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:14.365321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:15.366217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:15.382263 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0fbad007-c612-4452-8643-fb995091d6de tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1472 microversion: 2.1 time: 1.057883 Aug 30 18:34:15.386140 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1963/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:14 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1472 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:16.416918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:16.418631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:16.431015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:16.432742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:16.434418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:16.436372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:16.437680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:16.438788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:16.922126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:16.923693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a24854-c37f-424f-b14c-1f7350b34928", "name": "network-vif-deleted", "tag": "320c9108-beeb-433e-97c9-2b38cbd69ef5"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:16.931653 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f272dd71-4abc-40a8-823a-e7a303c7448c tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1430 microversion: 2.1 time: 0.523031 Aug 30 18:34:16.936941 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2066/4029] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:16 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1430 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:16.964343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:16.966497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:16.967066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:17.022746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] Creating event network-vif-deleted:320c9108-beeb-433e-97c9-2b38cbd69ef5 for instance 50a24854-c37f-424f-b14c-1f7350b34928 on n-h1-854119-10 Aug 30 18:34:17.046192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d6695feb-ea6c-438f-9b5d-202d96c9def6 req-52fdaba2-7071-4db8-bc92-2a1581444ed5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128494 Aug 30 18:34:17.046854 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1964/4030] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:17.413375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:17.414142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:17.450086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:17.450828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:17.451335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:17.452278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:17.452742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:17.453168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:17.532939 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bbe6ac1-2855-4493-8696-05e2fd444b24 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.124316 Aug 30 18:34:17.533660 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2067/4031] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:34:17 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/ips => generated 149 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:17.958654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:17.960062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:17.992906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:17.993398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:18.018009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:18.020083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:18.022424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:18.023067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:18.156822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:18.160102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:18.160612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:18.161106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lazy-loading 'fault' on Instance uuid 50a24854-c37f-424f-b14c-1f7350b34928 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:34:18.361610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2f1e90faa441c4bc88d9c2f716c8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f690e184dcdf48babd667cff7823cf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:18.372600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2df070d9-356f-4dfd-81d8-b7708a473872 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 200 len: 1306 microversion: 2.1 time: 0.420326 Aug 30 18:34:18.373244 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1965/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:17 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 1306 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:19.394262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:19.394922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] [instance: 50a24854-c37f-424f-b14c-1f7350b34928] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:19.417028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:19.417639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:19.423921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:19.426296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:19.428212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:19.428762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:19.463241 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] HTTP exception thrown: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Request method failure captured: Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 HTTP/1.1 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDldY9IlHjiKHJCtG4n-XhHwfWRoMEyF5FKy1HK9zNGoC2ZkKn33LV3lCTQXlzfQohyrqFtx5c6NVIqbIEdiqhxZeddOCXM_B1FmHbdTWZTG1Xeo7mv7vzRTMmRs6_8JgaF846wY4TlPTgAXEjAOFsyRjYGY6oRuddZXDlEE1eQ2n4ok Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f690e184dcdf48babd667cff7823cf40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f690e184dcdf48babd667cff7823cf40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f690e184dcdf48babd667cff7823cf40 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1322176073 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 9c2f1e90faa441c4bc88d9c2f716c8d2 Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersOnMultiNodesTest-1322176073-project Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '50a24854-c37f-424f-b14c-1f7350b34928'} Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:19.468381 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. Aug 30 18:34:19.472314 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:19.477614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] Returning 404 to user: Instance 50a24854-c37f-424f-b14c-1f7350b34928 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:19.482216 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f17dbe2d-dc5f-4c52-ba06-514a3275d1a6 tempest-ServersOnMultiNodesTest-1322176073 tempest-ServersOnMultiNodesTest-1322176073-project] 10.222.0.25 "GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928" status: 404 len: 111 microversion: 2.1 time: 0.092601 Aug 30 18:34:19.499634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2068/4033] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:19 2022] GET /compute/v2.1/servers/50a24854-c37f-424f-b14c-1f7350b34928 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:34:20.419391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d00718-49f3-424c-8be6-9b2027f040e3"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:20.421965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:20.446946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:20.447454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:20.447900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:20.448628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:20.449090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:20.449520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:21.168208 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84c230ce-d389-477e-bfb4-2fea439bee9a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "POST /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745799 Aug 30 18:34:21.171147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1966/4034] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:34:20 2022] POST /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:22.412896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1607909053", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:22.541093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] validate_networks() for [('fd033e32-b84a-49f8-92fd-cff5c8733dfd', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:34:23.732401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:34:23.733669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:34:23.734382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:34:23.735023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:34:23.735929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:34:23.756736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:23.759588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:23.761665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:23.762848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:23.766064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:23.768642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:23.887947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Getting quotas for project 5334c78e90284de7bdffb6eddf9a32ca. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:34:23.917852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Getting quotas for user dca901cc5b0b41c08aab5eca6bcf4d0c and project 5334c78e90284de7bdffb6eddf9a32ca. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:34:24.030012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:34:24.040406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:34:24.200748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6716415c-b02d-41c2-9da0-5f6c7ae45f7e tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.453838 Aug 30 18:34:24.203532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2069/4035] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:34:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:34:24.217182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-542cb6d1-6ad9-461a-8333-6d2da1e7d006 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:24.230555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-542cb6d1-6ad9-461a-8333-6d2da1e7d006 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:24.265095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:24.417381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-542cb6d1-6ad9-461a-8333-6d2da1e7d006 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:24.427192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-542cb6d1-6ad9-461a-8333-6d2da1e7d006 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1214 microversion: 2.1 time: 0.215953 Aug 30 18:34:24.442514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1967/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:24 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:25.454233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:25.454233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:25.495502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:25.496230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:25.498849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:25.502270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:25.503976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:25.507962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:25.931136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:25.947340 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2445e835-3c0e-4e5c-81f3-1a1866b23faf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1218 microversion: 2.1 time: 0.500145 Aug 30 18:34:25.954185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2070/4037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:25 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1218 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:26.394066 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8e14b26-0198-43c3-bf6e-fe86379e65d4 tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T18%3A34%3A26.059192&end=2022-08-31T18%3A34%3A26.059192" status: 404 len: 112 microversion: - time: 0.330250 Aug 30 18:34:26.405998 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1968/4038] 10.222.0.25 () {58 vars in 1316 bytes} [Tue Aug 30 18:34:26 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T18%3A34%3A26.059192&end=2022-08-31T18%3A34%3A26.059192 => generated 112 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 18:34:26.416777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75c0f9ae-659a-470c-9a8c-45255ec82dcf tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] Calling method '.version_select at 0x7f4e572ffaf0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:26.430306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-75c0f9ae-659a-470c-9a8c-45255ec82dcf tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75c0f9ae-659a-470c-9a8c-45255ec82dcf tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] Request method failure captured: Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-simple-tenant-usage/bf8f61934cff43c18388ace74551af6a?start=2022-08-31T18%3A34%3A26.059192&end=2022-08-29T18%3A34%3A26.059192 HTTP/1.1 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlgxOK5Ae0raONDQHfNU-205OpMB5M05qWStW3_ocq6PfVnnCq1Qum1RSssb69Cbo8CUUNPTLawzS1A8UMTmS5qo6Hkk4EoZMwbTWqoApefkMApO1V1SL4sOHbzZ0Bq9LjLQjK8fSXbzrt3l1JHZUNi8F7Pl7AY6Oa9jnRJMi9DhZj0 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8ed3861f1d74486685cc2075e13a5ee0 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1030218412 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ed3861f1d74486685cc2075e13a5ee0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8ed3861f1d74486685cc2075e13a5ee0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ed3861f1d74486685cc2075e13a5ee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8ed3861f1d74486685cc2075e13a5ee0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1030218412 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8ed3861f1d74486685cc2075e13a5ee0 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1030218412 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 84afc5cbeffc4cfa8de4afd275bc12f1 Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid start time. The start time cannot occur after the end time. Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bf8f61934cff43c18388ace74551af6a'} Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 30 18:34:26.439776 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.445603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-75c0f9ae-659a-470c-9a8c-45255ec82dcf tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:26.446741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-75c0f9ae-659a-470c-9a8c-45255ec82dcf tempest-TenantUsagesNegativeTestJSON-1030218412 tempest-TenantUsagesNegativeTestJSON-1030218412-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/bf8f61934cff43c18388ace74551af6a?start=2022-08-31T18%3A34%3A26.059192&end=2022-08-29T18%3A34%3A26.059192" status: 400 len: 111 microversion: 2.1 time: 0.034190 Aug 30 18:34:26.447491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2071/4039] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Aug 30 18:34:26 2022] GET /compute/v2.1/os-simple-tenant-usage/bf8f61934cff43c18388ace74551af6a?start=2022-08-31T18%3A34%3A26.059192&end=2022-08-29T18%3A34%3A26.059192 => generated 111 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:34:26.822732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d43c22e9-ee23-42d4-8242-c642555f9ff5 tempest-TenantUsagesNegativeTestJSON-138435244 tempest-TenantUsagesNegativeTestJSON-138435244-project] Calling method '.version_select at 0x7f4e55b8fd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:26.848730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d43c22e9-ee23-42d4-8242-c642555f9ff5 tempest-TenantUsagesNegativeTestJSON-138435244 tempest-TenantUsagesNegativeTestJSON-138435244-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fbfafa79148a4f0bacbe52b5f259580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f61934cff43c18388ace74551af6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d43c22e9-ee23-42d4-8242-c642555f9ff5 tempest-TenantUsagesNegativeTestJSON-138435244 tempest-TenantUsagesNegativeTestJSON-138435244-project] Request method failure captured: Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T18%3A34%3A26.059192&end=2022-08-31T18%3A34%3A26.059192&detailed=1 HTTP/1.1 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlgwb1EQtSVQ-14Tlw0WZQRj5FtNldqY-HLkgb6iDvXfHZgmq-IOYWlBNNIzHLv5qEBegm07_iJIn2J1VQRpkLHc_Gu2rx1jmRLrezdT15zp45m9WOmFWjPJCL9FmZqX4f3kpa9pIi8g9KZE2p6NBtfx0opX0rUTxo2hLw7Rmcgh3VE Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: bf8f61934cff43c18388ace74551af6a Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-138435244 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8f61934cff43c18388ace74551af6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bf8f61934cff43c18388ace74551af6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8f61934cff43c18388ace74551af6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bf8f61934cff43c18388ace74551af6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-138435244 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: bf8f61934cff43c18388ace74551af6a Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-138435244 Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TenantUsagesNegativeTestJSON-138435244-project Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: fbfafa79148a4f0bacbe52b5f259580e Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-138435244-project Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: action_args: {} Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 18:34:26.851420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 18:34:26.855490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:34:26.859147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d43c22e9-ee23-42d4-8242-c642555f9ff5 tempest-TenantUsagesNegativeTestJSON-138435244 tempest-TenantUsagesNegativeTestJSON-138435244-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:26.860268 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d43c22e9-ee23-42d4-8242-c642555f9ff5 tempest-TenantUsagesNegativeTestJSON-138435244 tempest-TenantUsagesNegativeTestJSON-138435244-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T18%3A34%3A26.059192&end=2022-08-31T18%3A34%3A26.059192&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.405315 Aug 30 18:34:26.918716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1969/4040] 10.222.0.25 () {58 vars in 1335 bytes} [Tue Aug 30 18:34:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T18%3A34%3A26.059192&end=2022-08-31T18%3A34%3A26.059192&detailed=1 => generated 123 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:27.019885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:27.025070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:27.133464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:27.137930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:27.138458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:27.139233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:27.139706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:27.140148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:27.612371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:27.626678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b0a24c1-e4af-4457-b54b-4958a15beaaf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1274 microversion: 2.1 time: 0.638645 Aug 30 18:34:27.643102 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2072/4041] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:26 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1274 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:28.653230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:28.653984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:28.666201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:28.682320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:28.683389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:28.684266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:28.684756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:28.685526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:28.782366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:31.161308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce51b58d-52da-488c-bd92-ae5fd698d608", "tag": "4edf6eb2-d6f7-47aa-b1aa-f245734c137b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:31.176493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:31.177235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:31.178139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:31.214452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] Creating event network-changed:4edf6eb2-d6f7-47aa-b1aa-f245734c137b for instance ce51b58d-52da-488c-bd92-ae5fd698d608 on n-h2-854119-10 Aug 30 18:34:31.223951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:31.246890 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-894a2172-e477-41da-a06c-f66cbac086f5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 2.597186 Aug 30 18:34:31.253278 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ade9ed4a-103b-476c-b0c5-363a7feedece req-67303f96-f10f-4e28-85c0-31c8c6d2b685 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096318 Aug 30 18:34:31.254012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2073/4042] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:31.257587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1970/4043] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:28 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 2612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:32.286134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:32.287026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:32.316372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:32.317029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:32.325845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:32.330712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:32.331276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:32.331719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.141398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:33.155861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3c9618d-4695-4c2d-b5e2-f362082fac5f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 0.875913 Aug 30 18:34:33.178192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2074/4044] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:32 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:33.549752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:33.554889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:33.598104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.605030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.605732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.607173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.608554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.609298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.796622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3364514-ec45-42ea-b2f0-43cf39466987 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.253170 Aug 30 18:34:33.803082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1971/4045] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:34:33 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:33.845975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:33.850582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:33.871560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:33.884179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.884179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.884179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.884179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:33.885761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:33.886857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:33.977414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:34.188385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:34.190219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:34.205238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:34.207456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:34.209293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:34.210171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:34.211741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:34.212486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:34.363869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:34.374630 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-938b3f69-9d71-48ae-9c90-80f7d11f9b1b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1670 microversion: 2.1 time: 0.568758 Aug 30 18:34:34.375247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2075/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:33 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:34.425167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:34.704502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:34.745354 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99d866f7-8cc5-42b6-9ae9-50bc0bb24e0b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 0.557049 Aug 30 18:34:34.764055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1972/4047] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:34 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:35.409477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:35.413261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:35.431916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.433387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.434006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.434900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.436262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.436994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.777141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:35.777923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:35.850521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.852298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.857686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.858558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:35.860433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:35.866140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:35.875418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:35.896806 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a6b124c-fa60-4a85-9f4b-0c93ceda2e68 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1670 microversion: 2.1 time: 0.496106 Aug 30 18:34:35.908110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2076/4048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:35 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1670 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:36.314740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:36.344941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f215c567-6e21-48cf-a06d-c0d129cacb2f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 0.579319 Aug 30 18:34:36.364250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1973/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:35 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:36.956957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:36.966707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:36.979032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:36.987627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:36.988334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:36.990305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:36.993035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:36.994374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.320759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:37.336998 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa570c54-d75e-4d89-887d-4fc9dda0f6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.387589 Aug 30 18:34:37.351236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2077/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:36 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:37.371826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:37.373932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:37.403613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce51b58d-52da-488c-bd92-ae5fd698d608", "name": "network-vif-plugged", "status": "completed", "tag": "4edf6eb2-d6f7-47aa-b1aa-f245734c137b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:37.414090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:37.414737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:37.415198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.415964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:37.416428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:37.416865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.449608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:37.450121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:37.456252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:37.501433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] Creating event network-vif-plugged:4edf6eb2-d6f7-47aa-b1aa-f245734c137b for instance ce51b58d-52da-488c-bd92-ae5fd698d608 on n-h2-854119-10 Aug 30 18:34:37.533101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-013ae5f2-a777-458b-80e2-eab07319302f req-e13815f1-3cb1-420c-8404-a0034d4f6890 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134152 Aug 30 18:34:37.538789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2078/4051] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:37.955095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:37.964686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e48e330-d3a9-4dd2-9bda-f8339372c842 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 0.597122 Aug 30 18:34:37.972392 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1974/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:37 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:38.995769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:38.996487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:39.018848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:39.034803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:39.036376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:39.038098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:39.041767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:39.045522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:39.848377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:39.861070 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fca25366-5577-41a7-8dc6-ee39fd3a2f8f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1314 microversion: 2.1 time: 0.870239 Aug 30 18:34:39.864469 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2079/4053] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:38 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:40.883699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:40.885648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:40.913251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:40.913774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:40.914226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:40.921917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:40.922453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:40.922909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:41.086978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:41.087611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:41.105091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:41.105682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:41.106088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:41.113436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:41.114051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:41.117505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:41.391853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lazy-loading 'services' on Instance uuid e18226d6-d56c-4be4-b19c-a427e2da15ac {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:34:41.635986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a1b05a7-ed30-4281-a303-34103c0987b2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments/26d00718-49f3-424c-8be6-9b2027f040e3" status: 202 len: 0 microversion: 2.1 time: 0.552420 Aug 30 18:34:41.659860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2080/4054] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:34:41 2022] DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments/26d00718-49f3-424c-8be6-9b2027f040e3 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:34:41.675919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:41.704994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:41.728522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:41.728995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:41.754908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:41.757345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:41.758303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:41.759022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:41.836315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-401699fd-7d88-485f-af0c-69a6367dc9ac tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169685 Aug 30 18:34:41.837689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2081/4055] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:41 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:42.433119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:42.451010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3cb8f41f-f70e-4f54-9528-a8137c3549db tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1500 microversion: 2.1 time: 1.565791 Aug 30 18:34:42.454384 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1975/4056] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:40 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1500 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:42.474737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:42.477621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:42.524579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.525114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.530316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:42.534773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.535479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.536212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:42.551522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:42.640138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lazy-loading 'flavor' on Instance uuid ce51b58d-52da-488c-bd92-ae5fd698d608 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:34:42.855330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:42.855595 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07e995ac-5324-4989-8949-4b4e1a5eb8a4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "POST /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608/action" status: 200 len: 32 microversion: 2.1 time: 0.385006 Aug 30 18:34:42.862526 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2082/4057] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:34:42 2022] POST /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:34:42.878287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:42.892488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:42.893803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:42.910884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.911692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.912359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:42.913275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.914941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.915975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:42.933962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.939111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.941018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:42.947575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:42.948865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:42.951300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:43.005633 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7be22cb7-7843-4248-965f-bc3f3cc7fac3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159119 Aug 30 18:34:43.006701 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1976/4058] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:42 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:43.755934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:43.769247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4699d1ea-fc8f-417f-9934-99542cd92301 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.903229 Aug 30 18:34:43.771588 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2083/4059] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:42 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:44.018672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:44.021292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:44.062724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:44.064782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:44.065405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:44.071146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:44.071642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:44.072097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:44.195695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e46b8c1-3f66-495d-8ad6-a277aa56bae4 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182305 Aug 30 18:34:44.203464 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1977/4060] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:44 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:44.795914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:44.798059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:44.825591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:44.828303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:44.828957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:44.829890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:44.832373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:44.833009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:45.216266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:45.218718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:45.236966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:45.237756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:45.238373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:45.241493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:45.242129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:45.244450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:45.336550 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-da984a96-2e51-46df-884c-a6884fa34834 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125311 Aug 30 18:34:45.337757 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1978/4061] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:45 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:45.612236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:45.620793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9baf37ee-5d66-4708-9379-e37c54d4d933 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.830370 Aug 30 18:34:45.631089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2084/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:44 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:46.353367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:46.355992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:46.397692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:46.398204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:46.400342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:46.401096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:46.405608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:46.406309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:46.526586 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f406ee2-d3c4-4cf5-88a9-a1cc90a2dee3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177130 Aug 30 18:34:46.535470 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1979/4063] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:46 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:46.652528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:46.653312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:46.665560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:46.668372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:46.671523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:46.672125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:46.673021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:46.678103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:46.678734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:47.065272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:47.104437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8c0526e-e641-4649-8f63-d5c338c6ceb2 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.454083 Aug 30 18:34:47.108823 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2085/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:46 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:47.544505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:47.547474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:47.569412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:47.570254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:47.572854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:47.579370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:47.580094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:47.593166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:47.719706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96b59f5a-73ba-4b2e-81b4-83c4be6695c5 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179794 Aug 30 18:34:47.722932 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1980/4065] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:47 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:48.127147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:48.128164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:48.165699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:48.166787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:48.171780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:48.173029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:48.183893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:48.184748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:48.572117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:48.605240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-119ebf37-097d-403f-94e6-c90863b80962 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.477409 Aug 30 18:34:48.606735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2086/4066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:48 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:48.734250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:48.746971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:48.772108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:48.772880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:48.773481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:48.774301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:48.775123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:48.777778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:48.873211 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3302da5-5ea5-44c8-9ce8-572854981e7a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143378 Aug 30 18:34:48.878533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1981/4067] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:48 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:49.636191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:49.636850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:49.644749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:49.645268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:49.645689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:49.660817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:49.661570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:49.662045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:49.886733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:49.890951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:49.909655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:49.910539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:49.911197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:49.912144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:49.912824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:49.915530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:50.003327 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae736526-42f3-46cb-a2c2-5ab1102219f8 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121812 Aug 30 18:34:50.004453 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1982/4068] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:49 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:50.124994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:50.144521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3621ef3-5862-4ca0-b00a-df26c447976a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.514228 Aug 30 18:34:50.149597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2087/4069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:49 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:51.018732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:51.021420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:51.040280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:51.040820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:51.041289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:51.042057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:51.044740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:51.044740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:51.128941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b0ad241f-b895-4ffe-96c0-5ab70c26957a tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113530 Aug 30 18:34:51.129574 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1983/4070] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:51 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:34:51.173343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:51.176630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:51.217904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:51.219878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:51.220741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:51.221503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:51.223594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:51.224802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:51.997073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:52.011320 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ebe4371-76f9-4fd3-9554-db7bb6eceae7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.845608 Aug 30 18:34:52.013999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2088/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:51 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:52.144105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:52.146748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:52.170624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.176260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.177803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.178250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.178929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.179658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.308812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f6dc9f5-895d-4e84-b7b3-98796cc425be tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.161585 Aug 30 18:34:52.309904 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1984/4072] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:34:52 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac/os-volume_attachments => generated 25 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:34:52.439727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:52.441932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:52.460818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.461417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.462167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.472111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.472111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.472111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.548453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:34:52.743364 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28f0a250-90c6-42f6-87ac-79f9b5d1b683 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 204 len: 0 microversion: 2.1 time: 0.303932 Aug 30 18:34:52.749972 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2089/4073] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:34:52 2022] DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:34:52.756364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:52.757177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:52.767833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.769692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.772654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:52.775589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:52.779320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:52.780090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:53.034315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:53.035521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:53.047512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:53.048168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:53.048624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:53.053594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:53.054702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:53.054859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:53.511660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:53.525807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9892123e-ba28-48dd-81b2-e779dea11e54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.495738 Aug 30 18:34:53.529480 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2090/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:53 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:53.631227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:53.638904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:53.647864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4ca2878-1d7e-49ef-8452-7d493bf10e98 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1681 microversion: 2.1 time: 0.895647 Aug 30 18:34:53.666715 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1985/4075] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:52 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1681 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:54.552731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:54.555245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:54.571905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.572798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.575668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.579011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.580877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.581831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.674459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:54.675098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:54.704731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=34 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:34:54.716233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.724475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.724943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:54.725708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:54.726173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:54.726639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:55.678980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:55.721530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-502d2d10-829a-4e78-be9d-0acf70e4cc03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1681 microversion: 2.1 time: 1.035285 Aug 30 18:34:55.726612 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1986/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:54 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1681 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:55.734309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:55.742700 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58ebb5ef-c895-40cb-a262-cf0339c4214c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 1.195107 Aug 30 18:34:55.767180 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2091/4077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:54 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:56.751310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:56.751997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:56.775284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:56.775822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:56.781941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:56.786169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:56.787323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:56.789001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:56.789635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:56.792274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:56.816944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:56.817568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:56.818035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:56.818901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:56.836212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:56.836686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:57.314799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:57.329404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-700d57b2-25fb-429a-86a3-941219b4a0dd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1613 microversion: 2.1 time: 0.583100 Aug 30 18:34:57.353246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1987/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:56 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1613 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:57.548210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:57.562999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-629aca71-9e44-4fd4-941a-1fe0b14b05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.786660 Aug 30 18:34:57.583086 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2092/4079] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:56 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:34:58.354409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:58.355658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:58.376678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:58.377506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:58.378152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:58.379156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:58.379934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:58.394776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:58.746159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd155270f98b04f2ab64d364366b0eabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be050dfa2c85497e804a681513ab65a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:34:58.764874 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03453bff-67b9-4c04-84a2-234a563ad153 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 200 len: 1613 microversion: 2.1 time: 0.415301 Aug 30 18:34:58.765506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1988/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:58 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 1613 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:34:58.786641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:58.797591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:58.812050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:58.813308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:58.816552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:58.818109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:58.819394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:58.820069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:58.868022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18226d6-d56c-4be4-b19c-a427e2da15ac", "name": "network-vif-deleted", "tag": "85a1eaf3-b8f2-4210-9f1a-206ada02c4e0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:34:58.898784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:58.899709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:58.900338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:58.932394 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] Creating event network-vif-deleted:85a1eaf3-b8f2-4210-9f1a-206ada02c4e0 for instance e18226d6-d56c-4be4-b19c-a427e2da15ac on n-h1-854119-10 Aug 30 18:34:58.938906 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-958e4449-95b5-4831-b0a9-52c473ac9d7c req-ca4c1a16-048d-48a1-822f-c7a0a29418bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.557172 Aug 30 18:34:58.940171 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2093/4081] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:34:59.789430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:59.790455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:34:59.802684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:59.803187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:59.803629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:59.821650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:34:59.822213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:34:59.830795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:34:59.895488 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac HTTP/1.1 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'e18226d6-d56c-4be4-b19c-a427e2da15ac'} Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:34:59.898788 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:34:59.903911 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6cd02423-3d1f-4f57-b751-1696ef0ea1ae tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 404 len: 111 microversion: 2.1 time: 0.117056 Aug 30 18:34:59.910440 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2094/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:59 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:34:59.931301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-450c7030-febc-403a-95b1-348f79458cb3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '.version_select at 0x7f4e5afb8d30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:34:59.989968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-450c7030-febc-403a-95b1-348f79458cb3 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746471969" status: 202 len: 0 microversion: 2.1 time: 0.065754 Aug 30 18:34:59.999097 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2095/4083] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746471969 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:35:00.786479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:00.803355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91d96d7c-833a-4971-8633-9f67869aa3fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 2.034759 Aug 30 18:35:00.805266 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1989/4084] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:34:58 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:01.830380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:01.830957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:01.852910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:01.855934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:01.858155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:01.863949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:01.873705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:01.878212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:03.857796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:03.867324 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd2bed07-dacd-40e3-9d63-387dae43d384 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 2.044487 Aug 30 18:35:03.867926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2096/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:01 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:04.892369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:04.900276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:04.919417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:04.920298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:04.920922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:04.921857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:04.922573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:04.923175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:05.735625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:05.749833 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-789270f8-8034-4f65-9a8e-1ae29910165c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.863632 Aug 30 18:35:05.766319 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1990/4086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:04 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:06.775524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:06.776865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:06.793017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:06.796151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:06.796791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:06.797707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:06.799241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:06.800818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:06.857125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:07.683104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:07.692303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e99b20a-22d5-4a1e-9519-bafc1d5ddb51 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 0.921035 Aug 30 18:35:07.704609 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2097/4087] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:06 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:08.723927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:08.725068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:08.735837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:08.739530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:08.740205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:08.741218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:08.751129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:08.752066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:09.898838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:09.899365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:09.920887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:09.921350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:09.921803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:09.922634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:09.923490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:09.923606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:10.612776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:10.626819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a99a4f18-5e9a-441b-ab34-5b474ad00dea tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 1.907336 Aug 30 18:35:10.646552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1991/4088] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:08 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:10.947935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:10.958179 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e700b556-edc1-4e22-aee7-5b9508ca33d5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.063936 Aug 30 18:35:10.959138 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2098/4089] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:09 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:10.989701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:10.990636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:11.003825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.003825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.004149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:11.004864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.018894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.021422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:11.655032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:11.655738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:11.673951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.679221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.679930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:11.680849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.681741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.683075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:11.694174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:11.710429 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1020477-d30e-4cfe-93f9-1e034d7869af tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.725372 Aug 30 18:35:11.723034 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1992/4090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:10 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:11.736636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:11.745131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:11.764027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.765460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.766164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:11.769133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:11.769929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:11.770626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.298955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:12.314259 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1d3dddd-d5fd-4025-bea2-70f29f51b676 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.578560 Aug 30 18:35:12.331475 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1993/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:11 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:12.349404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:12.350334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:12.376819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.377684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.378527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.379522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.380221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.389140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.418308 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac HTTP/1.1 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e18226d6-d56c-4be4-b19c-a427e2da15ac'} Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:12.422495 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.428650 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.431033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:12.432186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdfce718-2c50-4833-99bc-61cd22ac65df tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 404 len: 111 microversion: 2.1 time: 0.098385 Aug 30 18:35:12.433332 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1994/4092] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:35:12 2022] DELETE /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:12.441517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:12.442701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:12.450591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.452338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.454604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.455749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.456567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.457304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.833133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:12.849269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:12.858812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ca8e60ab-7a83-4fd7-81ca-b171c2dd1183 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.424062 Aug 30 18:35:12.874991 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1995/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:12 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:12.877742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:12.889004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: e18226d6-d56c-4be4-b19c-a427e2da15ac] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:12.899359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.899968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.900413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.901198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:12.901678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:12.902121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:12.924193 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31d4a23e-4c89-42ba-a3c6-0e7e708604e3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 1.274767 Aug 30 18:35:12.934558 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2099/4094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:11 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:12.963928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac HTTP/1.1 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e18226d6-d56c-4be4-b19c-a427e2da15ac'} Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:12.965728 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance e18226d6-d56c-4be4-b19c-a427e2da15ac could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:12.970068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4b070130-5b6f-4a6c-bd7e-00d6ecbf0c03 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac" status: 404 len: 111 microversion: 2.1 time: 0.102623 Aug 30 18:35:12.974985 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1996/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:12 2022] GET /compute/v2.1/servers/e18226d6-d56c-4be4-b19c-a427e2da15ac => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:13.288280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-810056946", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a43d14fc-4753-4553-8d04-df60af14fa3d"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:13.305506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d10ab727-f64e-49c1-ad9c-336ab81ea51a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Action: 'create', calling method: .version_select at 0x7f4e5af378b0>, body: {"keypair": {"name": "tempest-keypair-1913067274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQuAixOMFc+bIH6LJWW4B/tpwM5vt3vuA5+WBiP2rV2b4WsSQ1+dZTF37ssGZNMsAzSrGDHdc59X3e97bKJDxsCGjxZ1LhBUvFhBhLlLukrLICmVzEEFsSoMcBUrUX53Q=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:13.386524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d10ab727-f64e-49c1-ad9c-336ab81ea51a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for project fca43827ad114d019e3a90c18faa9651. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:13.399582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d10ab727-f64e-49c1-ad9c-336ab81ea51a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for user faee7d75430f4606bd909bae8a22e11d and project fca43827ad114d019e3a90c18faa9651. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:13.419168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] validate_networks() for [('a43d14fc-4753-4553-8d04-df60af14fa3d', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:35:13.492605 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d10ab727-f64e-49c1-ad9c-336ab81ea51a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.555958 Aug 30 18:35:13.493745 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2100/4096] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:35:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:13.966984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:13.968486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:13.988878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:13.992046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:13.992729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:14.006912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:14.007547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:14.007939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:15.441271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:15.455836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0858e4a7-41e5-4111-8e52-5c8f68dbd34f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 1.502645 Aug 30 18:35:15.477122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2101/4097] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:13 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:15.487729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01c71ab7-04ab-4aee-822d-9a8830a90c18 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: .version_select at 0x7f4e5afe0310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-219288598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4BLg9X3dkyMFYMu+gHpvboO4be3DnyDEwX33wvzsL1VS7Xadu6G0/otpHRRbR/eoXiRBzqXYZuJ5MJkuFPxiAFKqgzfaWMY7zQGMXRMoCau2J2R7lPXtKQoX7/iyUkUw=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:15.494453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:35:15.494964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:35:15.495418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:35:15.495844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:35:15.496324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:35:15.511158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-01c71ab7-04ab-4aee-822d-9a8830a90c18 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:15.521315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-01c71ab7-04ab-4aee-822d-9a8830a90c18 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:15.533772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:15.534313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:15.538271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:15.541722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:15.543139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:15.546510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:15.580017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01c71ab7-04ab-4aee-822d-9a8830a90c18 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.101315 Aug 30 18:35:15.581317 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2102/4098] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:35:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:15.645427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:15.659865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:15.711348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:35:15.717706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:35:16.018553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fcd13398-f95f-432f-8755-036d04b77d80 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732851 Aug 30 18:35:16.021374 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1997/4099] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:35:16.032275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5377c0d6-1962-4b90-b635-b0e6287baa59 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:16.032960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5377c0d6-1962-4b90-b635-b0e6287baa59 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:16.337869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5377c0d6-1962-4b90-b635-b0e6287baa59 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:16.350578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5377c0d6-1962-4b90-b635-b0e6287baa59 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1214 microversion: 2.1 time: 0.322792 Aug 30 18:35:16.357060 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2103/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:16 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:16.490442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:16.491725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:16.529903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:16.536953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:16.537929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:16.538954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:16.539581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:16.540166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:17.378180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03ad4d65-5405-48e0-9173-470d66c90cb1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:17.379075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-03ad4d65-5405-48e0-9173-470d66c90cb1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:17.387922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:17.611026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-03ad4d65-5405-48e0-9173-470d66c90cb1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:17.624906 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-03ad4d65-5405-48e0-9173-470d66c90cb1 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1214 microversion: 2.1 time: 0.250948 Aug 30 18:35:17.639505 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2104/4101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:17 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:18.647438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:18.648946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:18.667956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:18.668443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:18.678760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:18.679794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:18.680307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:18.680761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:18.836687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:18.852064 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e9cf392-2c32-491a-b9c9-6c79b507dd81 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1506 microversion: 2.1 time: 2.368546 Aug 30 18:35:18.855163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1998/4102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:16 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1506 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:19.090934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:19.106032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43ab4763-92d5-462d-9f65-1bc3191f00b8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1266 microversion: 2.1 time: 0.460574 Aug 30 18:35:19.126109 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2105/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:18 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1266 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:19.875091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:19.875966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:19.893825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:19.894328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:19.894806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:19.895544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:19.896006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:19.896708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:20.133058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:20.133743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:20.158155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:20.160169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:20.167273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:20.169986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:20.184451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:20.185263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:20.585095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:20.643064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24c02dbd-298f-4e86-896e-e1cad91b695e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1272 microversion: 2.1 time: 0.512214 Aug 30 18:35:20.662796 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2106/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:20 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1272 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:21.683366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:21.685169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:21.703959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:21.704981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:21.705662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:21.706499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:21.706972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:21.707529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:21.834135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:21.849553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c91c4ab5-a978-44d8-998b-70ba8f2c6c7b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1486 microversion: 2.1 time: 1.979013 Aug 30 18:35:21.850499 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 1999/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:19 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1486 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:21.874888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:21.879117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-145781640", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "40c00af3-3071-4a84-9ddb-bcb4446f23ed"}], "key_name": "tempest-TestNetworkBasicOps-219288598", "security_groups": [{"name": "tempest-secgroup-smoke-1459270526"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:21.896281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63fa426e-27e3-4b2d-95c0-3420b5352206 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1272 microversion: 2.1 time: 0.217539 Aug 30 18:35:21.909737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2107/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:21 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:22.086170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-609896561", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:22.202371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] validate_networks() for [('fd033e32-b84a-49f8-92fd-cff5c8733dfd', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:35:22.939054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] validate_networks() for [('40c00af3-3071-4a84-9ddb-bcb4446f23ed', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:35:23.006519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:35:23.007297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:35:23.007640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:35:23.008156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:35:23.008683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:35:23.026898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.030784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.034245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.034915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.038160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.038773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.102016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Getting quotas for project 5334c78e90284de7bdffb6eddf9a32ca. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:23.102016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Getting quotas for user dca901cc5b0b41c08aab5eca6bcf4d0c and project 5334c78e90284de7bdffb6eddf9a32ca. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:23.135634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:35:23.138720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:35:23.242631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-97dde2f3-e81e-4a7f-8e4d-ac9768610f94 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.161195 Aug 30 18:35:23.244076 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2108/4107] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:35:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:35:23.264323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:23.265284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:23.318626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.321008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.322036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.326287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.326966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.328694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.367213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d HTTP/1.1 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'c6141780-70eb-40fa-97bf-011e9712354d'} Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:23.374695 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.379557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.382576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:23.384563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-193d4223-a023-48ea-8400-64083f3fe40d tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 404 len: 111 microversion: 2.1 time: 0.131917 Aug 30 18:35:23.385347 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2109/4108] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:35:23 2022] DELETE /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:23.392463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:23.393358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:23.403081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.403887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.405325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.406330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.407155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.407933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.572789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:23.620033 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f6586538-859d-480a-bbf2-6a0d3158a451 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1272 microversion: 2.1 time: 0.228600 Aug 30 18:35:23.623809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2110/4109] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:23 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:23.637989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-76427b28-c1a7-4a9a-aeee-b2ae4982ef04 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:23.640196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-76427b28-c1a7-4a9a-aeee-b2ae4982ef04 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:23.823015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-76427b28-c1a7-4a9a-aeee-b2ae4982ef04 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:23.832099 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-76427b28-c1a7-4a9a-aeee-b2ae4982ef04 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1213 microversion: 2.1 time: 0.207069 Aug 30 18:35:23.832739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2111/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:23 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:23.838608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:23.842733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: c6141780-70eb-40fa-97bf-011e9712354d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:23.890984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.891914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.893719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.895042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:23.895739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:23.896353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:23.982134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d HTTP/1.1 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'c6141780-70eb-40fa-97bf-011e9712354d'} Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:23.999881 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.004592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance c6141780-70eb-40fa-97bf-011e9712354d could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:24.011047 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-637c651f-6cbd-4621-8dcd-cd17616c56fd tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d" status: 404 len: 111 microversion: 2.1 time: 0.168426 Aug 30 18:35:24.012194 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2112/4111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:23 2022] GET /compute/v2.1/servers/c6141780-70eb-40fa-97bf-011e9712354d => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:24.054476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:24.055514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:24.096295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.101098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.101567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.112071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.117303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.134413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.193272 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 HTTP/1.1 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '141212f6-b08f-4f37-9f27-d62e6f8245e4'} Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:24.205431 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56f57318-2716-4eaa-9451-a026124875aa tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 404 len: 111 microversion: 2.1 time: 0.189981 Aug 30 18:35:24.220581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2113/4112] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:35:24 2022] DELETE /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:24.224120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:24.224626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 141212f6-b08f-4f37-9f27-d62e6f8245e4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:24.240322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.240825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.241262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.242003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.249694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.250679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.287638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 HTTP/1.1 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '141212f6-b08f-4f37-9f27-d62e6f8245e4'} Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:24.294781 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. Aug 30 18:35:24.299319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:24.303398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 141212f6-b08f-4f37-9f27-d62e6f8245e4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:24.304552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddab705a-f7df-4e69-9bca-dcfc79602dba tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4" status: 404 len: 111 microversion: 2.1 time: 0.090022 Aug 30 18:35:24.307980 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2114/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:24 2022] GET /compute/v2.1/servers/141212f6-b08f-4f37-9f27-d62e6f8245e4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:24.641753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:24.642395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:24.652527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.659267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.660649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.661597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.662253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.662866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.776308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:24.790012 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-504b381f-2f06-43d4-8259-44f2c48b8bdd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1272 microversion: 2.1 time: 0.152283 Aug 30 18:35:24.801464 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2115/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:24 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:24.853523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:24.854185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:24.869091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.869725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.870165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:24.870972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:24.871614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:24.872209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:25.022904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:25.042861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-068282cd-34bd-46aa-9d72-b6f87d7dd7b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1209 microversion: 2.1 time: 0.188536 Aug 30 18:35:25.045270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2116/4115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:24 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:25.273553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:35:25.275186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:35:25.277640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:35:25.278612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:35:25.279310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:35:25.289514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:25.304115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:25.306307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:25.307520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:25.311870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:25.312791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:25.313475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:25.333186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=73 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:25.362114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:25.380792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:25.408800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:35:25.414079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:35:25.611599 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4e43ed8-9762-49ae-b2ae-cc186f082f28 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.757746 Aug 30 18:35:25.615148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2000/4116] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:35:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 3764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:35:25.632861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70b25f53-11a6-4339-b285-04d7f24868e6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:25.633701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-70b25f53-11a6-4339-b285-04d7f24868e6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:25.812608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:25.813238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:25.829869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:25.831215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:25.831880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:25.832773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:25.833623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:25.834214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:25.863793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70b25f53-11a6-4339-b285-04d7f24868e6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:25.877997 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70b25f53-11a6-4339-b285-04d7f24868e6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1247 microversion: 2.1 time: 0.250188 Aug 30 18:35:25.878975 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2117/4117] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:25 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1247 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:26.067612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:26.070137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:26.086486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:26.086990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:26.092607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:26.093651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:26.094293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:26.099614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:26.225016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:26.233861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b8f5e18-af12-4e0f-8d5b-ffcbc64b0ea9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1271 microversion: 2.1 time: 0.170147 Aug 30 18:35:26.243938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2118/4118] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:26 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:26.900705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:26.901338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:26.914006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:26.914675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:26.915121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:26.915908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:26.916369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:26.916798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:27.027741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:27.037344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bff3a129-de56-4cc1-8aea-c19c1635ab9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1243 microversion: 2.1 time: 0.141245 Aug 30 18:35:27.041479 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2119/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:26 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1243 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:27.257202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:27.257202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:27.268377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:27.269477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:27.269477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:27.270122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:27.276716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:27.276716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:27.466137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:27.477562 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17e79c93-25c7-4b4f-9128-627a85a637e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1271 microversion: 2.1 time: 0.226441 Aug 30 18:35:27.478167 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2120/4120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:27 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:28.089466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:28.091435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:28.109051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:28.113175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:28.113558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:28.116154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:28.118876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:28.119821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:28.208258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:28.217920 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c446911f-3164-496e-a532-6e15b7dd7815 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 2.409600 Aug 30 18:35:28.230799 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2001/4121] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:25 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:28.390128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:28.418585 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-69c0cf65-ec45-4f74-8d95-db0b6aed28bb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1307 microversion: 2.1 time: 0.323459 Aug 30 18:35:28.421436 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2121/4122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:28 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:28.526135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:28.527335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:28.554313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:28.554961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:28.555407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:28.556144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:28.556604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:28.557037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:28.804097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:28.823332 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2d647e5-aa19-4d3a-a130-397ca2470e73 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1271 microversion: 2.1 time: 0.305483 Aug 30 18:35:28.824306 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2002/4123] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:28 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:29.216442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1350131723", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "4bca1d32-355c-48e5-b94e-cc7545c38319"}], "security_groups": [{"name": "tempest-securitygroup--527954074"}], "key_name": "tempest-keypair-1913067274", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:29.250609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:29.253265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:29.313583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:29.315458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:29.318948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:29.321888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:29.326460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:29.328510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:29.479163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] validate_networks() for [('4bca1d32-355c-48e5-b94e-cc7545c38319', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:35:29.839941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:29.882072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1df84ad0-3447-4aca-bd6f-35aaf9f2ca01 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 0.613528 Aug 30 18:35:29.883979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2003/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:29 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:29.915484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:29.916133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:29.929413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:29.929912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:29.930432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:29.951832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:29.952522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:29.953140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.499578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:35:30.500454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:35:30.500729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:35:30.501239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:35:30.502073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:35:30.519999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.524375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.526486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.528817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.529656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.532940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.590810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for project fca43827ad114d019e3a90c18faa9651. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:30.606436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for user faee7d75430f4606bd909bae8a22e11d and project fca43827ad114d019e3a90c18faa9651. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:30.636979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:35:30.639404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:35:30.739451 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab531149-2364-420b-aa5a-4983bd17cc48 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.524411 Aug 30 18:35:30.758568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2122/4125] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:35:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:35:30.776853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:30.779697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:30.801055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.802313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.803053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.805613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.806985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.808366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.929077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:30.942186 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72857c22-ed59-4030-88ff-e8e8df5fac62 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1271 microversion: 2.1 time: 0.177409 Aug 30 18:35:30.945336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2123/4126] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:30 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:30.954945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:30.957656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:30.971321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.972454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.974565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.978085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:30.979450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:30.980110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:30.994761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:31.019036 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f HTTP/1.1 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '23458d56-3de6-4429-91bd-9d46736b5a3f'} Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:31.023311 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.030029 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.033605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:31.037053 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-902315a2-3e5c-41c9-b4ac-0bc153e91ee2 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 404 len: 111 microversion: 2.1 time: 0.088558 Aug 30 18:35:31.042130 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2124/4127] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:35:30 2022] DELETE /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:31.048767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2efe8f3-675d-4902-8b28-f9505b7b46a7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:31.049678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2efe8f3-675d-4902-8b28-f9505b7b46a7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:31.159512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:31.180573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78bf9ccf-11d3-401f-964c-4665351ff4eb tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 1.290296 Aug 30 18:35:31.184619 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2004/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:29 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:31.188982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2efe8f3-675d-4902-8b28-f9505b7b46a7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:31.198733 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2efe8f3-675d-4902-8b28-f9505b7b46a7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1242 microversion: 2.1 time: 0.154729 Aug 30 18:35:31.202179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2125/4129] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:31 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:31.205412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:31.207854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:31.216433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:31.222059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] [instance: 23458d56-3de6-4429-91bd-9d46736b5a3f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:31.231947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.233356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.233800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.234555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.235013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.235436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.240987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.250870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.251481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.252362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.253369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.255690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.296110 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] HTTP exception thrown: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Request method failure captured: Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f HTTP/1.1 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlafh8WKYDS1xkTiPJwcMuOLx_7ofyZ6bu_4IOZhK2P9wDcm-ROoUfuQVEwuczpUn543Ucr13XTyGyg5qzkKRlduFGe4lSBzsT_NYhq18s46nqH9T8szvn_KT8bqf9UR-wmf2jP_wcbbHpzkWr1utWOlH-8A3lyHbCZbgKZq8uCqx2E Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/be050dfa2c85497e804a681513ab65a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_be050dfa2c85497e804a681513ab65a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: be050dfa2c85497e804a681513ab65a2 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-98134837 Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d155270f98b04f2ab64d364366b0eabf Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeNegativeTest-98134837-project Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '23458d56-3de6-4429-91bd-9d46736b5a3f'} Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:35:31.297844 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:35:31.303940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] Returning 404 to user: Instance 23458d56-3de6-4429-91bd-9d46736b5a3f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:35:31.306979 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7253142e-bf4c-4e1c-9c19-b84fb7e2cb51 tempest-AttachVolumeNegativeTest-98134837 tempest-AttachVolumeNegativeTest-98134837-project] 10.222.0.25 "GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f" status: 404 len: 111 microversion: 2.1 time: 0.100126 Aug 30 18:35:31.307909 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2126/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:31 2022] GET /compute/v2.1/servers/23458d56-3de6-4429-91bd-9d46736b5a3f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:35:31.795944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec598cfa-1b07-45d7-aa96-e5dee4b10639", "tag": "2e674c95-760f-4bbc-8954-09c7c30a882c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:31.817351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.817900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.818294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.870674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] Creating event network-changed:2e674c95-760f-4bbc-8954-09c7c30a882c for instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 on n-h1-854119-10 Aug 30 18:35:31.882171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3fa55a8c-b8ce-4bb7-8ff4-93c5fdb5b98e req-3c748381-1b01-499b-a4a5-93cdc4c0598a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088740 Aug 30 18:35:31.887735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2127/4131] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:35:31.972437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:31.973604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:31.985527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.989883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.990519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:31.991504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:31.992484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:31.994566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:32.757674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:32.803513 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9d6c012-6aa4-4434-ad05-aed29311e9b8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.837788 Aug 30 18:35:32.804929 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2128/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:31 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:32.823416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:32.824599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:32.837349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:32.838250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:32.840335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:32.841272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:32.841893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:32.842648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:33.424845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:33.438774 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a60e4832-675f-4d06-ae30-cfe7dafe1233 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 0.632432 Aug 30 18:35:33.439382 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2129/4133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:32 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:33.444210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf", "tag": "8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:33.484323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:33.486645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:33.488455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:33.509082 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] Creating event network-changed:8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1 for instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf on n-h1-854119-10 Aug 30 18:35:33.522869 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-943cc8bd-d5fb-4e12-9af8-11ad7f042324 req-7a301525-afcd-4311-8773-736de5118e51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082151 Aug 30 18:35:33.532777 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2130/4134] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:33.538732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:33.539480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:33.550484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:33.551125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:33.551662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:33.553005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:33.553704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:33.554370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:33.597691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:33.632634 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a97188b-59a7-41ba-b202-52c46c188007 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 2.446617 Aug 30 18:35:33.649336 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2005/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:31 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:33.709936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:33.722363 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ea87d543-79ec-407f-9343-b53a96d7bda2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1300 microversion: 2.1 time: 0.188303 Aug 30 18:35:33.723039 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2131/4136] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:33 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:33.828254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:33.828888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:33.838541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:33.839054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:33.846102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:33.853504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:33.854003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:33.854489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:34.464109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:34.465575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:34.490487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:34.491198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:34.491786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:34.492995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:34.493831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:34.494668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:34.900264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:34.928766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-465816a1-9dc1-4ace-b267-397c0ddb0238 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 1.107058 Aug 30 18:35:34.930711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2006/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:33 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:34.943766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:34.944660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:34.953743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:34.954529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:34.955303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:34.956312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:34.956943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:34.958735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:35.290562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:35.313861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78c70574-ec81-4d68-90aa-181579b0fce1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 0.854582 Aug 30 18:35:35.314561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2132/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:34 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:35.319162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:35.319992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:35.333059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:35.335428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:35.336262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:35.336858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:35.338054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:35.338902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:35.347328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:35.396877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:35.556802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:35.607418 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b4ad130-6e30-43ba-b0d6-d792b86b7552 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 0.651366 Aug 30 18:35:35.607418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2007/4139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:34 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:35.838717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:35.874214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cfe4cfbe-353a-414e-9d6a-7f333f97d525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.558496 Aug 30 18:35:35.876988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2133/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:35 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:35.962306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:35.963125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:35.980290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:35.983010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:35.986267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:35.987476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:35.988080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:35.990607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.217621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d958ec3-a773-47c0-a2d7-b70184f7fc43", "tag": "e11a467a-0a0b-48a7-af3f-35fe324bd355"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:36.260170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:36.262709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:36.265460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.293570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] Creating event network-changed:e11a467a-0a0b-48a7-af3f-35fe324bd355 for instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 on n-h2-854119-10 Aug 30 18:35:36.308889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fad029dd-3eda-4593-9256-2d580bb16dc4 req-a38ee9bf-e8e2-483b-be1c-509a89848cf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097494 Aug 30 18:35:36.309916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2134/4141] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:36.347775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:36.348771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:36.351064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:36.369295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:36.370429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:36.373045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.374184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:36.384267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:36.385413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.705329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:36.720256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe161c09-aa41-4ce0-9327-fd5fda007391 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.764272 Aug 30 18:35:36.721087 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2008/4142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:35 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:36.726225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:36.726979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:36.754186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:36.754732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:36.755170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.756375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:36.757021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:36.757650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:36.981938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:36.997197 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-725a112d-c6e0-4715-80f6-07911321d45e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 0.663311 Aug 30 18:35:36.997800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2135/4143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:36 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:37.021926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:37.028139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:37.040833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:37.041540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:37.042144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:37.043146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:37.043768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:37.044375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:37.765223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:37.781603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ecc928a5-f70c-4a3c-b8d1-8f775733adcc tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.782609 Aug 30 18:35:37.787035 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2136/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:36 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:37.798939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:37.800369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:37.814757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:37.818464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:37.819398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:37.823412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:37.824179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:37.827697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:38.065225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:38.084863 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0befaa0b-42bc-4b08-9bce-bd5f223f90f2 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 1.362501 Aug 30 18:35:38.106887 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2009/4145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:36 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:38.113053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:38.114610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:38.128883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:38.129597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:38.130240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:38.151563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:38.153157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:38.153790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:38.337421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:38.355599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b2759486-5831-46af-8a22-7f48f97e7fb7 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.567312 Aug 30 18:35:38.358190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2137/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:37 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:38.785665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf4659c-622d-4735-af9f-1793c5383e81", "tag": "980c1053-41c6-4478-aada-a53721af088b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:38.816920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:38.817636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:38.822299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:38.854625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] Creating event network-changed:980c1053-41c6-4478-aada-a53721af088b for instance bcf4659c-622d-4735-af9f-1793c5383e81 on n-h2-854119-10 Aug 30 18:35:38.877161 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f2f4fd32-2eee-4e8b-b280-4d037df5be4d req-5454d5ae-d902-45f3-a27c-d27d2344f99a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091803 Aug 30 18:35:38.884485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2138/4147] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:38.899519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:38.905347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:38.939577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:38.942920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:38.945073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:38.950071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:38.954076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:38.954852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:39.225991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:39.253519 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e2f9712f-ae1e-4805-b07c-fea3a0b43f81 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 1.144833 Aug 30 18:35:39.255213 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2010/4148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:38 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:39.305089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:39.309732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:39.337606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:39.340244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:39.344143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:39.345313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:39.346138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:39.347370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:39.374259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:39.385639 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa9c4148-60ab-48dd-b241-a993b7e8d795 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.496461 Aug 30 18:35:39.389236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2139/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:38 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:39.613741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec598cfa-1b07-45d7-aa96-e5dee4b10639", "name": "network-vif-plugged", "status": "completed", "tag": "2e674c95-760f-4bbc-8954-09c7c30a882c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:39.626127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:39.627066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:39.627691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:39.647687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] Creating event network-vif-plugged:2e674c95-760f-4bbc-8954-09c7c30a882c for instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 on n-h1-854119-10 Aug 30 18:35:39.653508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-69fe9a44-eb9b-4b20-8513-4b934ba31554 req-d5f65bf4-3900-4ba3-b022-36d47ae899bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262699 Aug 30 18:35:39.655337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2140/4150] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:39.662454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:39.664486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:39.674036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:39.675092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:39.676468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:39.677745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:39.678960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:39.679602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:40.126888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:40.142378 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eaa79e30-3496-4252-aa26-ec035ff9507f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 0.884122 Aug 30 18:35:40.144573 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2011/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:39 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:40.283884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:40.286020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:40.295627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:40.296325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:40.298707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:40.299587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:40.300129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:40.300634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:40.566014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:40.668539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:40.689444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b610431d-6528-4e40-bc0b-6057e03f0fb6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 1.032111 Aug 30 18:35:40.690387 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2141/4152] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:39 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:40.704652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:40.705587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:40.718199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:40.723117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:40.723787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:40.724735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:40.728549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:40.729344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:40.859366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:40.870969 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d957a48-12f9-4214-aaf3-b05b247f55e7 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1373 microversion: 2.1 time: 0.594069 Aug 30 18:35:40.875669 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2012/4153] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:40 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1373 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:41.104705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:41.126526 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7aae568f-f3a0-405b-9d85-7d2a62190b98 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.431825 Aug 30 18:35:41.126526 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2142/4154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:40 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:41.179959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:41.180574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:41.221513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:41.228622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:41.229334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:41.232287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:41.236468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:41.238670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:41.711768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf", "name": "network-vif-plugged", "status": "completed", "tag": "8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:41.736130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=30 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:41.748666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:41.749938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:41.750412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:41.807287 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] Creating event network-vif-plugged:8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1 for instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf on n-h1-854119-10 Aug 30 18:35:41.828562 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-771011d2-d457-4c14-979a-b5ca03304fb2 req-cc7fa7b2-9aa7-4cb6-bd62-07b8c39f48d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120871 Aug 30 18:35:41.833616 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2143/4155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:41.844108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:41.844808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:41.868488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:41.869012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:41.872426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:41.873200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:41.873674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:41.876588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:41.984227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:41.997113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46cd5e7e-0763-48b3-ab43-93f40881e42f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 0.825846 Aug 30 18:35:41.999361 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2013/4156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:41 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:42.012019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:42.013031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:42.032760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.034819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.035818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.037934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.038876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.041277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.175966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:42.187609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e70dcb4f-7d13-4a15-b9f2-abce0b388f5d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.352324 Aug 30 18:35:42.190760 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2144/4157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:41 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:42.196025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:42.196645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:42.219598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.220104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.220548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.221276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.221736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.222166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.474252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:42.484103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3b12c61-a032-46c6-a4c1-d97ac7988f7b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.292040 Aug 30 18:35:42.485676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2145/4158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:42 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:42.548013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:42.556819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2bf5770c-e98d-4ea4-95c9-46f630b76d9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1544 microversion: 2.1 time: 0.555663 Aug 30 18:35:42.558208 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2014/4159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:42 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1544 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:42.578391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:42.579592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:42.586217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.587044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.587684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.599765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:42.601712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:42.602697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:42.907182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:42.929741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c72a617f-0059-4cb6-8a13-172459fcc164 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1544 microversion: 2.1 time: 0.355215 Aug 30 18:35:42.930668 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2146/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:42 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1544 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:43.023350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:43.024135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:43.036735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.037080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.037598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.038994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.039542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.040046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.213026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:43.213924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:43.221626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.222510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.223129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.224064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.224670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.225275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.228781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:43.668209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:43.679371 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48eb8f05-7766-4db0-b03d-7130792bf875 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.471233 Aug 30 18:35:43.687532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2147/4161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:43 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:43.693152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:43.694068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:43.713264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.713765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.714230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.715169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.715630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.716052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:43.917409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:43.931329 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ca2a6b6-a857-46ad-a902-18bbea93958f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1314 microversion: 2.1 time: 0.912953 Aug 30 18:35:43.946793 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2015/4162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:43 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:43.971296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d958ec3-a773-47c0-a2d7-b70184f7fc43", "name": "network-vif-plugged", "status": "completed", "tag": "e11a467a-0a0b-48a7-af3f-35fe324bd355"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:43.992285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:43.992962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:43.993579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:44.011023 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] Creating event network-vif-plugged:e11a467a-0a0b-48a7-af3f-35fe324bd355 for instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 on n-h2-854119-10 Aug 30 18:35:44.017711 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c23aad22-b2e2-4585-8946-e5a4c2d6f14c req-d0b0e9cd-3d7d-4b43-a423-482f04dfca9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053444 Aug 30 18:35:44.019688 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2016/4163] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:44.322786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:44.339796 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c75795f-bb1f-42e8-93e2-ff2cb387dd7f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.650747 Aug 30 18:35:44.341354 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2148/4164] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:43 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:44.709830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:44.713439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:44.733712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:44.744778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:44.745674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:44.750650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:44.753941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:44.759324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:44.952550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:44.953431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:44.967008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:44.970002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:44.970799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:44.973471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:44.974222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:44.975695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:45.077173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:45.087305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-472f3e13-e52c-4c00-85f3-730c1bcd53e8 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.382742 Aug 30 18:35:45.088463 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2017/4165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:44 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:45.365498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:45.366154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:45.384210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:45.384858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:45.385549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:45.395882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:45.396843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:45.397578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:45.404716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:46.079307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:46.090323 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7ba4454-4378-4558-8880-a40e1dc37525 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1367 microversion: 2.1 time: 0.732182 Aug 30 18:35:46.094923 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2018/4166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:45 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1367 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:46.110770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf4659c-622d-4735-af9f-1793c5383e81", "name": "network-vif-plugged", "status": "completed", "tag": "980c1053-41c6-4478-aada-a53721af088b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:46.137515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:46.158109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:46.159030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:46.197246 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] Creating event network-vif-plugged:980c1053-41c6-4478-aada-a53721af088b for instance bcf4659c-622d-4735-af9f-1793c5383e81 on n-h2-854119-10 Aug 30 18:35:46.210832 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ecd7823b-c3c6-4527-a5a1-0cce93eadba3 req-949be003-94e4-413f-9d09-d289b3eda1e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114133 Aug 30 18:35:46.211701 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2019/4167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:46.223467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:46.224854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:46.237926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:46.240107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:46.240596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:46.242210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:46.242933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:46.243717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:46.328125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:46.349638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ccf971eb-1100-409a-aceb-7955f4bb5771 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1502 microversion: 2.1 time: 1.400916 Aug 30 18:35:46.351210 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2149/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:44 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1502 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:46.375700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:46.376524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:46.383796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:46.384616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:46.385288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:46.386326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:46.387035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:46.388504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:46.727723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:46.736636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d7258d5-65b4-49d5-b399-8d644e25e4d6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.523462 Aug 30 18:35:46.741396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2020/4169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:46 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:47.121601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:47.123083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:47.134309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.135152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.139160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:47.140380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.141165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.142950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:47.180869 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Removing security group d35453cd-9d86-45bc-a5a6-1a17ed561c39 from port 8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1 Aug 30 18:35:47.724054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:47.732295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf962b57-5029-4125-90a9-f48e035f1641 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1556 microversion: 2.1 time: 0.614928 Aug 30 18:35:47.732894 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2021/4170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:47 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1556 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:47.758405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:47.759463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:47.767816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.768790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.769521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:47.770442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.771186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.771765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:47.926219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-707bd889-0117-4005-951c-abb8b55c75eb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173923 Aug 30 18:35:47.934802 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2022/4171] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:35:47 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:47.945884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:47.945884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:47.948425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.949006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.949442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:47.950155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:47.950691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:47.951119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:48.224533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:48.238843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa6bf405-a8bd-49a3-b9b6-966fbf7164bb tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1313 microversion: 2.1 time: 0.302611 Aug 30 18:35:48.241393 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2023/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:47 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:48.344628 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7ec7f725-3c13-4e1f-b87c-1ff8db47475b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf/action" status: 202 len: 0 microversion: 2.1 time: 1.973131 Aug 30 18:35:48.348362 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2150/4173] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:35:46 2022] POST /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf/action => generated 0 bytes in 1975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:35:48.353963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:48.355189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:48.368989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:48.369800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:48.370460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:48.371279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:48.371804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:48.372320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:48.537876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf", "tag": "8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:48.558942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:48.559443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:48.559884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:48.565193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:48.591735 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c16d5e88-155f-4e2e-b46a-bcbc0d866f1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1460 microversion: 2.1 time: 0.241486 Aug 30 18:35:48.592746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] Creating event network-changed:8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1 for instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf on n-h1-854119-10 Aug 30 18:35:48.607545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7657b091-3fab-4eb2-af6c-42ef735eda6e req-34acd84b-b810-4a5e-80dd-dba935879c4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077400 Aug 30 18:35:48.615336 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2024/4174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:48 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1460 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:48.624353 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2151/4175] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:48.627505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:48.628374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:48.644670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:48.645739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:48.646479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:48.647413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:48.648037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:48.648612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:49.262730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:49.263443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:49.271188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:49.271990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:49.272661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:49.273882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:49.274631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:49.275309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:49.607940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:49.631235 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a02b4ff-ebae-49b5-9f08-bd78072ff678 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.010690 Aug 30 18:35:49.632767 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2025/4176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:48 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:49.658897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:49.659876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:49.668544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:49.669420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:49.670053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:49.671705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:49.672546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:49.673361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:49.919818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:49.938369 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b94bf8ed-02ce-433c-b870-9b330ad0a5d5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1499 microversion: 2.1 time: 0.678821 Aug 30 18:35:49.939718 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2152/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:49 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1499 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:49.971472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:49.974556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:50.054230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.054885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.066s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.055496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.059286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.060730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.061181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.125668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lazy-loading 'flavor' on Instance uuid bcf4659c-622d-4735-af9f-1793c5383e81 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:35:50.284514 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f24b49fa-8ae4-48dc-a56d-2fdeb81b67f9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81/action" status: 200 len: 32 microversion: 2.1 time: 0.320637 Aug 30 18:35:50.285241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2153/4178] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:35:49 2022] POST /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:35:50.299912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:50.303897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:50.331535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.332733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.333538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.335032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.335666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.336614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.453630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:50.465527 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5121d0b7-3045-4599-825f-2df8c6159eaa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.811010 Aug 30 18:35:50.466756 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2026/4179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:49 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:50.493461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:50.493461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:50.503153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.503821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.504452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.505464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:50.507606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:50.512286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:50.971300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:50.982497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c347483f-0072-47bf-ad2c-45d928ef018b tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.690608 Aug 30 18:35:50.986464 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2154/4180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:50 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:50.991640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec598cfa-1b07-45d7-aa96-e5dee4b10639", "tag": "2e674c95-760f-4bbc-8954-09c7c30a882c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:51.001891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:51.002647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:51.003227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:51.029153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] Creating event network-changed:2e674c95-760f-4bbc-8954-09c7c30a882c for instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 on n-h1-854119-10 Aug 30 18:35:51.036101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1ba34973-a58f-44e5-a3dc-8857090ed472 req-271cec72-ccc3-452e-a0c0-8e410f1174d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047240 Aug 30 18:35:51.039596 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2155/4181] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:51.056493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:51.066881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-22d6f603-09f1-4767-a534-8ca66454c45f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.583249 Aug 30 18:35:51.081722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2027/4182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:50 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:51.089810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:51.090704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:51.103648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:51.104412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:51.105041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:51.105898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:51.106378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:51.106806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:52.009364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:52.010257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:52.024210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:52.024713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:52.025151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:52.025869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:52.026331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:52.026950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:52.328550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:52.340168 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fadd9587-c23c-48db-8175-9efb241f4f66 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.334746 Aug 30 18:35:52.340772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2028/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:52 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:52.453522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:52.466707 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-930bfd22-c784-4806-8a47-9fe34bd17ea7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.380913 Aug 30 18:35:52.467526 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2156/4184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:51 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:52.626822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-411179544", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a43d14fc-4753-4553-8d04-df60af14fa3d"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:52.716869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] validate_networks() for [('a43d14fc-4753-4553-8d04-df60af14fa3d', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:35:53.362615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:53.363325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:53.377402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:53.380035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:53.380856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:53.383016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:53.384517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:53.387619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:53.703857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:35:53.704484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:35:53.704780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:35:53.705196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:35:53.705612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:35:53.732213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:53.733184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:53.733834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:53.735993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:53.738536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:53.739366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:53.812075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:35:53.822320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Getting quotas for user 63d5845d852d443d9b03fc499cf62b4c and project 38198e73fe3f494bb857e20d80230920. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:35:53.864041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:35:53.879455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:35:54.018013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b78bbe6-7c4d-41bf-9456-febf7af63cc5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395269 Aug 30 18:35:54.027479 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2029/4185] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:35:54.040021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d958ec3-a773-47c0-a2d7-b70184f7fc43", "tag": "e11a467a-0a0b-48a7-af3f-35fe324bd355"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:35:54.083046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:54.083558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:54.083982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:54.133299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] Creating event network-changed:e11a467a-0a0b-48a7-af3f-35fe324bd355 for instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 on n-h2-854119-10 Aug 30 18:35:54.147493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ad1ccf0f-fba0-4c09-a8d5-ef03cefcc358 req-e89b70e2-37a7-4748-9923-6e8a9d2f36db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117534 Aug 30 18:35:54.151079 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2030/4186] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:35:54.163297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10361a28-fab9-4a8b-b94a-5053fc85a09b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:54.164407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-10361a28-fab9-4a8b-b94a-5053fc85a09b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:54.270817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10361a28-fab9-4a8b-b94a-5053fc85a09b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:54.281842 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10361a28-fab9-4a8b-b94a-5053fc85a09b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1214 microversion: 2.1 time: 0.128536 Aug 30 18:35:54.298427 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2031/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:54 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:54.555741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:54.597709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72e4fa1c-1c27-497f-971c-42af5bfcb771 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 1.239237 Aug 30 18:35:54.603870 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2157/4188] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:53 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:35:55.305543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:55.306723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:55.317314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:55.321377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:55.323830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:55.324908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:55.329841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:55.330565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:55.589323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:55.599498 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-397c142f-6fe6-4cab-a6f3-a23fb254dea6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1210 microversion: 2.1 time: 0.297893 Aug 30 18:35:55.609626 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2032/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:55 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1210 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:55.636040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:55.638102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:55.662209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:55.662973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:55.663577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:55.664619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:55.665243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:55.665836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:56.640016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:56.648784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:56.666858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:35:56.692503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:56.693628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:56.695034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:56.705307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:56.714749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:56.716101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:56.863188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:56.886539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b717e997-ef5e-4c4b-8854-b83474e51869 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 1.252370 Aug 30 18:35:56.890850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2158/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:55 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:56.984727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:57.008163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eeb461fc-93a7-4ee8-92eb-5c3621f4d022 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1284 microversion: 2.1 time: 0.376745 Aug 30 18:35:57.011307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2033/4191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:56 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1284 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:57.919409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:57.920877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:57.930744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:57.931771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:57.932298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:57.933313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:57.934010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:57.934673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:58.034276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:58.035127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:58.048732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:58.050205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:58.051644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:58.053849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:58.054907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:58.056505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:58.397629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:58.414726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-146486b1-19b1-45c6-af9c-3cd98643f74a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1272 microversion: 2.1 time: 0.386752 Aug 30 18:35:58.416075 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2034/4192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:58 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1272 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:58.691467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:58.703001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87c8caa4-3282-4371-8ade-c80b67074d40 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.794748 Aug 30 18:35:58.720831 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2159/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:57 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:35:59.438602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:59.439079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:59.446538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:59.447047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:59.447522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:59.448365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:59.448829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:59.449261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:59.736757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:35:59.741505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:35:59.757527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:59.759589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:59.760105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:59.762820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:35:59.763201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:35:59.763670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:35:59.958855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:35:59.981324 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71694251-35fd-4f42-a3b9-2f437a0390ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.548020 Aug 30 18:35:59.982681 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2035/4194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:59 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:00.635952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:00.648547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-103d32cf-ad38-44de-9988-12e2a980a5f0 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.919159 Aug 30 18:36:00.663657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2160/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:35:59 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:00.901921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2188eb-9f9e-4129-8227-9ae7ae7604cd", "tag": "cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:00.945588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:00.953466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:00.953948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:00.997559 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] Creating event network-changed:cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a for instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd on n-h1-854119-10 Aug 30 18:36:01.007971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:01.009234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:01.013564 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b978c12c-c5df-4183-a85d-3eccb6349eb9 req-5779932b-93ff-4988-837f-306dd7d6f084 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115718 Aug 30 18:36:01.017740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2036/4196] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:01.029912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:01.031775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:01.034391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:01.035567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:01.038437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:01.039168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:01.503703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:01.517091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40c7f317-3a22-40c6-9e27-6981af09d37c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.513902 Aug 30 18:36:01.521390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2161/4197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:01 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:01.686409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:01.692109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:01.716189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:01.716700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:01.723674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:01.724560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:01.743573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:01.744674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:02.233009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:02.249433 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6662373d-a709-4437-8ca3-312d0385e8fc tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.568232 Aug 30 18:36:02.250336 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2037/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:01 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:02.541584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:02.542435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:02.557180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:02.557725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:02.558172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:02.558950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:02.559407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:02.559835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:03.030468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:03.044734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1a31102-8e3c-4cf5-a86c-ec9a84317bc6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.507123 Aug 30 18:36:03.045765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2162/4199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:02 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:03.271813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:03.272603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:03.297468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:03.297981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:03.298452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:03.308151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:03.308877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:03.309546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:03.602017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:03.604602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:03.622664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ade3909-9b99-43a0-94e6-4a9a7cbf12f6 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.352367 Aug 30 18:36:03.623314 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2038/4200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:03 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:04.065283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:04.066608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:04.084074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:04.084863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:04.085483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:04.086381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:04.087021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:04.087611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:04.108364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:04.645479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:04.646762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:04.649460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:04.653295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:04.677947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:04.679060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:04.680332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:04.682285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:04.684723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:04.685380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:05.036312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:05.049212 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5bc15d35-c67e-4461-90ee-86e89e4a712e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.987724 Aug 30 18:36:05.049844 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2163/4201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:04 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:05.103057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:05.115424 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d0012bc-5f73-4dd6-bd81-672e40193b03 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.474860 Aug 30 18:36:05.122088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2039/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:04 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:06.075886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:06.078576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:06.100137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:06.101660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:06.104079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:06.108305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:06.110225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:06.114328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:06.140648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:06.142109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:06.159467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:06.163312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:06.164144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:06.165380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:06.166594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:06.167166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:06.526443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:06.540347 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fac0df28-43c6-4c43-99b7-eac454931530 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.404365 Aug 30 18:36:06.558639 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2040/4203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:06 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:06.757346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:06.785537 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-770a5bbc-e2ab-451a-817e-13c3e3cd60bc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.710974 Aug 30 18:36:06.788414 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2164/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:06 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:07.565228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:07.565849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:07.579431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:07.580171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:07.580799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:07.582173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:07.583032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:07.583679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:07.809716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:07.831756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:07.840530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=60 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:07.862962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:07.864405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:07.865023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:07.866752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:07.867847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:07.868565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:08.019877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:08.033519 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56673639-c43b-471e-a38a-557c140db43a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.471901 Aug 30 18:36:08.052232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2041/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:07 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:08.704199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:08.753027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b85734d1-9f95-4528-b62a-cd8f8efbdd70 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.946521 Aug 30 18:36:08.753696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2165/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:07 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:09.057390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:09.057897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:09.067833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:09.075148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:09.075863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:09.076784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:09.077426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:09.078089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:09.780760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:09.783113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:09.797771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:09.799178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:09.800867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:09.803303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:09.804491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:09.805287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:09.955467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:09.982470 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92ddbe6f-4e49-4382-aec9-8f65b03c05c3 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.928998 Aug 30 18:36:10.000587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2042/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:09 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:10.308368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:10.334829 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e752953f-0eef-41f4-a1b4-8ac1538f66f3 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.556004 Aug 30 18:36:10.342973 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2166/4208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:09 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:10.712085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:10.714512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:10.721971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:10.722555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:10.722996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:10.723722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:10.724178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:10.724756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:10.808369 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a06297be-296a-4c07-8b91-0b54d17a689a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639/action" status: 200 len: 24564 microversion: 2.1 time: 0.100712 Aug 30 18:36:10.817356 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2043/4209] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:36:10 2022] POST /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639/action => generated 24564 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:36:11.012166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:11.012876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:11.030928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:11.033315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:11.033783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:11.034605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:11.035077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:11.035506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:11.366852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:11.367562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:11.379029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:11.382983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:11.384093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:11.385691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:11.388736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:11.389405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:11.439096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:11.456291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29af13c4-617b-4985-8b56-920779250533 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.441491 Aug 30 18:36:11.459256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2167/4210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:11 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:12.079031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2188eb-9f9e-4129-8227-9ae7ae7604cd", "name": "network-vif-plugged", "status": "completed", "tag": "cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:12.141248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:12.149895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:12.152939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:12.208565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] Creating event network-vif-plugged:cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a for instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd on n-h1-854119-10 Aug 30 18:36:12.217364 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1091a13e-4fe6-4152-a482-abbb40d3f905 req-02c848a0-0399-435f-8ed9-e3664d0098ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173559 Aug 30 18:36:12.220156 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2168/4211] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:12.304326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:12.336068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60e0c2e2-494a-4345-aa56-3be5e2c6ffcf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.974175 Aug 30 18:36:12.341644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2044/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:11 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:12.489164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:12.490193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:12.510669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:12.512954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:12.514234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:12.529945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:12.531067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:12.549101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:13.189051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:13.202332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b27d15d9-4849-4636-b5e0-114b534e7149 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.718776 Aug 30 18:36:13.207225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2169/4213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:12 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:13.379613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:13.381418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:13.395288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:13.396287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:13.396867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:13.400028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:13.400821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:13.401454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:13.719224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:13.720216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:13.736161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:13.736850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:13.737840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:13.739287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:13.740255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:13.758890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:13.934920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lazy-loading 'services' on Instance uuid e3f351a2-9905-4472-8234-c1e10e1377e6 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:36:14.003166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:14.021120 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c3e9a73-6e6e-4545-8e98-74e7789e9346 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1314 microversion: 2.1 time: 0.652880 Aug 30 18:36:14.039605 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2045/4214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:13 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:14.070486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a657c8e0-03a1-4cdf-8f59-7d36f961ea6c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6/os-volume_attachments/8272c052-163a-4404-9655-6f6add97dc02" status: 202 len: 0 microversion: 2.1 time: 0.357319 Aug 30 18:36:14.071431 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2170/4215] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:36:13 2022] DELETE /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6/os-volume_attachments/8272c052-163a-4404-9655-6f6add97dc02 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:14.226034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:14.226689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:14.238237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:14.241086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:14.247671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:14.248637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:14.249282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:14.249889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:14.559804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:14.574115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1d1119b-517d-4b14-bb9e-8cd1bbfc3bb9 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.351548 Aug 30 18:36:14.574814 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2046/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:14 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:15.049259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:15.052273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:15.071570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.072193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.072848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.073758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.074415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.074696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.478093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:15.487169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-125415bf-c847-4b13-9a29-b5d6acb16e93 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1501 microversion: 2.1 time: 0.443169 Aug 30 18:36:15.490929 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2171/4217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:15 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1501 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:15.513611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:15.514161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:15.528888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.529483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.530022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.531941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.532851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.536762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.595689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:15.597850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:15.610393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.620714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.621357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.626698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.629357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.630058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.766136 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa8bc02a-567a-4e78-8c1a-d9946020da9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd/action" status: 202 len: 0 microversion: 2.1 time: 0.256708 Aug 30 18:36:15.770949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2047/4218] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:36:15 2022] POST /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:15.787922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:15.790150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:15.811250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.815199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.817216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:15.826948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:15.832558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:15.834679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:16.126034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:16.147640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-264cc130-33e6-4885-88e8-00dac000c14f tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.554065 Aug 30 18:36:16.149750 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2172/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:15 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:16.317839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:16.335234 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8f7256e-a312-415a-b742-faf38f519564 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1506 microversion: 2.1 time: 0.559573 Aug 30 18:36:16.335856 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2048/4220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:15 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:17.172274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:17.174705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:17.189195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:17.191917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:17.194458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:17.195437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:17.197256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:17.219153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:17.275084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-93900008", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8a0ff73d-8971-451a-a94e-f7ffdf8386f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:17.459957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:36:17.845551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:17.853783 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c85f453b-d1b9-44c9-8c65-acef155aceae tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.688470 Aug 30 18:36:17.872220 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2173/4221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:17 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:17.878709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:17.879520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:17.886959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:17.887688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:17.888280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:17.889146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:17.889757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:17.890355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.356442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:18.372714 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78d4b7ae-5d01-473b-a316-55b83ff9f229 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1486 microversion: 2.1 time: 0.499030 Aug 30 18:36:18.373319 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2174/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:17 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1486 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:18.394741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:18.395355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:18.405857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:36:18.406870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:36:18.407571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:36:18.408615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:36:18.409261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:36:18.416369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.417108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.417516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.420905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.421411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.424099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.424975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.426078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.426524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.427835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.429402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.430540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.457889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:36:18.466328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:36:18.482813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lazy-loading 'flavor' on Instance uuid 0f2188eb-9f9e-4129-8227-9ae7ae7604cd {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:36:18.577238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:36:18.580339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a0ff73d-8971-451a-a94e-f7ffdf8386f4',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:36:18.921208 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65c3d4d1-32a7-4da8-9cbb-eb63efd2e878 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.649270 Aug 30 18:36:18.921972 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2049/4223] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:36:18.933262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:18.933983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:18.957328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.958680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.961085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.962932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:18.963778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:18.964539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:18.985536 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c2fc7f07-ff9a-47a3-84a5-e2b4adf4f9c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd/action" status: 202 len: 0 microversion: 2.1 time: 0.593147 Aug 30 18:36:19.013630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2175/4224] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:36:18 2022] POST /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:19.037786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-726aa28c-6370-433a-b7f3-1c9a3282459b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:19.040293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-726aa28c-6370-433a-b7f3-1c9a3282459b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:19.308351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-726aa28c-6370-433a-b7f3-1c9a3282459b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:19.356174 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-726aa28c-6370-433a-b7f3-1c9a3282459b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1055 microversion: 2.1 time: 0.334339 Aug 30 18:36:19.361381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2176/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:19 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1055 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:19.413745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:19.420147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:19.450066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:19.454462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:19.456915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:19.457829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:19.458450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:19.466212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:19.587070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:19.596807 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47155744-e410-48c1-9eeb-c22107dbe36d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.668708 Aug 30 18:36:19.607103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2050/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:18 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:20.062799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:20.077192 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4274d578-ee89-48d3-a211-fffde2728369 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1492 microversion: 2.1 time: 0.712767 Aug 30 18:36:20.080772 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2177/4227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:19 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1492 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:20.381048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:20.382116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:20.390306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:20.392153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:20.392817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:20.393726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:20.394444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:20.395027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:20.477530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:20.488765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c33065d6-fa40-487a-912f-4a551d963063 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1097 microversion: 2.1 time: 0.112424 Aug 30 18:36:20.489840 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2051/4228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:20 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1097 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:20.628161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:20.628880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:20.644617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:20.654868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:20.656551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:20.663796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:20.665884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:20.666696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:21.103854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:21.105936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:21.122329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:21.123349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:21.123991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:21.124983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:21.127168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:21.128951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:21.157957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:21.186862 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-97b93d3a-4501-4cb5-8a3a-0a59d0d7a66a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 0.563892 Aug 30 18:36:21.187720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2178/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:20 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:21.509826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:21.511043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:21.525336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:21.528228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:21.531014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:21.533663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:21.534733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:21.535444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:21.545016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:21.635145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:21.696106 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2bffdd41-83b5-4d7b-84af-8b9e05196fe6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1513 microversion: 2.1 time: 0.596479 Aug 30 18:36:21.698993 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2052/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:21 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:21.752373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:21.786202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8e0cbd6-56e5-4c2b-86c0-0c51341b99f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1153 microversion: 2.1 time: 0.278989 Aug 30 18:36:21.786916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2179/4231] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:21 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1153 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:22.215395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:22.216196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:22.229284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.232543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.234173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.236333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.241520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.244598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.587966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:22.604179 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4372ee8-85f5-443f-9c82-c872bf9adfe5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1485 microversion: 2.1 time: 0.391936 Aug 30 18:36:22.605023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2053/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:22 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1485 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:22.631163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:22.631719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:22.653471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.654139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.659648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.660591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.661087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.661519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.723638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:22.724657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:22.754079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.755209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.759437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.763956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.765877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.768118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.907834 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f283316c-09c5-4b09-a086-2d690567b723 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "POST /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81/action" status: 202 len: 0 microversion: 2.1 time: 0.280331 Aug 30 18:36:22.912158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2180/4233] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:36:22 2022] POST /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:22.914215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:22.914955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:22.935787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.936285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.941050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:22.942723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:22.943458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:22.944091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:23.216414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:23.240515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39fb81fa-ad65-4b8b-8ba4-a4a20c7a53e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1171 microversion: 2.1 time: 0.327466 Aug 30 18:36:23.243980 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2181/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:22 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1171 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:23.253513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:23.260708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:23.277648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:23.279780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:23.284568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:23.286912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:23.289741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:23.290780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:23.744613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:23.757395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a163a1d-94cc-4007-8b83-a36ee16e1f4e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 1.039873 Aug 30 18:36:23.767568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2054/4235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:22 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:23.786541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2188eb-9f9e-4129-8227-9ae7ae7604cd", "name": "network-vif-plugged", "status": "completed", "tag": "cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:23.828588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:23.831243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:23.839429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:23.900124 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] Creating event network-vif-plugged:cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a for instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd on n-h1-854119-10 Aug 30 18:36:23.908105 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8b4d365c-3afb-4ad9-8cb2-2470c8d4d06c req-bef2871f-b1a3-4b97-9f03-a96401326c43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139163 Aug 30 18:36:23.909247 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2055/4236] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:24.021458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:24.022526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:24.033205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.037717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.038623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:24.041718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.042645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.044304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:24.059514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:24.142546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:36:24.205133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:24.221726 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4256433e-3ed0-4f48-a178-e3dbdc84aa6c tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1493 microversion: 2.1 time: 0.974389 Aug 30 18:36:24.229312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2182/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:23 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1493 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:24.265918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:24.265918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:24.280188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.280683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.281336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:24.282521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.283714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.284359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:24.508303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6ddad65-4ffc-40bc-aaf2-f8bb2dee89b7 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 204 len: 0 microversion: 2.1 time: 0.490739 Aug 30 18:36:24.510639 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2056/4238] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:36:24 2022] DELETE /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:36:24.527534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:24.532629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:24.550987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.555624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.559516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:24.560679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:24.561316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:24.561903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:25.045638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:25.059231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:25.059852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b9f8e06-8ec1-4123-8585-3c890a2db9fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 0.799709 Aug 30 18:36:25.069701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2183/4239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:24 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:25.071440 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4ad6cda-8829-4e41-8532-2c2f7d67919c tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1470 microversion: 2.1 time: 0.555621 Aug 30 18:36:25.073047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2057/4240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:24 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:25.086413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:25.088635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:25.106394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:25.107217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:25.108184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:25.109125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:25.109797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:25.110468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:25.251296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:25.252186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:25.260812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:25.265736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:25.266429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:25.267488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:25.268148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:25.275113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:25.646981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:25.663573 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6c61d0c-bb93-485c-992f-794028b93d99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.589316 Aug 30 18:36:25.675737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2184/4241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:25 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:26.092174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:26.093068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:26.109432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:26.109948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:26.110412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:26.111137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:26.115887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:26.116374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.023305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:27.038839 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-163e37fd-5292-42e7-925f-875cc7a03f54 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1493 microversion: 2.1 time: 1.791247 Aug 30 18:36:27.042529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2058/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:25 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1493 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:27.057745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:27.059096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:27.069775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:27.077698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:27.080903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:27.081671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.082691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:27.084563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:27.089390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.688233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:27.706625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17bb840e-1913-4792-b003-90672247987c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 1.618562 Aug 30 18:36:27.722866 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2185/4243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:26 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:27.725720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:27.732812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:27.734125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:27.743107 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bef794b-94cf-4aab-b0bc-f3cbc67544d8 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1470 microversion: 2.1 time: 0.698921 Aug 30 18:36:27.746952 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2059/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:27 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1470 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:27.765149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:27.767705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b64793-1548-4fb5-8741-56f055f3ec6f", "tag": "867681d7-546e-49cf-8c6f-a588006fdcaa"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:27.768636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:27.772200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.773223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:27.773867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:27.780956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.808026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:27.809457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:27.818174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:27.861505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] Creating event network-changed:867681d7-546e-49cf-8c6f-a588006fdcaa for instance 61b64793-1548-4fb5-8741-56f055f3ec6f on n-h2-854119-10 Aug 30 18:36:27.883808 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5895538c-a00e-4a0f-84fb-35aa36c59864 req-113abbaa-6aff-4e29-b91e-30e252717718 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122696 Aug 30 18:36:27.885070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2060/4245] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:28.067174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:28.068218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:28.080244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:28.081907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:28.082512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:28.089570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:28.090210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:28.090779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:28.456727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:28.478067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:28.554194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:28.568980 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6f5f1f8-f99d-4571-aca5-0d49bd32fcb4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.843073 Aug 30 18:36:28.575606 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2186/4246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:27 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:28.736437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:28.750967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:28.769839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:28.770803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:28.771507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:28.772875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:28.773687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:28.774331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:29.292812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:29.320618 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63fd6670-a05f-4a5a-aaa9-e223d991576d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 0.588873 Aug 30 18:36:29.336445 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2187/4247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:28 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:29.353286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:29.360225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:29.367918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:29.384054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:29.384995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:29.387017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:29.388336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:29.388980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:29.390181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:29.620715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:29.634712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67268d73-4111-44cd-bf66-8874ef1eb8e5 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1493 microversion: 2.1 time: 1.567372 Aug 30 18:36:29.637509 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2061/4248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:28 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1493 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:29.657458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:29.658308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:29.686301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:29.686832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:29.687274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:29.688380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:29.688487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:29.694007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:29.769162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb6f3262c0434a7ba72a650c789ebe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d14f2ff7094da294686f06063e6e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:29.794662 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0dd533fb-4100-4081-beec-2d5ec3d81af9 tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 200 len: 1428 microversion: 2.1 time: 0.456623 Aug 30 18:36:29.798438 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2188/4249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:29 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 1428 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:29.956200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f351a2-9905-4472-8234-c1e10e1377e6", "name": "network-vif-deleted", "tag": "b04496e4-4e49-4707-bc88-92179e6edf28"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:29.992201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:29.993225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:29.995241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:30.025618 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] Creating event network-vif-deleted:b04496e4-4e49-4707-bc88-92179e6edf28 for instance e3f351a2-9905-4472-8234-c1e10e1377e6 on n-h2-854119-10 Aug 30 18:36:30.039153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-88998c1e-f2c5-4ed0-a5c4-477d04b6c415 req-d631c2cc-5928-4fdd-b714-ca7ab64c73e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090299 Aug 30 18:36:30.041639 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2189/4250] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:36:30.368846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:30.368846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:30.374319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:30.374850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:30.375283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:30.380343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:30.382064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:30.382570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:30.474695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:30.489417 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f24eb375-75ca-48f6-90b8-7c9307763a65 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.848641 Aug 30 18:36:30.505426 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2062/4251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:29 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:30.516401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37b737ff-9b0f-4870-9fe2-d59c392681d1"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:30.519457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:30.527841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:30.528705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:30.529332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:30.530940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:30.531636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:30.532437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.017631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:31.036658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1688599-11fb-43a3-93b5-f08954f47ac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 0.679713 Aug 30 18:36:31.038948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2190/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:30 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:31.054381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:31.055429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:31.067972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.068945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.069655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.071512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.072696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.073531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.074001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59cf6105-d835-4a81-9b30-0617c9e89412 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "POST /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553667 Aug 30 18:36:31.082951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2063/4253] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:36:30 2022] POST /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:31.109574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c60478ee-656c-4c39-8401-54631660a0f4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: .version_select at 0x7f4e566d5820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1346662935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWFclM2ToytwlGx+QzVX13oP697y8/CADQ61l7C7lE2S/yYTSAZVSZRDLF7jcQpJAWtR3y/IylM41tmmPwz2WcCcdohN3BtScfYbCcwX7gKd4isGQaRy3QMtKpE/H9QVA=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:31.204409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c60478ee-656c-4c39-8401-54631660a0f4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:36:31.230253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c60478ee-656c-4c39-8401-54631660a0f4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:36:31.367964 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c60478ee-656c-4c39-8401-54631660a0f4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.283935 Aug 30 18:36:31.376849 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2064/4254] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:36:31 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:31.404313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:31.406285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] [instance: e3f351a2-9905-4472-8234-c1e10e1377e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:31.420772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.421728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.422379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.423216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.423684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.424540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.445553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] HTTP exception thrown: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Request method failure captured: Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 HTTP/1.1 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlgDx-WkOakqCSjv1lHhdTdw_J0fh56wPXrB0301hFRTFBv4wwchNQGPaTlKWhic53zdpx3bQYKLJg04H0LPYLJSyWOr8U29bjPaj8ANHSDg68H3qCi8drh5mv4TuF4FSzjO1uvGxqfPqf8IPZLE5OWZs8ehA_lxGsqsweD_fwuRVOc Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d0d14f2ff7094da294686f06063e6e15 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesBackupsTest-1665334523 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0d14f2ff7094da294686f06063e6e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d0d14f2ff7094da294686f06063e6e15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d0d14f2ff7094da294686f06063e6e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d0d14f2ff7094da294686f06063e6e15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesBackupsTest-1665334523 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d0d14f2ff7094da294686f06063e6e15 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesBackupsTest-1665334523 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesBackupsTest-1665334523-project Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: cb6f3262c0434a7ba72a650c789ebe44 Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesBackupsTest-1665334523-project Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e3f351a2-9905-4472-8234-c1e10e1377e6'} Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:31.447640 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] Returning 404 to user: Instance e3f351a2-9905-4472-8234-c1e10e1377e6 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58627ab9-3812-422b-a972-6fc2c89f53fa tempest-VolumesBackupsTest-1665334523 tempest-VolumesBackupsTest-1665334523-project] 10.222.0.25 "GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6" status: 404 len: 111 microversion: 2.1 time: 0.067611 Aug 30 18:36:31.452793 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2065/4255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:31 2022] GET /compute/v2.1/servers/e3f351a2-9905-4472-8234-c1e10e1377e6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:36:31.512075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:31.512816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:31.526511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.527235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.529650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.530547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.531024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.531464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.805945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:31.820221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-886353b7-c0bc-4b0e-90e2-d6e5e0da585d tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1499 microversion: 2.1 time: 0.778658 Aug 30 18:36:31.821516 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2191/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:31 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1499 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:31.857511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:31.858183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:31.881956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.882626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.887475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.888325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:31.888815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:31.889253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:31.971210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:36:32.201080 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72123fa3-08e9-40ee-afa9-a8432eb64273 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 204 len: 0 microversion: 2.1 time: 0.348889 Aug 30 18:36:32.201979 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2192/4257] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:36:31 2022] DELETE /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:36:32.215376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:32.218541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:32.233714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.237474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.237933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.238921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.242394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.243026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.353348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:32.385079 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09c26346-f740-496e-90c3-782a2ef9cf9d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.877006 Aug 30 18:36:32.405694 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2066/4258] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:31 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:32.420926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:32.421960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:32.441136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.443862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.445603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.446429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:32.449021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:32.449556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:32.847688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:32.852579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:32.870560 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8dbe09a5-b464-4d69-b849-d6c4cc4891b0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 0.662895 Aug 30 18:36:32.883993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2193/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:32 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:33.417901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:33.419209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:33.420193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:33.430119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e48e1d9c-b8ad-479a-920b-0817d11fe643 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 1.022372 Aug 30 18:36:33.435144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2067/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:32 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:33.489788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.491023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.491627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.492450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.492977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.495657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.895328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:33.896224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:33.913970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.915440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:33.916198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.917157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.920287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:33.927483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:33.929006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:33.939400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2603a0ef-8daf-4d43-816b-9a248633787c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.532212 Aug 30 18:36:33.948853 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2194/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:33 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:34.463256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:34.476703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:34.496906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:34.497688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:34.502528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:34.510780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:34.512033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:34.514128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:34.564846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:34.573192 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b3e9b594-a43d-4708-ae70-db7e89dcbb02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1213 microversion: 2.1 time: 0.683600 Aug 30 18:36:34.573787 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2068/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:33 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1213 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:34.977987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:34.978997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:34.997620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:35.002570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:35.004626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:35.008523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:35.010889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:35.012013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:35.455064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:35.467199 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e1451572-017a-47ee-87de-d6033a4ca8fe tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.501459 Aug 30 18:36:35.470029 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2069/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:34 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:35.598887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:35.599817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:35.612233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:35.612948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:35.614478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:35.617096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:35.617762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:35.618291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:35.618999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:35.637022 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f23f698-70bd-4294-acff-7984d0bbcb27 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1505 microversion: 2.1 time: 1.178177 Aug 30 18:36:35.638812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2195/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:34 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1505 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:36.088717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1429757061", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "230ad020-596c-4411-8469-d60edf745ed5"}], "key_name": "tempest-TestNetworkBasicOps-1346662935", "security_groups": [{"name": "tempest-secgroup-smoke-2084737679"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:36.513446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] validate_networks() for [('230ad020-596c-4411-8469-d60edf745ed5', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:36:36.831836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:36.847926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf26ceb1-076f-4aa0-baa7-7c58a6eda262 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 1.253154 Aug 30 18:36:36.848456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2070/4265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:35 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:36.880313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:36.881469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:36.907518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:36.908027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:36.914588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:36.915366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:36.922025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:36.927066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.657646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:37.675143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62e69df0-be62-4a5a-9707-5aaeb6288ea5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.817450 Aug 30 18:36:37.692184 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2071/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:36 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:37.713824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:37.714041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:37.715105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:36:37.715568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:36:37.715878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:36:37.718052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:36:37.718971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:36:37.723926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.724874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.726063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.727146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.727897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.728920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.737300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:37.742386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.742874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.743321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.744209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.755183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.757440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.820888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.821390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.821835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.823986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lazy-loading 'fault' on Instance uuid bcf4659c-622d-4735-af9f-1793c5383e81 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:36:37.850843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:36:37.882196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:36:37.904103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:37.914564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:36:37.917562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:36:37.918108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-26bb7c8e-5401-4b18-9fa8-bf3da5b536b4 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 200 len: 1303 microversion: 2.1 time: 0.224133 Aug 30 18:36:37.923784 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2072/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:37 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:37.929365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf4659c-622d-4735-af9f-1793c5383e81", "name": "network-vif-deleted", "tag": "980c1053-41c6-4478-aada-a53721af088b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:37.973215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:37.975407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:37.978520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:37.992467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:38.012226 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] Creating event network-vif-deleted:980c1053-41c6-4478-aada-a53721af088b for instance bcf4659c-622d-4735-af9f-1793c5383e81 on n-h2-854119-10 Aug 30 18:36:38.023701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3c4c165a-1461-4c37-9e79-29f2862ac8bc req-953d00d3-4ed4-45d2-99d9-091ea28cb9e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098483 Aug 30 18:36:38.024343 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2073/4268] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:38.036139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-459e63c5-dee1-49df-9c6c-c34bb7f563b0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.951438 Aug 30 18:36:38.037757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2196/4269] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:36:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:36:38.046757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:38.050693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:38.050822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-08f00036-bb6c-4bb8-ba20-7b888135dcd8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:38.052034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-08f00036-bb6c-4bb8-ba20-7b888135dcd8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:38.071849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.072661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.076438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:38.079435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.081085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.083766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:38.179218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08f00036-bb6c-4bb8-ba20-7b888135dcd8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:38.188672 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-08f00036-bb6c-4bb8-ba20-7b888135dcd8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1249 microversion: 2.1 time: 0.142902 Aug 30 18:36:38.193492 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2197/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:38 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1249 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:38.626821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:38.640025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cb5cc73-0ef0-4e9b-953b-57eb10a809e2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.612851 Aug 30 18:36:38.642731 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2074/4271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:38 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:38.710335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:38.711941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:38.734852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.735856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.737844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:38.740338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.741017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.755663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:38.957258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:38.957891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: bcf4659c-622d-4735-af9f-1793c5383e81] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:38.973478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.974002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.974525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:38.985597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:38.986115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:38.990045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.027980 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] HTTP exception thrown: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Request method failure captured: Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 HTTP/1.1 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlgtZC79y9zUr10NysSu_bNPyuNX5f6AISSh7vuVh1fjzzBTGEQLsqAl3nHawigY_9nRXDpTUaUKTq_Kc8fZ_kvVsx0TegJmgACj4g-ld13yj21yUbfq9hJMuxen9ruzsegQw_UZhHRN-DJUStjIwmkJfo0HPVTyHlwz8si5je8uOvw Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 5334c78e90284de7bdffb6eddf9a32ca Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 5334c78e90284de7bdffb6eddf9a32ca Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerRescueTestJSON-1658006902-project Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dca901cc5b0b41c08aab5eca6bcf4d0c Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerRescueTestJSON-1658006902-project Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bcf4659c-622d-4735-af9f-1793c5383e81'} Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:39.031040 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. Aug 30 18:36:39.036237 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:36:39.038774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Returning 404 to user: Instance bcf4659c-622d-4735-af9f-1793c5383e81 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:36:39.041958 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-beaf12e1-4a3c-470e-bf96-57badedd6339 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81" status: 404 len: 111 microversion: 2.1 time: 0.088807 Aug 30 18:36:39.043591 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2075/4272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:38 2022] GET /compute/v2.1/servers/bcf4659c-622d-4735-af9f-1793c5383e81 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:36:39.058573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:39.059363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:39.069907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.070585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.071338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.072534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.073408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.074195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.152875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:36:39.427078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:39.433302 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e9abc8f-613c-4d53-ada7-5e54c5208f90 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 204 len: 0 microversion: 2.1 time: 0.383609 Aug 30 18:36:39.439798 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2076/4273] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:36:39 2022] DELETE /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:36:39.447218 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7abeddf1-6433-4a03-9098-5507173e7850 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.740573 Aug 30 18:36:39.447928 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2198/4274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:38 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:39.453334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:39.466465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:39.467149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:39.467891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:39.488139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.488557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.488738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.489095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.490968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.493746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.494098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.494883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.495836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.496007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.498941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.499595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.737521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:39.746829 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61cab9f6-f4e5-4339-8729-781c84bb5a73 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1245 microversion: 2.1 time: 0.305377 Aug 30 18:36:39.750790 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2077/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:39 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1245 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:39.775597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:39.776778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:39.785458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.786445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.787055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.787783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:39.788569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:39.789476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:39.961780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:39.980482 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3cce1e1-79b0-4b38-a6ea-3d0cc8b2e949 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1492 microversion: 2.1 time: 0.531735 Aug 30 18:36:39.984227 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2199/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:39 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1492 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:40.165938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:40.185205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c771812-314a-4574-95a2-4a673d37c584 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.417163 Aug 30 18:36:40.190332 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2078/4277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:39 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:40.471987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:40.472610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:40.480338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:40.482854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:40.484449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:40.485330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:40.486025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:40.486718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:40.719579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:40.732243 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcd6b352-357c-44a1-8a02-c71a907bee85 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.264819 Aug 30 18:36:40.735509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2200/4278] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:40 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:40.771930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:40.772554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:40.794716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:40.795056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:40.795829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:40.797399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:40.800959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:40.801928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.005096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:41.006607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:41.023963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.024880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.025607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.026639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.027359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.028824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.070107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:41.085206 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07aa980e-311c-4c04-9829-af20a1bc7bb5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1245 microversion: 2.1 time: 0.317142 Aug 30 18:36:41.086297 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2079/4279] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:40 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1245 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:41.214216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:41.216585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:41.245609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.246288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.247001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.249233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.251667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.252192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.308650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:41.624748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:41.660233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1933296a-93d1-47d9-9fb6-6a0210fcd195 tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1492 microversion: 2.1 time: 0.659008 Aug 30 18:36:41.660897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2201/4280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:40 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1492 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:41.754896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:41.755456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:41.774269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.774981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.779773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.780666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:41.781156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:41.781671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:41.782524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:41.792555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a932652-9cc5-4157-87b6-0e523ce6a6e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.584476 Aug 30 18:36:41.817581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2080/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:41 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:42.109184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:42.109901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:42.131238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.132112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.134013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:42.136431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.139281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.140476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:42.252760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:42.275061 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e44736e-9a4a-46ed-8019-b725ee552c88 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.524217 Aug 30 18:36:42.277634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2202/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:41 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:42.309603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:42.319883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-052a8641-fa29-4601-a8de-74083ebf16b1 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1301 microversion: 2.1 time: 0.214838 Aug 30 18:36:42.324645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2081/4283] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:42 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1301 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:42.690601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:42.691605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:42.704913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.705793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.706468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:42.709250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.712626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.714304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:42.826534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:42.827545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:42.841748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.842669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.843337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:42.844566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:42.845253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:42.845920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:43.385813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:43.399644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ce8a666-0c73-4533-869e-915d72511c20 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.578225 Aug 30 18:36:43.430322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2082/4284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:42 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:43.453887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:43.458268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:43.484673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:43.485844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:43.489041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:43.492193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:43.495647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:43.497210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:43.632809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:43.648710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c78f8ff-f747-4651-8f14-47c6c34a76ba tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1492 microversion: 2.1 time: 0.963184 Aug 30 18:36:43.663759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2203/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:42 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1492 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:43.663759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:43.663759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:43.690802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:43.698334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:43.699030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:43.699876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:43.700429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:43.700937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.082048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:44.092519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f569410-19d8-428b-82df-f9198afa77f5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1307 microversion: 2.1 time: 0.441537 Aug 30 18:36:44.110545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2204/4286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:43 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1307 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:44.242420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:44.251419 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab8ec560-1808-49bb-bacd-6851f6718352 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.820141 Aug 30 18:36:44.260201 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2083/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:43 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:44.430134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:44.432600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:44.450972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:44.453005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:44.457527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.460421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:44.463049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:44.463712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.593513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce51b58d-52da-488c-bd92-ae5fd698d608", "name": "network-vif-deleted", "tag": "4edf6eb2-d6f7-47aa-b1aa-f245734c137b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:44.617361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:44.618230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:44.621826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.654119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] Creating event network-vif-deleted:4edf6eb2-d6f7-47aa-b1aa-f245734c137b for instance ce51b58d-52da-488c-bd92-ae5fd698d608 on n-h2-854119-10 Aug 30 18:36:44.668243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4af01181-bffb-472b-8c09-99fd426c8d1b req-9690e292-f063-4bb7-975a-4c8eddb56a46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078933 Aug 30 18:36:44.669392 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2084/4288] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:44.679321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:44.687523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:44.710938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:44.711841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:44.713472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.714522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:44.715165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:44.715938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:44.956286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca901cc5b0b41c08aab5eca6bcf4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5334c78e90284de7bdffb6eddf9a32ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:44.974026 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edf9fabe-0524-4cf6-805a-d08ca37b148a tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 200 len: 1285 microversion: 2.1 time: 0.294657 Aug 30 18:36:44.975498 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2085/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:44 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 1285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:45.119449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:45.120076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:45.145348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:45.150465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:45.151783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:45.157337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:45.158152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:45.160287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:45.534485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:45.557060 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80554bf7-ce5d-4683-8a4b-f9f8defd881a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1307 microversion: 2.1 time: 0.442056 Aug 30 18:36:45.568315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2086/4290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:45 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:45.577640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:45.578270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:45.600663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:45.604104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:45.606035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:45.608903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:45.609661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:45.610308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:45.895143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:45.919392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4ed7dab-b5ac-41c1-bf39-4b5a69673657 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 1.497660 Aug 30 18:36:45.955304 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2205/4291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:44 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:45.964316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:45.981936 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c82a8cab-d0ab-4e49-99a5-0ede03ff7d55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.410703 Aug 30 18:36:45.998431 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2087/4292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:45 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:46.004075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:46.004985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] [instance: ce51b58d-52da-488c-bd92-ae5fd698d608] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:46.024471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.026602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.027294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:46.029969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.030800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.031458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:46.053811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] HTTP exception thrown: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Request method failure captured: Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 HTTP/1.1 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlgtZC79y9zUr10NysSu_bNPyuNX5f6AISSh7vuVh1fjzzBTGEQLsqAl3nHawigY_9nRXDpTUaUKTq_Kc8fZ_kvVsx0TegJmgACj4g-ld13yj21yUbfq9hJMuxen9ruzsegQw_UZhHRN-DJUStjIwmkJfo0HPVTyHlwz8si5je8uOvw Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 5334c78e90284de7bdffb6eddf9a32ca Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5334c78e90284de7bdffb6eddf9a32ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 5334c78e90284de7bdffb6eddf9a32ca Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueTestJSON-1658006902 Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueTestJSON-1658006902-project Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: dca901cc5b0b41c08aab5eca6bcf4d0c Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueTestJSON-1658006902-project Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ce51b58d-52da-488c-bd92-ae5fd698d608'} Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:46.056172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. Aug 30 18:36:46.065506 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:46.068627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] Returning 404 to user: Instance ce51b58d-52da-488c-bd92-ae5fd698d608 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:36:46.069678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-299062ed-04eb-4e7b-9049-c9958b6625bf tempest-ServerRescueTestJSON-1658006902 tempest-ServerRescueTestJSON-1658006902-project] 10.222.0.25 "GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608" status: 404 len: 111 microversion: 2.1 time: 0.073384 Aug 30 18:36:46.075045 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2206/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:45 2022] GET /compute/v2.1/servers/ce51b58d-52da-488c-bd92-ae5fd698d608 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:36:46.577219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:46.577841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:46.594267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.594976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.595435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:46.596182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.603026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.607244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:46.814829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:46.829830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:46.840434 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-581b4c54-f289-45bb-8930-645dc6fd6d16 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1307 microversion: 2.1 time: 0.267012 Aug 30 18:36:46.843962 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2088/4294] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:46 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:46.947709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:46.948430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:46.960677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.970168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.971985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:46.972771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:46.973262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:46.973681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:47.005918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:47.006752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:47.029348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:47.029858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:47.030303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:47.031054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:47.035847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:47.036305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:47.300106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:47.316122 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0a66dac-04d1-496c-a5cc-d437cc38f84d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.371516 Aug 30 18:36:47.328633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2207/4295] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:46 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:47.819178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:47.828584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6d45936-1f04-41cc-b638-67736117e6eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.826967 Aug 30 18:36:47.829188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2089/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:47 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:47.860211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:47.866174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:47.866820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:47.891944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:47.892601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:47.893062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:47.901990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:47.903170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:47.903868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:48.186211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:48.245589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:48.253567 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acaf7608-eef8-4df3-9e90-3a52b77656b5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.394027 Aug 30 18:36:48.254176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2208/4297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:47 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:48.338140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:48.338799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:48.344973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b64793-1548-4fb5-8741-56f055f3ec6f", "name": "network-vif-plugged", "status": "completed", "tag": "867681d7-546e-49cf-8c6f-a588006fdcaa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:48.367712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:48.370944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:48.371359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:48.372209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:48.372705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:48.373113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:48.379748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:48.391123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:48.391586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:48.437317 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] Creating event network-vif-plugged:867681d7-546e-49cf-8c6f-a588006fdcaa for instance 61b64793-1548-4fb5-8741-56f055f3ec6f on n-h2-854119-10 Aug 30 18:36:48.464552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-85fbc826-0d43-46e3-b372-a53a11f12ad8 req-911a56e9-3d55-45fa-be49-040cb22bc187 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123089 Aug 30 18:36:48.465233 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2209/4298] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:36:48.850296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:48.851136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:48.868256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:48.876856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:48.877465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:48.878083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:48.878705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:48.879154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:49.269591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:49.293553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cbaa806-6f98-4dd6-8c6d-491e28b0756d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.955057 Aug 30 18:36:49.299254 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2090/4299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:48 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:49.324916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:49.325878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:49.338011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:49.339157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:49.349034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:49.350447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:49.351261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:49.353222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:49.638969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:49.653400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07c70b18-b3ae-4720-8478-8f2a64ff539d tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.348643 Aug 30 18:36:49.661958 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2091/4300] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:49 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:50.166492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:50.186975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee890698-d406-41a5-bfd3-0f719d4fbfb6 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 1.340976 Aug 30 18:36:50.193523 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2210/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:48 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:50.325471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:50.327627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:50.349270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:50.353942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:50.357187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:50.363071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:50.363850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:50.364473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:50.691379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:50.693702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:50.726274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:50.734073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:50.738050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:50.747773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:50.748410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:50.748871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:51.206852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:51.226255 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0992bda7-68c5-415e-a5ae-7debeb7ea36b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1201 microversion: 2.1 time: 0.903768 Aug 30 18:36:51.230405 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2092/4302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:50 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1201 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:51.251753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:51.255909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:51.270775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:51.279491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:51.279961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:51.280719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:51.288621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:51.289432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:51.740916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:51.763107 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba61135a-b264-4f8e-8b6d-ea05b3957014 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 1.080348 Aug 30 18:36:51.769121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2211/4303] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:50 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:51.807259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0", "tag": "5690cdad-7f71-4e21-bca3-f9cb394d246a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:51.841442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:51.846115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:51.846849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:51.896342 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] Creating event network-changed:5690cdad-7f71-4e21-bca3-f9cb394d246a for instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 on n-h2-854119-10 Aug 30 18:36:51.905832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e584229b-eef2-4383-a35b-955fc9a8258e req-4a627be3-721e-4a47-b3f2-cd5bde3e632a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119183 Aug 30 18:36:51.907234 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2212/4304] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:52.109548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:52.130028 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dfd73f07-d2a2-49a7-8edf-d648063aae53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.890451 Aug 30 18:36:52.134617 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2093/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:51 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:52.313690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:52.314627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:52.355795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:52.357666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:52.360483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:52.364423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:52.371143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:52.388387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:52.790109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:52.790820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:52.815675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:52.816176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:52.822955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:52.826742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:52.830386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:52.834218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.141586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:53.150858 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-362f164d-2dbe-42a6-be67-f81a29831c70 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1387 microversion: 2.1 time: 0.846741 Aug 30 18:36:53.155570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2213/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:52 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1387 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:53.168149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:53.169195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:53.189392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.190275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.191780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.193004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.193541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.194064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.232576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:53.520944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:53.528386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:53.542787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bf9bc89-6298-41b0-8abe-2b6c31d323da tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1508 microversion: 2.1 time: 0.384388 Aug 30 18:36:53.543403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2214/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:53 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:53.546384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-137339fa-1f83-468d-86c0-d32474224c27 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.760859 Aug 30 18:36:53.547390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2094/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:52 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:53.550124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:53.550930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:53.568271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.569632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.574243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.578485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.581116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.583756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.874838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:53.888897 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b5d19f1-d843-4d91-9546-a4d9ee82b332 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1387 microversion: 2.1 time: 0.343540 Aug 30 18:36:53.890682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2215/4309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:53 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1387 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:53.935954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:53.936889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:53.946178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.947920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.948645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:53.949945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:53.951031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:53.951850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.421694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:54.446441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7cf2bb0d-d19b-4a19-8cbb-abff0c47b4a8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1387 microversion: 2.1 time: 0.533888 Aug 30 18:36:54.481952 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2095/4310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:53 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1387 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:54.492561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:54.493392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:54.504886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.505563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.506226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.507158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.507783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.508365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.559385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:36:54.586957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:54.588150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:54.623983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.625161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.626584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.628475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.629585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.630762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.753190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed73e2d0-d5d0-4e37-b814-d3833b300e25 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 204 len: 0 microversion: 2.1 time: 0.262731 Aug 30 18:36:54.755988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2216/4311] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:36:54 2022] DELETE /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:36:54.767517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:54.768695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:54.778818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.779822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.780601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:54.781771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:54.782749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:54.783498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:55.420433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:55.437520 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d6ea4ea-6a60-4250-9712-df92f6eee6de tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1505 microversion: 2.1 time: 0.876124 Aug 30 18:36:55.439318 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2096/4312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:54 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1505 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:55.450206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:55.451149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:55.460684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:55.461740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:55.462621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:55.464035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:55.476675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:55.476675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:55.586634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:55.596787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-970972a6-1744-4d6e-a4f8-adc59a013aaa tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.838167 Aug 30 18:36:55.611291 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2217/4313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:54 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:56.045791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4ac50bb7-0f45-4884-87bc-593f2a8f859b"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:56.049104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:56.073314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.073314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.077597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.079669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.081331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.084266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.207197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:56.221207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-776b2ab7-51c5-4228-a54e-3726248bca4a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1393 microversion: 2.1 time: 0.779379 Aug 30 18:36:56.222655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2097/4314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:55 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1393 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:56.292110 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] HTTP exception thrown: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Request method failure captured: Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments/37b737ff-9b0f-4870-9fe2-d59c392681d1 HTTP/1.1 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 74 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlhguYwfmnH15v1QP05rl4e8smn4DhLaw66m8BfPfixXCbSREckujqdHqqxflYXA1BnjSSaEe-yKAxYV8I6ccW5VATVT0hCUXe-hvFXHahqRqvNtDf39vIT9qqy8VgWQu-wFa-jx6SKy4kFEsw86XcF6glcrEts_ZlmCQ0KGynIIRNE Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 406c1c17a5564b1d80809f056abbf708 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_406c1c17a5564b1d80809f056abbf708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 406c1c17a5564b1d80809f056abbf708 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesAdminNegativeTest-305814444-project-admin Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5d7dfcefb08d439ea6d68f10b212968c Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesAdminNegativeTest-305814444-project-admin Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: {"volumeAttachment": {"volumeId": "4ac50bb7-0f45-4884-87bc-593f2a8f859b"}} Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: exception: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '3d958ec3-a773-47c0-a2d7-b70184f7fc43', 'id': '37b737ff-9b0f-4870-9fe2-d59c392681d1', 'body': {'volumeAttachment': {'volumeId': '4ac50bb7-0f45-4884-87bc-593f2a8f859b'}}} Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. (HTTP 404) (Request-ID: req-947b477f-decb-43b5-9167-2651191851b0) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:36:56.295690 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Returning 400 to user: Volume 4ac50bb7-0f45-4884-87bc-593f2a8f859b could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:36:56.302333 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68be0123-a7a5-48f8-afe4-483c9f890d5c tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments/37b737ff-9b0f-4870-9fe2-d59c392681d1" status: 400 len: 107 microversion: 2.1 time: 0.685003 Aug 30 18:36:56.313270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2218/4315] 10.222.0.25 () {60 vars in 1433 bytes} [Tue Aug 30 18:36:55 2022] PUT /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments/37b737ff-9b0f-4870-9fe2-d59c392681d1 => generated 107 bytes in 690 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:36:56.422081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:56.422663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:56.432497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.432999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.433446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.434173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.434659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.435091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.461201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:56.461815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:56.470451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.473078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.473870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.476292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.480002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.481359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.697321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lazy-loading 'services' on Instance uuid 3d958ec3-a773-47c0-a2d7-b70184f7fc43 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:36:56.896386 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e562a6ed-466f-4ccc-921c-968b6f781190 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments/37b737ff-9b0f-4870-9fe2-d59c392681d1" status: 202 len: 0 microversion: 2.1 time: 0.477919 Aug 30 18:36:56.897513 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2098/4316] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:36:56 2022] DELETE /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments/37b737ff-9b0f-4870-9fe2-d59c392681d1 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:36:56.907912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:56.910028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:56.925947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.927973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.930283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:56.938019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:56.938892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:56.941546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:57.015811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:57.031547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a9f601e-d648-4165-8e61-521f4271124a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1505 microversion: 2.1 time: 0.573183 Aug 30 18:36:57.037545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2219/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:56 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:57.043771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:57.046075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:57.062119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:57.063142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:57.063738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:57.065993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:57.066755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:57.068549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:57.120953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8e95d6d-2393-43ac-bf08-29331ca28d71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081154 Aug 30 18:36:57.121855 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2220/4318] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:36:57 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:57.247358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:57.248501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:57.257361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:57.261500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:57.261966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:57.262775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:57.263237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:57.263667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:57.638940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:57.659242 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c979fdc-eed0-4d5e-81b2-c0954e196fe4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.752642 Aug 30 18:36:57.663829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:57.669514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2099/4319] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:56 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:57.677791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a3dca046-f7ac-40b0-924f-a6155e15855f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1393 microversion: 2.1 time: 0.434373 Aug 30 18:36:57.678722 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2221/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:57 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1393 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:36:58.061851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:58.062829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:58.067117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b64793-1548-4fb5-8741-56f055f3ec6f", "name": "network-vif-deleted", "tag": "867681d7-546e-49cf-8c6f-a588006fdcaa"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:58.081300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:36:58.085759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.088954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.092942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.093867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.096776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.097260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.098529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.099070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.099514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.167652 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] Creating event network-vif-deleted:867681d7-546e-49cf-8c6f-a588006fdcaa for instance 61b64793-1548-4fb5-8741-56f055f3ec6f on n-h2-854119-10 Aug 30 18:36:58.199687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-83538738-a7a5-4f0d-8d2f-735a05804711 req-1ec8bf02-9234-41da-a73a-ffb43afe297b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122469 Aug 30 18:36:58.203870 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2222/4321] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:58.211455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:58.228887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:58.264346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.264627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.265071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.268561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.273763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.276983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.376706 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-327b33f8-9a5b-4c47-af1e-3adc7dada231 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169514 Aug 30 18:36:58.377538 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2223/4322] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:36:58 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:58.601487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0", "name": "network-vif-plugged", "status": "completed", "tag": "5690cdad-7f71-4e21-bca3-f9cb394d246a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:36:58.635468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.637214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.638247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.685602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] Creating event network-vif-plugged:5690cdad-7f71-4e21-bca3-f9cb394d246a for instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 on n-h2-854119-10 Aug 30 18:36:58.705777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b8e94a8-dc01-4254-8891-53a0f6757b72 req-b3f61ffb-059b-49d6-a4de-ebccc0eed099 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107636 Aug 30 18:36:58.709256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2224/4323] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:36:58.724573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:58.730704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:58.760100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.760924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.761556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.774809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.776799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.777444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.849276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:58.862996 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d32e596-0256-4840-8773-ad377220a6cd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1505 microversion: 2.1 time: 0.806404 Aug 30 18:36:58.890771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2100/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:58 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:58.896069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:58.901004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:58.924300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.924806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.925259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:58.925994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:58.926851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:58.936935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:59.110065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:59.127059 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d595d97-808c-4309-a4dd-d8227bab76fe tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.233517 Aug 30 18:36:59.129793 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2101/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:58 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:59.393541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:59.396209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:59.411073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:36:59.437354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf61b576-37b0-463a-9e0a-db9bd6c773a6 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.709834 Aug 30 18:36:59.438374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:59.439355 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2225/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:58 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:36:59.440059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:59.440757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:59.443241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:59.443941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:59.444547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:59.508090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a550bfa1-f137-4e5e-bcfb-1f8d7f3a1030 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118380 Aug 30 18:36:59.508738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2102/4327] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:36:59 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:36:59.893630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:36:59.894278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:36:59.914568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:59.916089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:59.916934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:36:59.917935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:36:59.918617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:36:59.919242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.151120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:00.151878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:00.163262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.166270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.167663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.169562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.170442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.171355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.279668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:00.288702 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1779028-2d6d-4aaf-89da-7a7980b1315c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 200 len: 1448 microversion: 2.1 time: 0.399227 Aug 30 18:37:00.292072 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2226/4328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:36:59 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 1448 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:00.314738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:00.314738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:00.322318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.322550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:00.325624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.326819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.328663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.330616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.334039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.362746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16149696-41e8-4626-b690-cf7441739993 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.215509 Aug 30 18:37:00.366425 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2103/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:00 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:00.465140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:00.470293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:00.497024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.499379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.502057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.504935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.509492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.512618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.772412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:00.782642 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5170468-7544-430b-855f-71fae84743e9 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.473733 Aug 30 18:37:00.800091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2227/4330] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:00.810104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:00.812802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:00.828408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.835350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.836127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.837817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.838542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.839160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.926332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41f0dd72-d4b2-483c-96d5-a74e281e4a2b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127141 Aug 30 18:37:00.930260 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2228/4331] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:00 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:00.940334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:00.941330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:00.954210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.955333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.956191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.967202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:00.968306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:00.971336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:00.979493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:00.983008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:01.000191 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-793a7bc9-0a6a-49c7-8fc2-1a4096bda10c tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1375 microversion: 2.1 time: 0.539895 Aug 30 18:37:01.004135 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2104/4332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:00 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1375 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:01.020072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2188eb-9f9e-4129-8227-9ae7ae7604cd", "name": "network-vif-unplugged", "status": "completed", "tag": "cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:01.045979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.046911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.047520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.077228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_external_events [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] Unable to find a host for instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd. Dropping event network-vif-unplugged {{(pid=122590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:37:01.081628 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1403f46b-d685-4cfd-8ee7-384b9cdc294c req-e4cf3441-8398-459d-9430-87045512fb87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.074338 Aug 30 18:37:01.082613 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2105/4333] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:37:01.299272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:01.309543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ef96736-6055-42f9-8759-44bb7b7a738c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.377498 Aug 30 18:37:01.325720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2229/4334] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:01.346132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:01.347448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:01.365044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.366073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.367594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.371946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.372636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.374609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.392573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:01.394072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:01.411745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.412254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.416316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.419277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.419760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.420194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.595821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:01.598821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:01.613178 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-196ca695-85c3-4577-a52a-c0cb6d67b7c4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.226935 Aug 30 18:37:01.631621 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2230/4335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:01 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:01.747416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:01.759404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e66c8b3d-ed72-468b-9004-2475e7d998b7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.417518 Aug 30 18:37:01.764171 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2106/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:01 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:01.781684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:01.782373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:01.806702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.807157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.812637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.813720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.814372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.815002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.942217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:01.946077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:01.972276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.972514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.972960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:01.973686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:01.978927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:01.979724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.062318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c7dc424-8a2b-4a63-80e3-b7800286d0ee tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124513 Aug 30 18:37:02.068082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2107/4337] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:01 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:02.076303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:02.089657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:02.096731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.097588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.098465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.099782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.100468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.103875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.456119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:02.467111 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c1bc225-c651-4049-b748-eddfb6ae5232 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1548 microversion: 2.1 time: 0.397699 Aug 30 18:37:02.471804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2108/4338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:02 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1548 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:02.497389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:02.498333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:02.513644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.514493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.516953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.525429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.528913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.529871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.738762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:02.758443 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b140621-71f6-42b2-8744-379b20e8b376 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.974635 Aug 30 18:37:02.760934 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2231/4339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:01 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:02.769246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:02.770116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:02.792202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.794635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.795832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.797054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.799239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.799967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.855185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:02.867679 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e8ff0db-761d-475f-a330-df5c07c77859 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1548 microversion: 2.1 time: 0.377614 Aug 30 18:37:02.870418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2109/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:02 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1548 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:02.876084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:02.902435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:02.903900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:02.905339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:02.968671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Going to try to stop instance {{(pid=122590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:37:02.988219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:03.012064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-71149bf9-1b1c-484f-80b2-4680254f1e66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.249394 Aug 30 18:37:03.015397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2232/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:02 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:03.062976 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93f73d38-cb07-4584-a19e-cf91f49826eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.190561 Aug 30 18:37:03.064648 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2110/4342] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:02 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:03.083887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:03.084128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:03.086391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:03.091366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:03.106235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:03.106778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:03.107223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:03.107949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:03.108386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:03.108534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:03.108829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:03.110026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:03.110560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:03.112160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:03.115111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:03.117409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:03.217283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8faf63e6-6543-4c69-a2b1-e4b09133aa20 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146245 Aug 30 18:37:03.222570 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2111/4343] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:03 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:04.001626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:04.012577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5274d39f-658d-4f44-96d0-b33a1994631d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.943928 Aug 30 18:37:04.027013 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2233/4344] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:04.045571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:04.047134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:04.054721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:04.055870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:04.056511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:04.057401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:04.058044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:04.058669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:04.154409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:04.172691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d90c422-5034-4926-b2be-f3e2672c7f9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.139358 Aug 30 18:37:04.182129 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2112/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:04 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:04.230984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:04.251381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:04.267765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:04.268571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:04.270412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:04.277642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:04.278484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:04.279212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:04.369197 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3333b253-06de-4fbf-b792-e20407aa0b1f tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141202 Aug 30 18:37:04.377698 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2234/4346] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:04 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:05.051801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:05.053080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:05.066005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.074631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.075096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.075867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.076327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.076757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.208908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:05.209514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:05.226908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.228427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.228927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.230107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.230613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.231082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.351411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:05.364859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-293d6763-79f4-4b0d-8998-5961ef5a3f2f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.160040 Aug 30 18:37:05.367473 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2235/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:05 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:05.383123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:05.386137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:05.414459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.415355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.416008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.418535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:05.420343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:05.421001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:05.503312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9276207e-f0ee-442b-8e3f-14075bca20e8 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124065 Aug 30 18:37:05.504264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2236/4348] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:05 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:37:05.844242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:05.859246 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e294d9e0-7b8b-4298-bd1e-5b84beebdefc tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.806300 Aug 30 18:37:05.864485 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2113/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:05 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:06.398865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:06.399937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:06.440383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.440871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.441328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:06.442026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.443311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.445278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:06.520281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:06.523506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:06.543650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.545590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.546759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:06.548881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.550970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.553309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:06.640314 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-358e01c8-6ce8-47be-8eec-70c657d7e64a tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127008 Aug 30 18:37:06.645132 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2114/4350] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:37:06 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:37:06.675834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:06.688978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7892da3c-0fdf-49d6-a9f1-c0f86836cf7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.299415 Aug 30 18:37:06.707014 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2237/4351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:06 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:06.885190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:06.886226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:06.907121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.909363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.914985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:06.916118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:06.917399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:06.918022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:07.050622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-858333230", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "4bca1d32-355c-48e5-b94e-cc7545c38319"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:07.147586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] validate_networks() for [('4bca1d32-355c-48e5-b94e-cc7545c38319', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:37:07.447268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:07.468453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13130652-1fa6-454a-afca-578ecb363c31 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.583007 Aug 30 18:37:07.471675 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2115/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:06 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:07.734388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:07.736473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:07.751886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:07.752657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:07.753333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:07.755299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:07.756085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:07.756672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:07.944545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:07.969495 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af00d900-421e-4e08-8fee-fcd673515dc9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.256185 Aug 30 18:37:07.982382 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2116/4353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:07 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:08.494199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:08.495148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:08.509544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:08.510050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:08.510523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:08.519518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:08.520048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:08.522051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:09.044761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:09.059914 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-876ab707-ab75-4f58-ba13-f80e52c5de73 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 0.569674 Aug 30 18:37:09.066436 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2117/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:08 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:09.087916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:09.089749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:09.107601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:09.108105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:09.119218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:09.121229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:09.121728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:09.122177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:09.298946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:37:09.299483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:37:09.300108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:37:09.300584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:37:09.301662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:37:09.311846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:09.350468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:09.354737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:09.359604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:09.362433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:09.363332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:09.364233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:09.412470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:09.438522 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-289e5c2e-ee8f-417b-95ff-aad2a0204be0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.369288 Aug 30 18:37:09.441764 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2118/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:09 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:09.447747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for project fca43827ad114d019e3a90c18faa9651. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:37:09.470268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Getting quotas for user faee7d75430f4606bd909bae8a22e11d and project fca43827ad114d019e3a90c18faa9651. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:37:09.511223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:37:09.516655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:37:09.677035 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7845be80-8f08-4fda-92c7-c3a2ca64e179 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.630250 Aug 30 18:37:09.682646 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2238/4356] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:37:09.699812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd692243-5c1e-43ed-9b94-4c0c9c75d4a9 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:09.701385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd692243-5c1e-43ed-9b94-4c0c9c75d4a9 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:09.997601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd692243-5c1e-43ed-9b94-4c0c9c75d4a9 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:10.012438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd692243-5c1e-43ed-9b94-4c0c9c75d4a9 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1217 microversion: 2.1 time: 0.319479 Aug 30 18:37:10.014882 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2119/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:09 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:10.092595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:10.093628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:10.112479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:10.119175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:10.120066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:10.123402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:10.125244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:10.130835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:10.463921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:10.465365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:10.491367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:10.497380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:10.500640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:10.507059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:10.508716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:10.510659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:10.809370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:10.825916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1db1a31-ad98-4a0b-8c48-3a3f97083e48 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.367798 Aug 30 18:37:10.830054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2120/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:10 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:11.044207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:11.044864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:11.072076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:11.072948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:11.075158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:11.078931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:11.079959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:11.082063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:11.338801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:11.358081 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2a5bdf9-ea49-4398-ac9b-bb3e07aad185 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1213 microversion: 2.1 time: 0.317816 Aug 30 18:37:11.359584 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2121/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:11 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1213 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:11.830682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:11.848207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9568369-97dd-4cde-b504-06774dfa8aa8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 1.756942 Aug 30 18:37:11.849411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:11.850110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2239/4360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:10 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:11.850851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:11.862097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:11.868481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:11.870757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:11.874041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:11.875620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:11.882395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:11.891688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:12.087433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:12.105333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff0b3b83-9782-4efc-ab51-b550954e68a4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.259995 Aug 30 18:37:12.117426 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2122/4361] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:11 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:12.384510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:12.385153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:12.398738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:12.410793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:12.411482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:12.422577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:12.422577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:12.422577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:12.625514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:12.638296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6dda13f0-66ea-4885-b895-9677285d20f0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1287 microversion: 2.1 time: 0.259203 Aug 30 18:37:12.638924 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2240/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:12 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:12.896069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:12.898261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:12.918830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:12.921656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:12.922592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:12.924322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:12.926092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:12.933883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:13.140769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:13.141564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:13.152427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:13.157094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:13.159593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:13.162076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:13.167266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:13.168172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:13.425527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:13.475187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c597cfaa-4190-4246-9240-1009bf337ada tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.340964 Aug 30 18:37:13.484296 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2241/4363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:13 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:13.665633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:13.666631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:13.697492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:13.702471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:13.708194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:13.709617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:13.712624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:13.713287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:13.951015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:13.979929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:13.987843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fe48cf5-a3de-4cd2-86f4-ecd227a089aa tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1678 microversion: 2.1 time: 1.098482 Aug 30 18:37:13.989651 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-409163de-b7f3-4828-bba8-2e8145b07e5b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1275 microversion: 2.1 time: 0.330697 Aug 30 18:37:13.997049 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2242/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:13 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1275 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:14.023649 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2123/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:12 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1678 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:14.505262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:14.506928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:14.521511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:14.522333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:14.523094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:14.527833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:14.529458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:14.530094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:14.685300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:14.699985 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac71d557-7653-4e43-be61-2523f5affd7d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 200 len: 1186 microversion: 2.1 time: 0.198599 Aug 30 18:37:14.703227 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2243/4366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:14 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 1186 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:15.021335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:15.022173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:15.033034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:15.033824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:15.054759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.057150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.057694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.060018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.062980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.063767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.064498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.065219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.066371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.072908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.073854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.074880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.633103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:15.645917 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-973b440a-da34-4b47-b60c-7a2e36a5dd1a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1655 microversion: 2.1 time: 0.617834 Aug 30 18:37:15.651195 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2244/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:15 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1655 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:15.671729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:15.690858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.691250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.691687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.774666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Going to try to start instance {{(pid=122589) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:37:15.881816 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7af36d80-4cd3-46a7-90c3-0d85e484bbcd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.213984 Aug 30 18:37:15.882775 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2245/4368] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:15 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:15.890812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:15.899637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 61b64793-1548-4fb5-8741-56f055f3ec6f] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:15.908198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.913874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.914766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.916085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:15.918288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:15.919247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:15.976361 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f HTTP/1.1 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '61b64793-1548-4fb5-8741-56f055f3ec6f'} Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:15.979743 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. Aug 30 18:37:15.985004 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:15.988271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 61b64793-1548-4fb5-8741-56f055f3ec6f could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:15.995710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47cc19f5-fdbf-4298-801e-0cdb147a8842 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f" status: 404 len: 111 microversion: 2.1 time: 0.111458 Aug 30 18:37:16.002937 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2246/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:15 2022] GET /compute/v2.1/servers/61b64793-1548-4fb5-8741-56f055f3ec6f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:16.022843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:16.023701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:16.031740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:16.032541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:16.033144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:16.034020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:16.034671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:16.035577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:16.290861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:16.299752 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-754e753a-54c7-49d9-aa24-7717180cffef tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 1.283282 Aug 30 18:37:16.304523 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2124/4370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:15 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:17.039217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-195344065", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:17.147872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] validate_networks() for [('6ea6885d-b0da-4db6-9332-706da66697de', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:37:17.675801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:17.678561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:17.689533 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc7c881f-0215-408f-86db-e946141ae60b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1664 microversion: 2.1 time: 1.683007 Aug 30 18:37:17.692421 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2247/4371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:16 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1664 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:17.710271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:17.710941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:17.742657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:17.754796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:17.755267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:17.756043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:17.758093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:17.758674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.418643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:37:18.418643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:37:18.419243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:37:18.419412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:37:18.419824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:37:18.433353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:18.433845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:18.434281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.449804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:18.450421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:18.450881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.532888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:37:18.545037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for user faf78635374746d793bae244e2a28989 and project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:37:18.565683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:18.575209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55482232-5164-42e6-ab3e-94cea903b417 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 0.881423 Aug 30 18:37:18.575803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2248/4372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:17 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:18.581557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:37:18.584370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:37:18.597812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397", "tag": "b86187be-79d4-4329-b12e-2fa109a76bca"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:18.639525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:18.649545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:18.655091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.663922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7145704f-8988-47a5-b6c1-1a1a295f726b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.936455 Aug 30 18:37:18.666945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2125/4373] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:37:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:37:18.683807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe78ab11-9a6b-46ba-a5d5-b6dc77a668e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:18.685661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe78ab11-9a6b-46ba-a5d5-b6dc77a668e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:18.720600 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] Creating event network-changed:b86187be-79d4-4329-b12e-2fa109a76bca for instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 on n-h1-854119-10 Aug 30 18:37:18.750213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3e69310f-7e80-41b2-a927-3069480812eb req-6d12da2b-63f6-442e-822b-5a34bc3ad7e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164286 Aug 30 18:37:18.750911 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2249/4374] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:18.783565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:18.784286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:18.817550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:18.818057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:18.818532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.819255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:18.819715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:18.820147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:18.897232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fe78ab11-9a6b-46ba-a5d5-b6dc77a668e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:18.909975 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe78ab11-9a6b-46ba-a5d5-b6dc77a668e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1221 microversion: 2.1 time: 0.235234 Aug 30 18:37:18.911752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2126/4375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:18 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:19.042385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-979803357", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:19.138971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] validate_networks() for [('6ea6885d-b0da-4db6-9332-706da66697de', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:37:19.431724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:19.497436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:20.363572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:37:20.363572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:37:20.363572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:37:20.363572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:37:20.363572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:37:20.378956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:20.379897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:20.380617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:20.391161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:20.391946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:20.392658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:20.426993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:37:20.439997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for user faf78635374746d793bae244e2a28989 and project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:37:20.477220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:37:20.482701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:37:20.581333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-455cb1a1-6c17-4e7a-b844-de266620cf40 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.545175 Aug 30 18:37:20.593450 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2127/4376] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:37:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:37:20.602473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:20.604681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:20.622402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:20.622935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:20.623445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:20.625856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:20.626434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:20.628850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:20.921133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:20.936217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c2a4f00-6953-476f-8e7c-43c1c1553885 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1664 microversion: 2.1 time: 2.167534 Aug 30 18:37:20.943422 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2250/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:18 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1664 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:20.948620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8293c82c-3942-4094-a7a5-6220e4834b68 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:20.967255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8293c82c-3942-4094-a7a5-6220e4834b68 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:21.035344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:21.044169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f1fc605-7f6d-42e5-b038-996bcba193bb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 0.455137 Aug 30 18:37:21.049325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2128/4378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:20 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:21.455839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8293c82c-3942-4094-a7a5-6220e4834b68 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:21.470132 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8293c82c-3942-4094-a7a5-6220e4834b68 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1221 microversion: 2.1 time: 0.518898 Aug 30 18:37:21.488486 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2251/4379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:20 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1221 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:21.965693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:21.966301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:22.011523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.012166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.012619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.013375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.013828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.014252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.069314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:22.070573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:22.084105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.090608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.091369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.096016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.096804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.097481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.283292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:22.300766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2046de1b-a3dd-4b22-9c64-08ad5fabdd4c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.339421 Aug 30 18:37:22.302116 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2129/4380] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:21 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:22.325064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:22.325665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:22.338451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.339007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.339462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.340204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.340854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.343294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.635420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:22.654397 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f37cdb32-4928-4854-824e-b17ed8a6ea6d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.333388 Aug 30 18:37:22.657217 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2130/4381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:22 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:22.670297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:22.679820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:22.707614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.708419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.709019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.714704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.715586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.720291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.841255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:22.852101 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-440ad5f4-fab6-4a6c-84ee-f91555f2e83a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1273 microversion: 2.1 time: 0.192194 Aug 30 18:37:22.853036 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2131/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:22 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:22.859710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:22.860559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:22.877742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.878670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.879372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:22.880445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:22.881127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:22.881968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:23.151534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:23.165294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14db0caa-d1bf-4ef1-aa0c-660356a769bd tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.309754 Aug 30 18:37:23.165942 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2132/4383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:22 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:23.192792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:23.194181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:23.208479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:23.209980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:23.213580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:23.217334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:23.218747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:23.220298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:23.870674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:23.894151 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e0c7034-ce23-451a-9900-cf80fed3cc0a tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.707978 Aug 30 18:37:23.899984 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2133/4384] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:23 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:23.915150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:23.924990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:23.929491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:23.960640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:23.960975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:23.961670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:23.962328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:23.965256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:23.975609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:24.245613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:24.262099 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a897556e-130f-4c42-95c2-1f36c2afdd07 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1279 microversion: 2.1 time: 0.360482 Aug 30 18:37:24.265775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2134/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:23 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1279 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:24.298511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:24.299624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:24.329917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:24.331765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:24.341840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:24.347691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:24.348204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:24.348664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:24.870044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:24.886038 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83f92923-54eb-4d28-9720-5d755ed1597c tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 2.821194 Aug 30 18:37:24.891211 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2252/4386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:22 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 2827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:25.291667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:25.292536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:25.319721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:25.328167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.333188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.333935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.335002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.339306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-011cc6c9-37a4-416d-8793-25f6c33c8e15 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 1.066593 Aug 30 18:37:25.339837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.340179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2135/4387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:24 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:25.342962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.366012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:25.366743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:25.376881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.391781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.395570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.396677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.397393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.398084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.465610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lazy-loading 'flavor' on Instance uuid 1e0cecb6-76aa-45e1-9508-81b2e4022a05 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:25.627838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dc012049-477e-4497-b298-512ac518507c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.264375 Aug 30 18:37:25.634280 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2136/4388] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:25 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:37:25.647525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:25.649668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:25.669053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.671511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.672644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.676615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.678477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.679137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.737104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:25.753896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e80ad94-030b-4def-8c17-f8cb3a7cadef tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1279 microversion: 2.1 time: 0.465705 Aug 30 18:37:25.757133 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2253/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:25 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1279 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:25.910985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:25.912356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:25.929662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.931005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.931709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:25.932640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:25.933659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:25.934271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:26.221765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:26.248672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f795396-c709-4e56-9662-961a8327449c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1676 microversion: 2.1 time: 0.610277 Aug 30 18:37:26.260508 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2137/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:25 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1676 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:26.781435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:26.782076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:26.797396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:26.799202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:26.802371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:26.803276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:26.805744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:26.806638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:26.821136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:26.835963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e484f511-82a0-4655-b361-1a11d0b59fb7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 0.923333 Aug 30 18:37:26.837436 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2254/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:25 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:27.092934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1705141153", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2359b29f-f12e-4223-b935-4487aa6d0531", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:27.206655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:27.216622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52d4d84f-885e-4531-b989-671c1d5265fe tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1279 microversion: 2.1 time: 0.442587 Aug 30 18:37:27.219860 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2138/4392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:26 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1279 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:27.240008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:37:27.274787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:27.275693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:27.287198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:27.291574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:27.292310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:27.293261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:27.293883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:27.294773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:27.337466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:27.734033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:27.758209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7b1bf52-e5ee-49bc-90dd-189fa1088d7e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1659 microversion: 2.1 time: 0.487796 Aug 30 18:37:27.760832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2139/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:27 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1659 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:27.779200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397", "name": "network-vif-plugged", "status": "completed", "tag": "b86187be-79d4-4329-b12e-2fa109a76bca"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:27.813254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:27.818858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:27.819319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:27.851437 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] Creating event network-vif-plugged:b86187be-79d4-4329-b12e-2fa109a76bca for instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 on n-h1-854119-10 Aug 30 18:37:27.921964 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ac1c57bb-8d65-4b67-86e1-89025fd5428c req-2fd5706b-a32c-4eaa-833f-964c67fc9045 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109691 Aug 30 18:37:27.922702 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2140/4394] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:27.983472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:27.984455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:28.014085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:28.014646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:28.015093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:28.017169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:28.017911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:28.018369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:28.169590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9ee4a14-88af-4430-9507-9224d2a6c26f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action" status: 202 len: 0 microversion: 2.1 time: 0.225782 Aug 30 18:37:28.192570 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2141/4395] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:27 2022] POST /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:28.243751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:28.247482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:28.284883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:28.290335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:28.292898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:28.297495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:28.300047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:28.317511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:28.966172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:28.993471 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e91fdffd-4a27-4e0d-a8d1-d7af5647dffe tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1317 microversion: 2.1 time: 0.798114 Aug 30 18:37:29.010759 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2142/4396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:28 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:29.010759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:29.010759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:29.040156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:29.040760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:29.042497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:29.046486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:29.047079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:29.047599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:29.601464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:29.615852 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec3f7200-8a83-479f-bc01-a9aca160cd99 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1665 microversion: 2.1 time: 0.610468 Aug 30 18:37:29.616551 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2143/4397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:29 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1665 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:29.631848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:29.634131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:29.664495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:29.665907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:29.666986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:29.668208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:29.668890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:29.669572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:30.109623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:30.121904 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd8bca80-2964-4129-8087-300f000496c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.503311 Aug 30 18:37:30.122508 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2144/4398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:29 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:30.139042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:30.140103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:30.175826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:30.175826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:30.181157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:30.185439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:30.185994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:30.192757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:30.407730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:30.456465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:30.541412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:30.549335 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4084400c-5a9a-4807-9122-a58bcedc3e0d tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1507 microversion: 2.1 time: 0.425776 Aug 30 18:37:30.563148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2145/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:30 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:30.638157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:30.638906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:30.647521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:30.650879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:30.651368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:30.654671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:30.655375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:30.655999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:31.166844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:37:31.167414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:37:31.167730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:37:31.168146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:37:31.168562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:37:31.190456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:31.191021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:31.195450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:31.197052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:31.197777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:31.198220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:31.243997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:37:31.259179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:37:31.422951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:37:31.425564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2359b29f-f12e-4223-b935-4487aa6d0531',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:37:31.691475 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9742113-80d3-45fa-8d81-e8f557539861 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.602374 Aug 30 18:37:31.692751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2255/4400] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:37:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:37:31.700003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:31.700914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:31.711938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:31.712703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:31.713351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:31.714320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:31.717419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:31.718082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:31.957184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:31.965493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c44a76b0-ea75-433a-84fe-f9d5f6251daf tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1665 microversion: 2.1 time: 1.332235 Aug 30 18:37:31.969311 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2146/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:30 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1665 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:31.980820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4e5e21-d569-437d-85ba-fad1bd3361ae", "tag": "f0e33be1-d398-4b97-a493-bed5d7d1d4d2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:32.006276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:32.006798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:32.007242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:32.033255 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] Creating event network-changed:f0e33be1-d398-4b97-a493-bed5d7d1d4d2 for instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae on n-h2-854119-10 Aug 30 18:37:32.047625 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4d49b915-5dad-4748-a17e-6d6a8f545a84 req-471d33ce-b1bc-4d2c-99d8-563ee183b639 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076184 Aug 30 18:37:32.052240 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2147/4402] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:32.063104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f258e7c-bc4f-4af9-8dfa-767da7fc882b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:32.070863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f258e7c-bc4f-4af9-8dfa-767da7fc882b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:32.214634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0f258e7c-bc4f-4af9-8dfa-767da7fc882b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:32.238286 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f258e7c-bc4f-4af9-8dfa-767da7fc882b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1057 microversion: 2.1 time: 0.180689 Aug 30 18:37:32.241201 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2148/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:32 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1057 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:32.601353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317146d4-d1ed-4da8-8434-3775abed3953", "tag": "cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:32.644395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:32.650786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:32.652230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:32.692431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] Creating event network-changed:cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150 for instance 317146d4-d1ed-4da8-8434-3775abed3953 on n-h2-854119-10 Aug 30 18:37:32.714214 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4114162a-7e0d-4fa2-89ab-ae75fa0b8d46 req-004d4786-bcfc-4cac-945c-ce7674a9057c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117133 Aug 30 18:37:32.722286 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2149/4404] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:37:32.998295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:32.999051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:33.012257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.012999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.017065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.018041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.018799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.019399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.278762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:33.289971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d1c9fb6-3941-4161-bb69-3274cb7b8433 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 1.595845 Aug 30 18:37:33.291551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2256/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:31 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:33.297292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "678bd5f8-cdbd-415a-9acd-8555554db9bb"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:33.300888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:33.310258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.311226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.311886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.313088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.313759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.314429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.396885 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] HTTP exception thrown: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Request method failure captured: Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397/os-volume_attachments/1fb7d700-b561-423e-a4e3-a9f67bb3f9bd HTTP/1.1 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 74 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlhguYwfmnH15v1QP05rl4e8smn4DhLaw66m8BfPfixXCbSREckujqdHqqxflYXA1BnjSSaEe-yKAxYV8I6ccW5VATVT0hCUXe-hvFXHahqRqvNtDf39vIT9qqy8VgWQu-wFa-jx6SKy4kFEsw86XcF6glcrEts_ZlmCQ0KGynIIRNE Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 406c1c17a5564b1d80809f056abbf708 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/406c1c17a5564b1d80809f056abbf708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_406c1c17a5564b1d80809f056abbf708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 406c1c17a5564b1d80809f056abbf708 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-305814444 Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesAdminNegativeTest-305814444-project-admin Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 5d7dfcefb08d439ea6d68f10b212968c Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesAdminNegativeTest-305814444-project-admin Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: {"volumeAttachment": {"volumeId": "678bd5f8-cdbd-415a-9acd-8555554db9bb"}} Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: exception: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': 'd7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397', 'id': '1fb7d700-b561-423e-a4e3-a9f67bb3f9bd', 'body': {'volumeAttachment': {'volumeId': '678bd5f8-cdbd-415a-9acd-8555554db9bb'}}} Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. (HTTP 404) (Request-ID: req-0c5adb42-92f0-4e43-bf6f-c73b1bbdc4fd) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:37:33.399783 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. Aug 30 18:37:33.404246 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:33.410963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] Returning 404 to user: Volume 1fb7d700-b561-423e-a4e3-a9f67bb3f9bd could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:33.412097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b92d1d5-49da-41f7-b5ca-53b7126c0687 tempest-VolumesAdminNegativeTest-305814444 tempest-VolumesAdminNegativeTest-305814444-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397/os-volume_attachments/1fb7d700-b561-423e-a4e3-a9f67bb3f9bd" status: 404 len: 109 microversion: 2.1 time: 0.118766 Aug 30 18:37:33.412908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2257/4406] 10.222.0.25 () {60 vars in 1433 bytes} [Tue Aug 30 18:37:33 2022] PUT /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397/os-volume_attachments/1fb7d700-b561-423e-a4e3-a9f67bb3f9bd => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:33.418719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:33.441954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:33.454957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.457314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.458027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.460210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.460954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.463758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.633614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:33.651561 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04d998ed-40e5-44a1-b4e5-6de0e1846f53 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.659269 Aug 30 18:37:33.659268 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2150/4407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:32 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:33.678463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:33.679436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:33.694383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.694888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.695416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.696406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:33.702086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:33.702596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:33.751614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:33.767496 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5ca4c88-6a86-42ef-a11f-659761486664 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1155 microversion: 2.1 time: 0.353131 Aug 30 18:37:33.772262 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2258/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:33 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1155 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:34.312740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:34.314195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:34.326429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.327278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.327897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:34.328791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.333281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.334193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:34.489572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:34.508083 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2af52352-d2f0-4445-8b24-2916d35537c7 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1668 microversion: 2.1 time: 0.832005 Aug 30 18:37:34.510642 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2151/4409] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:33 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1668 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:34.536771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:34.537632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:34.549363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.550707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.552376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:34.554589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.558158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.558855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:34.625560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:34.638969 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Working on deleting snapshot 608ccae7-a73f-4c5a-af7f-beb8917f8357 from shelved instance... Aug 30 18:37:34.881713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:34.893565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1877739-321d-4d22-94d5-2a508a3c5bbc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.585076 Aug 30 18:37:34.898795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2259/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:34 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:34.919954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:34.931516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:34.947824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.950326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.950965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:34.953679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:34.954556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:34.955308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.238131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:35.250128 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f7c9fff1-28a8-4838-b8cc-3f4dda038de7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1173 microversion: 2.1 time: 0.349441 Aug 30 18:37:35.274757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2260/4411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:34 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1173 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:35.293030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:35.293336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:35.299770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:35.300273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:35.300712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.301778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:35.302451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:35.303043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.380957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:35.585206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a24e8cbc-27f1-4dde-83d0-6e2fa038967a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 204 len: 0 microversion: 2.1 time: 0.307619 Aug 30 18:37:35.588657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2261/4412] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:35 2022] DELETE /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:35.604260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:35.607625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:35.626013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:35.628257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:35.628778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.629544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:35.630017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:35.633109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.896878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Doing local delete in cell 19fe4607-648e-4217-8aee-38dd51fd27c3(cell1) {{(pid=122590) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 18:37:35.901572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:35.902868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:35.903605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:35.904365 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 18:37:35.909724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] deallocate_for_instance() {{(pid=122590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 18:37:36.028530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:36.042256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d18b6a18-a10a-4cb7-9c8f-eee9b52062c3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1554 microversion: 2.1 time: 0.447376 Aug 30 18:37:36.054467 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2262/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:35 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1554 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:36.054467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:36.054914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:36.092277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:36.093132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:36.093798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:36.094773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:36.095510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:36.096149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:36.329851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:36.344031 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b31f6114-482f-48b9-9e09-422bbc4ec780 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.299875 Aug 30 18:37:36.357348 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2263/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:36 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:36.357348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:36.357348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:36.378995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:36.379517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:36.379971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:36.380714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:36.381193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:36.381803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:36.580184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:36.598622 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7cc9b08e-053b-4368-94a5-4a206d01e651 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1173 microversion: 2.1 time: 0.251963 Aug 30 18:37:36.599411 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2264/4415] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:36 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1173 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:37.068722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:37.069428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:37.079850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:37.085043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:37.086631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:37.087922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:37.090737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:37.093216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:37.165132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:39.291022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Updating instance_info_cache with network_info: [] {{(pid=122590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:37:39.777954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:39.867321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64146105-08a9-42de-94a5-e5ed035767d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 204 len: 0 microversion: 2.1 time: 5.334352 Aug 30 18:37:39.869104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2152/4416] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:34 2022] DELETE /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 0 bytes in 5338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:37:39.886529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:39.893987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:39.912151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:39.912933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:39.914119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:39.918567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:39.922748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:39.932784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:39.937933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:39.939846 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d9dc5fe-04c4-437e-a138-bfd20793a200 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 200 len: 1554 microversion: 2.1 time: 2.871425 Aug 30 18:37:39.946232 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2265/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:37 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 1554 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:39.966528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:39.968410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:39.991450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:39.997034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:40.004075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:40.006564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:40.008617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:40.011380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:40.016118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.034678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:41.061466 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c125dc27-0e7e-4445-bf9a-653f8caec908 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1215 microversion: 2.1 time: 1.113463 Aug 30 18:37:41.069155 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2266/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:39 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1215 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:41.086991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:41.091279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:41.117982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.119299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.121097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.123157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.124511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.126595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.190080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:41.279396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:41.308988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:41.405666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:41.415940 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d06bb3cb-a67c-4cf5-8209-6a130e0d5aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 1.544418 Aug 30 18:37:41.416547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2153/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:39 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:41.417301 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ebdc912-106d-4b57-95b2-d62996c54e55 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 204 len: 0 microversion: 2.1 time: 0.344226 Aug 30 18:37:41.427355 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2267/4420] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:41 2022] DELETE /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:41.445864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2188eb-9f9e-4129-8227-9ae7ae7604cd", "name": "network-vif-deleted", "tag": "cd0d17cf-ae67-4bd1-8e9f-26fd80a5892a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:41.455069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:41.455581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 0f2188eb-9f9e-4129-8227-9ae7ae7604cd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:41.474671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.478734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.479258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.480341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.480831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.481270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.497977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.498608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.499065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.524525 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd HTTP/1.1 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '0f2188eb-9f9e-4129-8227-9ae7ae7604cd'} Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:41.528449 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.533319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 404 to user: Instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:41.533951 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc7378f5-b6b1-472b-b0b3-5fce57066544 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd" status: 404 len: 111 microversion: 2.1 time: 0.103815 Aug 30 18:37:41.535487 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2268/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:41 2022] GET /compute/v2.1/servers/0f2188eb-9f9e-4129-8227-9ae7ae7604cd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:41.548651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_external_events [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] Unable to find a host for instance 0f2188eb-9f9e-4129-8227-9ae7ae7604cd. Dropping event network-vif-deleted {{(pid=122590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:37:41.549546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ec656a2b-368e-467a-9ac0-5fa146ae2185 req-c9643718-6194-4a08-900b-89cec9e63baa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.107900 Aug 30 18:37:41.550156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2154/4422] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 133 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:37:41.555388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0", "name": "network-vif-deleted", "tag": "5690cdad-7f71-4e21-bca3-f9cb394d246a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:41.559491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e5e21-d569-437d-85ba-fad1bd3361ae", "name": "network-vif-plugged", "status": "completed", "tag": "f0e33be1-d398-4b97-a493-bed5d7d1d4d2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:41.576191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.577011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.577780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.607948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.608442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.608882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.610103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] Creating event network-vif-deleted:5690cdad-7f71-4e21-bca3-f9cb394d246a for instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 on n-h2-854119-10 Aug 30 18:37:41.623769 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cc7a50f4-dd55-46e4-9009-6dd8deed8342 req-8aa7b81f-5496-4a1c-90b1-fcb299813bfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084935 Aug 30 18:37:41.628149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2269/4423] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:41.640614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:41.658330 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] Creating event network-vif-plugged:f0e33be1-d398-4b97-a493-bed5d7d1d4d2 for instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae on n-h2-854119-10 Aug 30 18:37:41.673861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:41.687093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7ba0c707-dca0-4690-af32-6bb4a2b39f90 req-58d1c7fb-947e-429c-8b40-e8f8672a1251 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131155 Aug 30 18:37:41.688147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2155/4424] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:41.696906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:41.697856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:41.705144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.705908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.706656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.708275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.709048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.709828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.722382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.727536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.729030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.730696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.735706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.736192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.776870 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] HTTP exception thrown: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Request method failure captured: Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 HTTP/1.1 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlhHgBVmewj5PXPm21iDIJR3DckJgqywwh8kFT-SOlj0MdSXFrBSBjqnOEAfNCFPdSz6V2-ysU69osHO-0UfOMVbgo-heW2QRO6J4sZCfKH4uYpUqGQhnaEdIRS3ZC-2sa9gxIgaDWrjC57m0SYOpPqaMTIgOgA-E5Kf6EtkYSmuIGE Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3aff2cb00a51480bbdce8ebebd9c3b59 Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0'} Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:41.782154 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Returning 404 to user: Instance f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-12c91f86-de34-453a-9411-5f87fc801742 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0" status: 404 len: 111 microversion: 2.1 time: 0.156642 Aug 30 18:37:41.789339 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2270/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:41 2022] GET /compute/v2.1/servers/f7eeb7c7-7fd1-4f5a-9d5f-dfc1d874b0c0 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:41.801953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:41.802523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:41.817033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.817549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.818002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.818771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:41.819237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:41.830568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:41.895104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:42.056386 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-000479f2-c9e5-4c9d-9688-2299c25ab4ce tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 204 len: 0 microversion: 2.1 time: 0.266337 Aug 30 18:37:42.062387 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2271/4426] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:41 2022] DELETE /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:42.074567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:42.077833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:42.112682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:42.113215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:42.114899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:42.115687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:42.116164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:42.116597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:42.227702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:42.553592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:42.564502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f83e481e-72ea-4b7f-a66a-aec90a79b51b tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1513 microversion: 2.1 time: 0.874877 Aug 30 18:37:42.586246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2156/4427] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:41 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1513 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:42.599743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:42.600376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:42.625844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:42.626902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:42.629030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:42.631119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:42.633208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:42.634927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.073481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:43.102181 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-123d7075-9755-46a1-af5d-0515dbaf689f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1215 microversion: 2.1 time: 0.512119 Aug 30 18:37:43.103309 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2157/4428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:42 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1215 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:43.112730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:43.115030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:43.134676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:43.135354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:43.135815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.136534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:43.136984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:43.137420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.368151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:43.381053 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4fe454f-1426-4dda-b2f8-a8bb0d469bcd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.276434 Aug 30 18:37:43.384681 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2158/4429] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:43 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:43.478017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:43.490589 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cfea65fa-5c25-4016-ac91-edd7603732df tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1466 microversion: 2.1 time: 1.426609 Aug 30 18:37:43.491177 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2272/4430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:42 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1466 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:43.596557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:43.601414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:43.617176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:43.626575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:43.627509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.628688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:43.630764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:43.631508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.686137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4191a9c-552a-457a-a486-46887c55fd4a", "tag": "b6f71c7b-da86-4ce4-8324-5e0f2212dba2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:43.717658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:43.720657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:43.721293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:43.751505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] Creating event network-changed:b6f71c7b-da86-4ce4-8324-5e0f2212dba2 for instance e4191a9c-552a-457a-a486-46887c55fd4a on n-h1-854119-10 Aug 30 18:37:43.761534 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d2d10054-37c7-434a-ba98-b6a78e71bb74 req-63eeae02-0f52-411f-a5f0-e3cafdb3e366 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079556 Aug 30 18:37:43.765495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2273/4431] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:43.781596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c69a34d4-f1eb-4b24-8b94-ffb049b7f8e0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '.version_select at 0x7f4e55aec550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:43.824081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c69a34d4-f1eb-4b24-8b94-ffb049b7f8e0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1346662935" status: 202 len: 0 microversion: 2.1 time: 0.047484 Aug 30 18:37:43.825862 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2274/4432] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:37:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1346662935 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:43.862379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:43.881466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f95883f-d2f7-435b-ab52-3d64d2a02f71 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1513 microversion: 2.1 time: 0.295963 Aug 30 18:37:43.888791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2159/4433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:43 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:44.128302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:44.129358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:44.142383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:44.145579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:44.149706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:44.150871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:44.151564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:44.152176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:44.322321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317146d4-d1ed-4da8-8434-3775abed3953", "name": "network-vif-plugged", "status": "completed", "tag": "cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:44.347330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:44.354209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:44.355123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:44.382934 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] Creating event network-vif-plugged:cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150 for instance 317146d4-d1ed-4da8-8434-3775abed3953 on n-h2-854119-10 Aug 30 18:37:44.396203 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-71384266-0af9-4052-bc82-5650de726e9c req-fd13e12c-a69e-42ec-863d-bd07474aa670 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077804 Aug 30 18:37:44.405605 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2160/4434] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:37:44.412428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:44.413512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:44.429348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:44.430304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:44.431106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:44.432142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:44.432839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:44.433499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:45.140752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:45.167231 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d442e014-4483-4b07-b907-3f3e83ba58e9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.758954 Aug 30 18:37:45.169145 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2161/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:44 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:45.175469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:45.176594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:45.188412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:45.189131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:45.189872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:45.190975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:45.192197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:45.192744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:45.214270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:45.230942 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6a0a3a7a-977a-40a1-b96a-806ef4b0b8c5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1215 microversion: 2.1 time: 1.107078 Aug 30 18:37:45.234975 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2275/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:44 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1215 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:45.252923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:45.253558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:45.270841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:45.271440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:45.271935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:45.272709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:45.273267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:45.273876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:45.821763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:45.836022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9ca67a4-de71-4e10-8bdc-6a6dde659467 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1466 microversion: 2.1 time: 0.665164 Aug 30 18:37:45.837380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2162/4437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:45 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1466 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:46.028209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:46.043640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac4931c2-7e96-4c63-886c-af3d9aa391fd tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1513 microversion: 2.1 time: 0.807270 Aug 30 18:37:46.045284 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2276/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:45 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1513 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:46.191095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:46.191713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:46.202025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:46.203619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:46.204140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:46.205566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:46.206120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:46.206646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:46.254788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:46.255406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:46.274430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:46.274930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:46.275367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:46.276084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:46.276534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:46.276955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:46.844477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:46.866300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7990b92-eee4-4b6a-b65b-6a54c1a6eda0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1321 microversion: 2.1 time: 0.670174 Aug 30 18:37:46.881873 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2163/4439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:46 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1321 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:46.889030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf", "name": "network-vif-deleted", "tag": "8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:46.937916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:46.943309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:46.944040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:46.974673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] Creating event network-vif-deleted:8c64e7bf-e92d-4b5f-8f59-4fab32dcbfd1 for instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf on n-h1-854119-10 Aug 30 18:37:46.990238 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-53059966-44c1-4437-bae3-f6c4ec135007 req-a80c5184-7276-4c5f-8232-32205c819147 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106776 Aug 30 18:37:46.991173 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2164/4440] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:46.997796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:46.998774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:47.009069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.016216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.021882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.022941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.024333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.024966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.172946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.173484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.173943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.176997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lazy-loading 'fault' on Instance uuid 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:47.300634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:47.321671 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65ce8042-71d8-477e-9327-c37127e2f47b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 200 len: 1304 microversion: 2.1 time: 0.328832 Aug 30 18:37:47.322764 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2165/4441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:46 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 1304 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:47.341537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:47.342769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:47.355615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.356526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.357520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.358629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.361250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.362121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.476913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:47.488368 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d484ad7a-921b-46a8-98a3-639893bd4d30 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 200 len: 1302 microversion: 2.1 time: 0.164139 Aug 30 18:37:47.489786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2166/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:47 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:47.495500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397", "name": "network-vif-deleted", "tag": "b86187be-79d4-4329-b12e-2fa109a76bca"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:47.500178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:47.506451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.507248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.508200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.508915 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19da50c8-d558-4501-9c0a-e5252a389f6f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 1.259476 Aug 30 18:37:47.515184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2277/4443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:46 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:47.525907 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] Creating event network-vif-deleted:b86187be-79d4-4329-b12e-2fa109a76bca for instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 on n-h1-854119-10 Aug 30 18:37:47.531549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ad5bfdca-85fb-4974-b7b4-64bc7ac5d182 req-ef7acaf4-9137-4217-9ab7-01a07b26e020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040048 Aug 30 18:37:47.532456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2167/4444] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:47.896410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:47.897265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:47.916837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.918462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.919097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:47.920027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:47.921123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:47.921569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.346100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:48.346874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:48.356118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.356623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.357068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.357808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.358274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.358741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.409144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf HTTP/1.1 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf'} Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:48.412306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. Aug 30 18:37:48.417091 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.420806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 404 to user: Instance 3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:48.422072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc84dd0e-cef6-4142-a907-b7c0e4f0f580 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf" status: 404 len: 111 microversion: 2.1 time: 0.080972 Aug 30 18:37:48.422921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2168/4445] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:48 2022] GET /compute/v2.1/servers/3ae0803e-fdf1-4b3e-9f6d-0837415aa8bf => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:37:48.435916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:48.436843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:48.445064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.445987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.446744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.447846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.448592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.449358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.507141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:48.626120 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c40d0f8-999f-4f1b-b617-aa51401c58c4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 204 len: 0 microversion: 2.1 time: 0.197486 Aug 30 18:37:48.627295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2169/4446] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:48 2022] DELETE /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:48.636045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:48.636914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:48.646393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.646983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.647527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.648435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.649949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.650628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.675607 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] HTTP exception thrown: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Request method failure captured: Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 HTTP/1.1 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlhJ6fCkd3Gllj17pKgF_ADX_jfKzKZ9qwkUiu6hIwDVdKTFS-tstCJ5nyH0EKWcPDGp0Qy8SKPfOxj_d7UP5Fr3mHmAsUN8lfmSc6a5zXHqgFUKtKkCPu0QrBj4F4Oj7CfCu0eRdRkYpSm1pd-IS5wMTHdsAVPBBJ5C5XphKNHlZpw Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fca43827ad114d019e3a90c18faa9651 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fca43827ad114d019e3a90c18faa9651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fca43827ad114d019e3a90c18faa9651 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesAdminNegativeTest-860321259-project Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: faee7d75430f4606bd909bae8a22e11d Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesAdminNegativeTest-860321259-project Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'd7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397'} Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:48.678379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Returning 404 to user: Instance d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ce797f5d-6a9f-4156-96c1-142a7b05e8e0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397" status: 404 len: 111 microversion: 2.1 time: 0.051760 Aug 30 18:37:48.684756 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2170/4447] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:48 2022] GET /compute/v2.1/servers/d7c3bc2d-fc0a-4baf-b2e5-f3b5f8abe397 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:48.689740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:48.690384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:48.700579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.701096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.701723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.703709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.704194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.704626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.733356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:DELETE=2,nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:48.948970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:48.970569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-15d5bdc8-4600-49ca-b3c3-da07bce1e6c2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1516 microversion: 2.1 time: 1.076330 Aug 30 18:37:48.972647 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2278/4448] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:47 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1516 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:48.979121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:48.980465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:48.987952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.988744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.989411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:48.990498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:48.991227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:48.992169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.203824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:49.219207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9466c21b-d265-4414-8d39-12f36ee887d9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 0.535366 Aug 30 18:37:49.220002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2171/4449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:48 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:49.224888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:49.227392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:49.244550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.245052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.245486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.246198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.246672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.247093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.305471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'flavor' on Instance uuid 317146d4-d1ed-4da8-8434-3775abed3953 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:49.464386 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-468a34a7-ecca-4927-9740-16e9b99e2231 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action" status: 200 len: 32 microversion: 2.1 time: 0.243198 Aug 30 18:37:49.466846 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2172/4450] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:37:49 2022] POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:37:49.478656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:49.479401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:49.497204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.497696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.498133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.498882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:49.499336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:49.499763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:49.960934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:49.975814 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5f63cd58-aed3-4d75-ae3a-ab25bf8ff0d4 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1509 microversion: 2.1 time: 1.001741 Aug 30 18:37:49.990727 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2279/4451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:48 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1509 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:50.074635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:50.095485 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-320e1864-3687-4970-8099-95020055d3b8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.621444 Aug 30 18:37:50.098724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2173/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:49 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:50.249857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:50.250515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:50.262251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.262987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.263754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.274205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.275068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.277220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.510469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:50.511533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:50.542289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.543042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.543566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.544527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.545028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.545407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.616198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:50.631361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:50.641564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17623b1d-99a6-4b7d-a1cc-b42906f87c95 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 0.403845 Aug 30 18:37:50.659035 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2280/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:50 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:50.673094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec598cfa-1b07-45d7-aa96-e5dee4b10639", "tag": "2e674c95-760f-4bbc-8954-09c7c30a882c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:50.711226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.711704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.713018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.747610 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] Creating event network-changed:2e674c95-760f-4bbc-8954-09c7c30a882c for instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 on n-h1-854119-10 Aug 30 18:37:50.760068 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9f6348a4-0040-4b38-9d7e-3b8eaba1cc4f req-b6b5a227-0a19-4b1d-aa28-90e0bd7b672b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099350 Aug 30 18:37:50.761282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2281/4454] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:50.845860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:50.903605 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68cbe85f-1770-4c49-9379-b09578db6502 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 204 len: 0 microversion: 2.1 time: 0.399005 Aug 30 18:37:50.904465 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2174/4455] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:50 2022] DELETE /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:37:50.916372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:50.917617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:50.945648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.947258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.947729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:50.948716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:50.955637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:50.956329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.004479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:51.005500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:51.016302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.024812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.043930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.044732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.045217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.045656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.492852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:51.502989 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb9e884c-17b2-4329-b4c1-b7f676570868 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1668 microversion: 2.1 time: 0.593807 Aug 30 18:37:51.516238 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2282/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:50 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:51.531111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:51.531804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:51.548755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.549608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.550258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.551581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.552242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.552866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.614906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:51.815670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:51.826308 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0959d711-bb12-40b9-85c7-18b41944e1bb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1509 microversion: 2.1 time: 0.825987 Aug 30 18:37:51.828997 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2175/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:50 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1509 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:51.837896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:51.844445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:51.856943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.859151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.859821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.863256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:51.864237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:51.864894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:51.984235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:51.998788 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8adfe0c2-401b-464d-8a37-8f229c57e5ec tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.481034 Aug 30 18:37:52.000454 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2283/4458] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:51 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:52.530906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:52.531903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:52.548727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:52.549237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:52.549795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:52.550791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:52.551607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:52.556558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.009761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:53.022147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-77b5b3ae-47ed-4de2-95bb-2709c103db41 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1668 microversion: 2.1 time: 0.495386 Aug 30 18:37:53.023495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2284/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:52 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:53.053186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:53.054760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:53.069259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.071642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.072456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.076515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.077208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.077842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.145377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.146202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.146867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.147515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lazy-loading 'fault' on Instance uuid dec27802-f733-4bd8-b004-fe386ae5d8c7 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:53.175884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:53.190069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-11adf2cb-1828-4649-ae16-9fd91de76b0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 1.359611 Aug 30 18:37:53.206382 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2176/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:51 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:53.212502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec27802-f733-4bd8-b004-fe386ae5d8c7", "name": "network-vif-deleted", "tag": "c8c9a761-d336-482c-9d6e-fbeeefd4691b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:53.232205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.235504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.237899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.268548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:53.268800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] Creating event network-vif-deleted:c8c9a761-d336-482c-9d6e-fbeeefd4691b for instance dec27802-f733-4bd8-b004-fe386ae5d8c7 on n-h1-854119-10 Aug 30 18:37:53.282480 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-76f6c6b8-7148-4dcc-b99e-de9813a974ef req-c44f90fc-667b-4b80-9596-252e8dfaef46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083972 Aug 30 18:37:53.282480 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2177/4461] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:53.302530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:53.303150 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-de3964a0-da83-4290-b2a8-958e0cdacdac tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 200 len: 1305 microversion: 2.1 time: 0.276557 Aug 30 18:37:53.303292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:53.333304 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2285/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:53 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 1305 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:53.336109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.339603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.342287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.344490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:53.364664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:53.370408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:53.936297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:53.949231 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5911a460-e748-4b19-81d7-f8abd7a64df0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.665415 Aug 30 18:37:53.950159 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2178/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:53 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:54.049114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:54.049830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:54.071936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.072456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.072904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.078017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.078653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.079113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.219007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:54.222211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:54.241169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.242882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.244678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.249866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.251245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.252309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.340144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:54.371884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61029152-0d6d-463c-94aa-b83f8ffde950 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1550 microversion: 2.1 time: 0.326934 Aug 30 18:37:54.372693 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2286/4464] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:54 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1550 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:54.394384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:54.396035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: dec27802-f733-4bd8-b004-fe386ae5d8c7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:54.407158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.408086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.408952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.409938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.411826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.412804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.478896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 HTTP/1.1 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'dec27802-f733-4bd8-b004-fe386ae5d8c7'} Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:54.482008 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. Aug 30 18:37:54.489158 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:54.493009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 404 to user: Instance dec27802-f733-4bd8-b004-fe386ae5d8c7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:54.515575 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bb9283d-fef5-4e96-b33b-4bf17c46ee1c tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7" status: 404 len: 111 microversion: 2.1 time: 0.124621 Aug 30 18:37:54.516633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2287/4465] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:54 2022] GET /compute/v2.1/servers/dec27802-f733-4bd8-b004-fe386ae5d8c7 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:37:54.541049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:54.542121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:54.561702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.562471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.563168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.571802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:54.575143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:54.576689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:54.699292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:54.982643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99491c7d-812f-46e1-9b6b-654e7804c760 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 204 len: 0 microversion: 2.1 time: 0.457216 Aug 30 18:37:54.985766 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2288/4466] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:54 2022] DELETE /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:55.006063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:55.009468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:55.029912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.032014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.052534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.058991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.060140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.062577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.172547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:37:55.238545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:55.263529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-036bf9b0-0b87-45b4-8f29-935d1f544131 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 1.049095 Aug 30 18:37:55.270578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2179/4467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:54 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:55.293022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:55.304232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:55.319083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.323702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.324833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.328990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.330312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.334163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.539027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3ade3fc-cce2-4c8a-b60f-44db3612cef7 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 204 len: 0 microversion: 2.1 time: 0.550188 Aug 30 18:37:55.544223 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2289/4468] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:54 2022] DELETE /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:37:55.557566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:55.559241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:55.573765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.575120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.575834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:55.577377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:55.579809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:55.580680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.033000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:56.042185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c39aac2-bf90-4912-8bb7-8e422a020dde tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.767658 Aug 30 18:37:56.048950 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2180/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:55 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:56.067284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:56.069544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:56.077818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.083098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.083904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.084918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.089928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.090957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.150077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:56.168789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.169797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.170525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.171219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lazy-loading 'fault' on Instance uuid ec598cfa-1b07-45d7-aa96-e5dee4b10639 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:56.174614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-016ab993-26ff-49ea-a8b9-97f07dc9d173 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1495 microversion: 2.1 time: 0.626952 Aug 30 18:37:56.176959 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2290/4470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:55 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1495 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:56.187097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4191a9c-552a-457a-a486-46887c55fd4a", "name": "network-vif-plugged", "status": "completed", "tag": "b6f71c7b-da86-4ce4-8324-5e0f2212dba2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:56.205559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.207025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.208920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.232233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] Creating event network-vif-plugged:b6f71c7b-da86-4ce4-8324-5e0f2212dba2 for instance e4191a9c-552a-457a-a486-46887c55fd4a on n-h1-854119-10 Aug 30 18:37:56.241712 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-90673dca-a492-4625-8019-4e31ae3d8228 req-35ca1355-2a6d-4ca7-b52a-4b7596daba28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062345 Aug 30 18:37:56.243465 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2291/4471] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:56.269771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec598cfa-1b07-45d7-aa96-e5dee4b10639", "name": "network-vif-deleted", "tag": "2e674c95-760f-4bbc-8954-09c7c30a882c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:56.310213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.312069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.313031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.341119 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] Creating event network-vif-deleted:2e674c95-760f-4bbc-8954-09c7c30a882c for instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 on n-h1-854119-10 Aug 30 18:37:56.351386 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-caf3f753-32eb-4720-a3cf-6893e32fa20b req-4c3db401-5e5f-4f30-b21c-20a3d22ceb1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105626 Aug 30 18:37:56.352483 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2292/4472] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:56.362050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:56.373302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:56.382691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.383264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.384061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.384984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.385453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.385887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.502297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:56.510014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de78ba52-bad7-45ec-baec-1a8e8801d9a2 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 200 len: 1337 microversion: 2.1 time: 0.459541 Aug 30 18:37:56.510658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2181/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:56 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 1337 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:56.532758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:56.542131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:56.564518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.565239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.565861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.566794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:56.567427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:56.568026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:56.765493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:56.779391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-651f6523-4e56-4656-8d5c-242b0a603946 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1680 microversion: 2.1 time: 0.425332 Aug 30 18:37:56.779942 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2293/4474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:56 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1680 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:57.083967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:57.091245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:57.092680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:57.100306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24425ebb-e358-4dad-a7f1-3edc582d1219 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1203 microversion: 2.1 time: 0.571177 Aug 30 18:37:57.101587 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2182/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:56 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1203 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:57.105136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.106030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.106806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.107807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.108506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.109238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.217212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:57.218249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:57.225172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.225654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.226190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.226959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.227414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.228173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.326800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:57.352576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ecc9b34-0600-4f4b-9269-2bdc0f807d2f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1453 microversion: 2.1 time: 0.138833 Aug 30 18:37:57.353203 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2183/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:57 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:57.417341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:57.428666 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4a69782-f2d9-4216-9aed-2540329a4913 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.342200 Aug 30 18:37:57.429297 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2294/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:57 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:57.542098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:57.542863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: ec598cfa-1b07-45d7-aa96-e5dee4b10639] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:57.562416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.562925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.563369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.569166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.571227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.571697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.597933 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] HTTP exception thrown: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Request method failure captured: Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 HTTP/1.1 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlhHgBVmewj5PXPm21iDIJR3DckJgqywwh8kFT-SOlj0MdSXFrBSBjqnOEAfNCFPdSz6V2-ysU69osHO-0UfOMVbgo-heW2QRO6J4sZCfKH4uYpUqGQhnaEdIRS3ZC-2sa9gxIgaDWrjC57m0SYOpPqaMTIgOgA-E5Kf6EtkYSmuIGE Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3aff2cb00a51480bbdce8ebebd9c3b59 Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ec598cfa-1b07-45d7-aa96-e5dee4b10639'} Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:57.606154 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. Aug 30 18:37:57.613029 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:37:57.616147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Returning 404 to user: Instance ec598cfa-1b07-45d7-aa96-e5dee4b10639 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:57.617433 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d747a7d-3e85-4158-93aa-ebbe2ba7db3a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639" status: 404 len: 111 microversion: 2.1 time: 0.084768 Aug 30 18:37:57.618462 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2184/4478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:57 2022] GET /compute/v2.1/servers/ec598cfa-1b07-45d7-aa96-e5dee4b10639 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:37:57.819090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:57.820031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:57.830371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.831146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.831841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:57.832713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:57.833326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:57.834171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.122684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:58.123600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:58.132074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.133230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.133786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.134664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.135213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.135716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.175496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:58.391151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:58.405321 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3774780-53ad-4cfb-98d2-78942fafef63 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1680 microversion: 2.1 time: 0.605483 Aug 30 18:37:58.419345 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2295/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:57 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1680 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:58.428294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:58.429345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:58.437207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.438612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.439307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.440308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.441035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.441705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.510975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.511474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.512045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.512579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lazy-loading 'fault' on Instance uuid df6db648-5a14-4bb5-b2db-52c22e357bf8 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:37:58.748734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:58.757623 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-01f5e48f-9721-4aa4-bef7-f91e39cf8a76 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1389 microversion: 2.1 time: 0.639098 Aug 30 18:37:58.758876 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2185/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:58 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1389 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:58.766046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:58.766991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:58.783306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:58.783894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.784410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.784876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.785585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.786053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.786512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.794939 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf20a204-a413-4cb5-a610-3cd0de22ba8f tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 200 len: 1305 microversion: 2.1 time: 0.373695 Aug 30 18:37:58.796767 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2296/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:58 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 1305 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:58.803426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6db648-5a14-4bb5-b2db-52c22e357bf8", "name": "network-vif-deleted", "tag": "42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:37:58.819419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.820461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.821168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.839454 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] Creating event network-vif-deleted:42f5017f-58db-4a4b-aeb8-65b3ed5ee4ab for instance df6db648-5a14-4bb5-b2db-52c22e357bf8 on n-h1-854119-10 Aug 30 18:37:58.847306 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-696b2f66-9b50-4a93-b5ef-cd0806967517 req-a7a16720-740f-4b96-9b0c-a655a84d6fed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048882 Aug 30 18:37:58.848679 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2297/4482] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:37:58.855280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d44a2c4d-2dde-4406-a480-e1f06216c8a4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '.version_select at 0x7f4e55e01a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:58.900386 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d44a2c4d-2dde-4406-a480-e1f06216c8a4 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-219288598" status: 202 len: 0 microversion: 2.1 time: 0.050263 Aug 30 18:37:58.901190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2298/4483] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 18:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-219288598 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:37:58.907741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:58.909064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:58.917329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.918092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.918851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.921146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:58.921998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:58.922768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:58.959563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:59.175510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:59.187335 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d302ef90-a234-419d-8676-3e80cbfb3d3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.426813 Aug 30 18:37:59.189792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2186/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:58 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:59.344250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:59.355553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9c5bfb6-0a5c-46e3-8a62-7b33171bcf23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1389 microversion: 2.1 time: 0.452739 Aug 30 18:37:59.361751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2299/4485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:58 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1389 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:37:59.383216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.384188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.393380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.394208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.394752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.395560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.396126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.396641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.433856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.436508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.444898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:37:59.458784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.463024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.465858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.466859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.473826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.474602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.610205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:37:59.648354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c478a57c-9c27-408b-a8fb-44326ec48efb tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1613 microversion: 2.1 time: 0.199226 Aug 30 18:37:59.652330 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2300/4486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:59 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1613 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:37:59.821718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.822329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: df6db648-5a14-4bb5-b2db-52c22e357bf8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.835940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.836685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.837239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.838254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.839118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.839798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.883263 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 HTTP/1.1 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'df6db648-5a14-4bb5-b2db-52c22e357bf8'} Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:37:59.885120 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 404 to user: Instance df6db648-5a14-4bb5-b2db-52c22e357bf8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:37:59.890968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53987d40-1618-4994-9183-84b632bbea9e tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8" status: 404 len: 111 microversion: 2.1 time: 0.070019 Aug 30 18:37:59.892418 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2301/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:59 2022] GET /compute/v2.1/servers/df6db648-5a14-4bb5-b2db-52c22e357bf8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:37:59.897449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:37:59.898019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:37:59.915885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.916390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.916824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.917560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:37:59.918023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:37:59.918484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:37:59.972275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:38:00.088912 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6e694b2-9bb8-494b-abc9-b338bdb46b11 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 204 len: 0 microversion: 2.1 time: 0.192015 Aug 30 18:38:00.089714 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2302/4488] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:37:59 2022] DELETE /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:38:00.100321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:00.101602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:00.112035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.112931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.113800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.115475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.116159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.116949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.149290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:00.163318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b5c1fb4-6f77-44a2-a1d2-f22d00c277fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1389 microversion: 2.1 time: 0.783320 Aug 30 18:38:00.174516 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2187/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:37:59 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1389 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:00.183124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:00.183923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:00.190746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.191552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.192162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.193080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.193703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.194287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.225074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:38:00.323481 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af8aa94a-6e16-42aa-a1f5-a65c04fe2d52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 204 len: 0 microversion: 2.1 time: 0.144326 Aug 30 18:38:00.324732 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2188/4490] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:38:00 2022] DELETE /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:38:00.333451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:00.334513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:00.343412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.344481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.346621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.350090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.351482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.352131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.497639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:00.507266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a7c6291-12c7-4d90-b0f9-af1a67ca6ae5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1674 microversion: 2.1 time: 0.411710 Aug 30 18:38:00.511455 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2303/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:00 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1674 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:00.517929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:00.524090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:00.537340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.538197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.539314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.540369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.541065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.542566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.920377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:00.940714 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9594e1fb-eed0-4e74-abf6-533b62cc5312 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.612189 Aug 30 18:38:00.942806 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2189/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:00 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:00.962525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d958ec3-a773-47c0-a2d7-b70184f7fc43", "name": "network-vif-deleted", "tag": "e11a467a-0a0b-48a7-af3f-35fe324bd355"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:00.978012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:00.978888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:00.980049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:00.997295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] Creating event network-vif-deleted:e11a467a-0a0b-48a7-af3f-35fe324bd355 for instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 on n-h2-854119-10 Aug 30 18:38:01.003817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7f10f580-2e93-4f53-af6d-59df7132c915 req-9f8a921f-7818-4244-98d2-10ec40c7c438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059924 Aug 30 18:38:01.004771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2190/4493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:01.010482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:01.011924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:01.019173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.020579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.021824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.023369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.024256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.025023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.044062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:01.058102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0f3c348-3584-4bfd-9529-41d00557fde9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1395 microversion: 2.1 time: 0.543845 Aug 30 18:38:01.076064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2304/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:00 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1395 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:01.090171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.092898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.093565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.094207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lazy-loading 'fault' on Instance uuid 3d958ec3-a773-47c0-a2d7-b70184f7fc43 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:38:01.537940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:01.539596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:01.555020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.558211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.559046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.560025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.561589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.564296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.653334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faee7d75430f4606bd909bae8a22e11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca43827ad114d019e3a90c18faa9651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:01.664801 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-246a310c-7564-41e7-a329-f1f29168e4b0 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 200 len: 1332 microversion: 2.1 time: 0.658531 Aug 30 18:38:01.668882 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2191/4495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:01 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 1332 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:01.966451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:01.967914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:01.983731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:01.993785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.994986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:01.997439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:01.999328 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4782d328-f2a1-4bc6-91c0-5fd777674db8 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1674 microversion: 2.1 time: 0.466938 Aug 30 18:38:01.999851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:01.999998 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2305/4496] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:01 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1674 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:02.022704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.023592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.094601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:02.095358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:02.107896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.112096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.114737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.117971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.119630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.121107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.565129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:02.577614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f860c37-651e-49f9-9d5f-81e3ea6f36f4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1395 microversion: 2.1 time: 0.497229 Aug 30 18:38:02.610910 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2306/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:02 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1395 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:02.674290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:02.701549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:02.710277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] [instance: 3d958ec3-a773-47c0-a2d7-b70184f7fc43] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:02.760605 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f7d3650-30eb-470f-8a6b-aae003d831cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.797791 Aug 30 18:38:02.770617 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2192/4498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:01 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:02.782503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.788499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.791027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.795671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:02.803238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:02.805167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:02.913701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] HTTP exception thrown: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Request method failure captured: Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 HTTP/1.1 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlhJ6fCkd3Gllj17pKgF_ADX_jfKzKZ9qwkUiu6hIwDVdKTFS-tstCJ5nyH0EKWcPDGp0Qy8SKPfOxj_d7UP5Fr3mHmAsUN8lfmSc6a5zXHqgFUKtKkCPu0QrBj4F4Oj7CfCu0eRdRkYpSm1pd-IS5wMTHdsAVPBBJ5C5XphKNHlZpw Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: fca43827ad114d019e3a90c18faa9651 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fca43827ad114d019e3a90c18faa9651"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fca43827ad114d019e3a90c18faa9651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: fca43827ad114d019e3a90c18faa9651 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-860321259 Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesAdminNegativeTest-860321259-project Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faee7d75430f4606bd909bae8a22e11d Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesAdminNegativeTest-860321259-project Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '3d958ec3-a773-47c0-a2d7-b70184f7fc43'} Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:02.917097 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. Aug 30 18:38:02.929548 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:38:02.946038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Returning 404 to user: Instance 3d958ec3-a773-47c0-a2d7-b70184f7fc43 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:02.948196 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2206375-8e9f-44fb-8000-a8a62bcb66d2 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43" status: 404 len: 111 microversion: 2.1 time: 0.256653 Aug 30 18:38:02.952300 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2307/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:02 2022] GET /compute/v2.1/servers/3d958ec3-a773-47c0-a2d7-b70184f7fc43 => generated 111 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:38:02.960567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66aa245d-0db1-49a0-93fc-57ee42651761 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] Calling method '.version_select at 0x7f4e55d1faf0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:03.025568 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66aa245d-0db1-49a0-93fc-57ee42651761 tempest-VolumesAdminNegativeTest-860321259 tempest-VolumesAdminNegativeTest-860321259-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913067274" status: 202 len: 0 microversion: 2.1 time: 0.069102 Aug 30 18:38:03.026949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2193/4500] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913067274 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:03.030708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:03.031839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:03.044416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.047053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.047786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:03.051847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.052617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.053924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:03.410254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:03.422823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2acab9ef-5de0-4538-b3a9-065cfdd04f3d tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1674 microversion: 2.1 time: 0.397076 Aug 30 18:38:03.431052 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2308/4501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:03 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1674 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:03.624601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:03.625570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:03.653282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.655663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.656348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:03.664213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.664976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.665442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:03.789574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:03.790201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:03.806614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.807575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.811169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:03.812707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:03.815542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:03.816968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:04.088345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:04.104692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-81d79bb2-4735-4e4a-9e09-e95dfe44f51f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1395 microversion: 2.1 time: 0.491429 Aug 30 18:38:04.106193 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2194/4502] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:03 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1395 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:04.455738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:04.456791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:04.466573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:04.470496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:04.471452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:04.472499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:04.473053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:04.474205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:04.872511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:04.881701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-978915c8-be2b-42c5-87bf-0ec12b11208a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 1.098645 Aug 30 18:38:04.891298 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2309/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:03 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:04.907179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4191a9c-552a-457a-a486-46887c55fd4a", "name": "network-vif-deleted", "tag": "b6f71c7b-da86-4ce4-8324-5e0f2212dba2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:04.923185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:04.923659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:04.951471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:04.996778 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] Creating event network-vif-deleted:b6f71c7b-da86-4ce4-8324-5e0f2212dba2 for instance e4191a9c-552a-457a-a486-46887c55fd4a on n-h1-854119-10 Aug 30 18:38:05.024646 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-68e0e569-2330-4664-87d8-87b18fe38a0b req-9f719158-ffdf-491e-837b-56704158ad90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129138 Aug 30 18:38:05.025828 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2310/4504] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:05.132565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:05.133301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:05.165102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:05.166257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:05.167011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:05.168076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:05.170791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:05.171552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:05.404279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:05.424133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bcc0fad3-68b3-48ee-aa4b-d4c73564f98d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.297509 Aug 30 18:38:05.429933 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2311/4505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:05 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:05.864576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:05.895722 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72b6b89d-1cd7-4e09-b41e-b50d903765eb tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1674 microversion: 2.1 time: 1.444517 Aug 30 18:38:05.900652 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2195/4506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:04 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1674 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:05.912717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:05.913522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:05.927951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:05.935800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:05.936441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:05.944697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:05.945681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:05.948550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:06.470620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:06.471422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:06.497037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:06.497587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:06.498027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:06.501654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:06.503993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:06.509444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:06.894265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:06.896293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:06.928020 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6aa473ac-1a13-4523-b6d8-1b6dbc7ef02b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.476178 Aug 30 18:38:06.945354 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2196/4507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:06 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:06.953693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8fd2f1d-fa34-4f0f-888b-91712968caf8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 1.041466 Aug 30 18:38:06.958449 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2312/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:05 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:06.964287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:06.966170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:06.985943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:06.988692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:06.989469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:06.994565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:06.995737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:06.996434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:07.225872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d5845d852d443d9b03fc499cf62b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38198e73fe3f494bb857e20d80230920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:07.251049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f8db0d14-e298-45c9-a9a5-2c956e9dca7b tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 200 len: 1607 microversion: 2.1 time: 0.295726 Aug 30 18:38:07.269452 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2197/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:06 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 1607 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:07.373292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0cecb6-76aa-45e1-9508-81b2e4022a05", "name": "network-vif-deleted", "tag": "a0e15a42-4914-4294-8c94-56e934e6f256"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:07.415708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:07.416995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:07.419181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:07.456494 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] Creating event network-vif-deleted:a0e15a42-4914-4294-8c94-56e934e6f256 for instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 on n-h1-854119-10 Aug 30 18:38:07.469887 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-56d920d7-0941-4a97-b1e5-0648b6cd156c req-25c22e55-bd23-41fb-8b10-eea5fd5b8cab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104027 Aug 30 18:38:07.473856 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2313/4510] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:07.970580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:07.973213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:07.992382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:07.993119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:07.995314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:07.999750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.003591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.004790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:08.008130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.012549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.037417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:08.038845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.040278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.041832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:08.043079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.043803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.445241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:08.458780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9aeb32b2-a36d-43d1-b1ef-05c73b1408b8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.493713 Aug 30 18:38:08.459405 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2198/4511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:07 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:08.475839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:08.476542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] [instance: 1e0cecb6-76aa-45e1-9508-81b2e4022a05] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:08.496083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:08.496907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.499248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.500051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:08.500518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:08.500949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:08.548112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] HTTP exception thrown: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Request method failure captured: Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 HTTP/1.1 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlbeFdHS6KYiKBVtelgTxsJIlhUO4R6rm7-QAe-M7pGEGlv3Gy08yd4dJ2ZJndN4rzEwov7kfuJoSYBb6zpO-PloBoja9lNRsvp0nPF1-DIaXSTcim_NKQCIKbexPwNQ5A9rb3wrgLPOhXJXBxgic1m_rpYxpuDgmfWZzfw5Tax11Dc Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38198e73fe3f494bb857e20d80230920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38198e73fe3f494bb857e20d80230920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38198e73fe3f494bb857e20d80230920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-387169464 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 38198e73fe3f494bb857e20d80230920 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-387169464 Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 63d5845d852d443d9b03fc499cf62b4c Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-387169464-project Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1e0cecb6-76aa-45e1-9508-81b2e4022a05'} Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:08.549961 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Returning 404 to user: Instance 1e0cecb6-76aa-45e1-9508-81b2e4022a05 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:08.557848 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5fa464c4-bfeb-470e-b96b-511fecb27f55 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05" status: 404 len: 111 microversion: 2.1 time: 0.094513 Aug 30 18:38:08.563049 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2199/4512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:08 2022] GET /compute/v2.1/servers/1e0cecb6-76aa-45e1-9508-81b2e4022a05 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:38:08.568778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d1a7ce1-7eb0-428a-b2e6-d490343938f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] Calling method '.version_select at 0x7f4e55b73310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:08.598163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:08.613377 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d1a7ce1-7eb0-428a-b2e6-d490343938f5 tempest-ServerActionsTestJSON-387169464 tempest-ServerActionsTestJSON-387169464-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866961532" status: 202 len: 0 microversion: 2.1 time: 0.049445 Aug 30 18:38:08.613974 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2200/4513] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866961532 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:08.620203 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-163d329e-5de1-40b4-b546-2b7878efb446 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.640950 Aug 30 18:38:08.639170 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2314/4514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:07 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:09.486019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:09.491423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:09.528981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:09.529886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:09.536679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:09.537703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:09.538391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:09.547224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:09.658381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:09.664128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:09.699731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:09.700765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:09.701219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:09.701964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:09.702439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:09.702867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:09.768293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:09.792620 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d7e92d8-b1cb-4308-b2d5-1abee4225ab0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.316647 Aug 30 18:38:09.793868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2201/4515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:09 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:10.420850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:10.431583 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24b3fe18-241b-4cf6-82fc-13929cd18e8f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.792837 Aug 30 18:38:10.439105 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2315/4516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:09 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:10.820871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:10.822092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:10.836517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:10.839038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:10.840872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:10.845994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:10.846815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:10.847456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:11.054055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:11.067379 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9fe062bc-00ce-4bfd-b10c-2d1ce87b9efa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.253244 Aug 30 18:38:11.070970 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2202/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:10 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:11.469919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:11.470769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:11.490312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:11.494570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:11.495279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:11.496215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:11.497209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:11.501022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:12.092235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:12.093511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:12.111886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:12.116647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:12.117887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:12.120158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:12.121980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:12.123460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:12.130642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:12.144331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:12.154905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1961fa74-8973-4093-95c0-9ce403b227f7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.690583 Aug 30 18:38:12.178125 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2316/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:11 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:12.507355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:12.525660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-10e4724b-e876-4921-bf68-962db06277cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.434664 Aug 30 18:38:12.535261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2203/4519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:12 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:13.208764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:13.218211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:13.239957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.247191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.248083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.249116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.249841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.250593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.254159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:13.553211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:13.554760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:13.563630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.564072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.564929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.568030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:13.569395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:13.570045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:13.824485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:13.836098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1f5df5b2-7409-45fe-9cc2-fd43e09a7169 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 200 len: 1188 microversion: 2.1 time: 0.287591 Aug 30 18:38:13.839574 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2204/4520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:13 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 1188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:14.015528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:14.025092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-443012d8-0f3d-4c4e-8794-cc209fc69b31 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.826248 Aug 30 18:38:14.031525 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2317/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:13 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:14.857811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:14.859321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: e4191a9c-552a-457a-a486-46887c55fd4a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:14.891120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:14.891973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:14.892650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:14.895572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:14.896421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:14.898051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:14.931837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a HTTP/1.1 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'e4191a9c-552a-457a-a486-46887c55fd4a'} Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:14.945570 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance e4191a9c-552a-457a-a486-46887c55fd4a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d8f46df-84bb-4902-89ec-6739ba5885ed tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a" status: 404 len: 111 microversion: 2.1 time: 0.093393 Aug 30 18:38:14.950248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2205/4522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:14 2022] GET /compute/v2.1/servers/e4191a9c-552a-457a-a486-46887c55fd4a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:38:15.053979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:15.055741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:15.064597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:15.065255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:15.080256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:15.086737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:15.089052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:15.089724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:16.412644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:16.422542 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5583849f-a74b-484e-93d2-661ec7d6cd24 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 1.372909 Aug 30 18:38:16.429405 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2318/4523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:15 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:17.452973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:17.453617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:17.466271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:17.466795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:17.467253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:17.468000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:17.468466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:17.468900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:18.608652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:18.619088 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b10614bd-c4e1-4e95-82ab-3f2e0a7723d1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 1.170429 Aug 30 18:38:18.634042 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2206/4524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:17 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:19.648254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:19.649553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:19.661125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:19.661630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:19.662078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:19.662909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:19.681700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:19.684204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:20.261865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:20.276520 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5718bd41-804a-4cc0-a923-11b0251d29de tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.632141 Aug 30 18:38:20.283190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2319/4525] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:19 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:21.311803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:21.312669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:21.321327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:21.329504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:21.330455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:21.331167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:21.332139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:21.335010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:21.335832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:22.377618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:22.400439 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ea479ba-b81e-49c7-a92f-3158f45d18c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 1.094438 Aug 30 18:38:22.406277 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2207/4526] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:21 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:23.425143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:23.425763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:23.444089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:23.445973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:23.446923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:23.447835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:23.448469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:23.449114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:23.950454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:23.971861 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6885367-1cc8-44a6-a490-1e8d43f6077e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1522 microversion: 2.1 time: 0.550959 Aug 30 18:38:23.972898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2320/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:23 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:25.000747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:25.001360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:25.019859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.020362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.020801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:25.021521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.021971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.022537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:25.692767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:25.706951 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd38b18b-00a3-46f8-a36f-c3121194d1c1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1502 microversion: 2.1 time: 0.710166 Aug 30 18:38:25.732919 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2208/4528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:24 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1502 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:25.741229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:25.742052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:25.770995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.778944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.780405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:25.783083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:25.788006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:25.791216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.247730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:26.268040 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83801321-2380-4c6c-8587-507a3acb637a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1515 microversion: 2.1 time: 0.533397 Aug 30 18:38:26.272548 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2321/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:25 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:26.299488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:26.304107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f1430b1-8bb0-447c-b568-cebd71195344] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:26.324642 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/5f1430b1-8bb0-447c-b568-cebd71195344/action HTTP/1.1 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 14 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: {"rescue": {}} Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5f1430b1-8bb0-447c-b568-cebd71195344', 'body': {'rescue': {}}} Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:26.336265 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. Aug 30 18:38:26.341008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:26.344725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 404 to user: Instance 5f1430b1-8bb0-447c-b568-cebd71195344 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:26.345879 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c60c4172-c9ac-4de4-9203-9b59d971e397 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f1430b1-8bb0-447c-b568-cebd71195344/action" status: 404 len: 111 microversion: 2.1 time: 0.052855 Aug 30 18:38:26.347707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2209/4530] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:26 2022] POST /compute/v2.1/servers/5f1430b1-8bb0-447c-b568-cebd71195344/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:38:26.370930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:26.372076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:26.407740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.411374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.415261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.420784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.422552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.423172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.708357 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28e5876c-d2e6-4e55-ba41-5fdbc981343b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action" status: 202 len: 0 microversion: 2.1 time: 0.345242 Aug 30 18:38:26.716143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2322/4531] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:26 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:26.718241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:26.719220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:26.742829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.747382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.765045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:26.769008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:26.777754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:26.784363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:27.761246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:27.772548 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9eb80973-984f-4e66-8bc6-050c77b5b1dd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1520 microversion: 2.1 time: 1.058579 Aug 30 18:38:27.773239 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2210/4532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:26 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1520 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:28.806131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:28.807852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:28.833757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.836148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.836611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:28.839598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:28.840079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:28.840525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.589781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:29.617161 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9e851cf-4b9b-4257-88f7-961ec96845e3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1500 microversion: 2.1 time: 0.823408 Aug 30 18:38:29.620352 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2323/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:28 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1500 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:29.645632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:29.647143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:29.666224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.667064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.667592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.671262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.671874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.672648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.758436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'flavor' on Instance uuid 5f4e5e21-d569-437d-85ba-fad1bd3361ae {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:38:29.807661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Cannot 'rescue' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state paused Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action HTTP/1.1 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 14 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: {"rescue": {}} Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'rescue' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state paused Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5f4e5e21-d569-437d-85ba-fad1bd3361ae', 'body': {'rescue': {}}} Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae in vm_state paused. Cannot rescue while the instance is in this state. Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state paused Aug 30 18:38:29.809291 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state paused Aug 30 18:38:29.814643 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:38:29.826528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 409 to user: Cannot 'rescue' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state paused {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:38:29.827870 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48e05eeb-2785-40cb-b9ed-5abda0bb05a5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action" status: 409 len: 144 microversion: 2.1 time: 0.187881 Aug 30 18:38:29.828685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2211/4534] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:29 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action => generated 144 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:38:29.840867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:29.843079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:29.855239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:29.868401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.872432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.874224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:29.879685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:29.881823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:29.883554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:30.007781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-63decde4-feeb-432e-a428-f8114d7a7311 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action" status: 202 len: 0 microversion: 2.1 time: 0.171155 Aug 30 18:38:30.009595 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2324/4535] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:29 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:38:30.019400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:30.020064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:30.040681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:30.049492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:30.052253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:30.057459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:30.059255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:30.059964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:30.871253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:30.886565 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-29af031c-fea9-4638-b490-c3e9706bd660 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1507 microversion: 2.1 time: 0.871754 Aug 30 18:38:30.887824 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2212/4536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:30 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1507 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:31.916158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:31.918678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:31.951032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:31.955310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:31.959488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:31.960713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:31.966512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:31.969267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:32.950922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:32.962876 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-298e5127-3c71-4e9d-9bcd-c12cdbf228cd tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1515 microversion: 2.1 time: 1.057491 Aug 30 18:38:32.967271 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2325/4537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:31 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1515 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:34.541446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0eddadad-15d6-4cfd-8c04-8615f8621302 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: .version_select at 0x7f4e566f31f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1155784455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQAiQPiTcPO1plthbr91KtMPf+T8P9kNWbiV6GomDO3Kw9Dm+3AOqqVs0ADmGGDYX3cCyhOdTbgRPxIQLaZXTcCmXk4MgOE/8kne2OcAwk6sgDTxoty1mZCGVw/7QqKfw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:34.621805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0eddadad-15d6-4cfd-8c04-8615f8621302 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:38:34.651895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0eddadad-15d6-4cfd-8c04-8615f8621302 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:38:34.755762 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0eddadad-15d6-4cfd-8c04-8615f8621302 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.217016 Aug 30 18:38:34.759288 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2213/4538] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:38:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:37.085511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:37.088721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:37.119271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:37.124274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:37.125038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:37.126666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:37.127316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:37.127942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:37.202456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'flavor' on Instance uuid 5f4e5e21-d569-437d-85ba-fad1bd3361ae {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:38:37.392664 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3926291-1089-4110-ad06-3577fe154e88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action" status: 200 len: 32 microversion: 2.1 time: 0.311944 Aug 30 18:38:37.394041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2326/4539] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:38:37 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:38:37.416476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:37.418217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:37.433171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:37.433672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:37.434159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:37.435690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:37.436160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:37.436648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:38.255165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:38.267958 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4297684a-804c-4ef2-8cf0-95739747019b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.868310 Aug 30 18:38:38.274470 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2214/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:37 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:39.297963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:39.298696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:39.320621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:39.321435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:39.321884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:39.322681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:39.330112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:39.331219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:40.297168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1488429420", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "45c1797b-d283-4618-be92-f212ecb2ea2d"}], "key_name": "tempest-TestNetworkBasicOps-1155784455", "security_groups": [{"name": "tempest-secgroup-smoke-639574258"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:40.766524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:40.790092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4664db7f-05f5-49cb-9498-9ecdf46d8252 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.498162 Aug 30 18:38:40.790741 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2327/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:39 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:40.931260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] validate_networks() for [('45c1797b-d283-4618-be92-f212ecb2ea2d', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:38:41.822942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:41.826114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:41.852621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:41.867501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:41.868385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:41.874590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:41.881330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:41.882495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:42.364976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:38:42.366440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:38:42.367239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:38:42.367988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:38:42.368640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:38:42.387103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:42.391025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:42.391819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:42.396471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:42.398838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:42.399557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:42.448465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=56 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:42.479421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:38:42.492131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Getting quotas for user 3aff2cb00a51480bbdce8ebebd9c3b59 and project f0c9c9f7134b4f2387e4e1d078afd9d4. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:38:42.515695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:38:42.518320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:38:42.630269 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9c53d969-1b68-4d79-b993-4a6bce099bec tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.338816 Aug 30 18:38:42.631453 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2215/4542] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:38:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:38:42.651203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-baf6b148-850a-4816-846c-3c37770a105e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:42.653926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-baf6b148-850a-4816-846c-3c37770a105e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:42.758174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-baf6b148-850a-4816-846c-3c37770a105e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:42.774321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-baf6b148-850a-4816-846c-3c37770a105e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1249 microversion: 2.1 time: 0.132794 Aug 30 18:38:42.780433 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2216/4543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:42 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:43.706848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:43.740134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:43.747391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a35b9c11-8076-4d8d-bb3d-9b462d444f56 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.937531 Aug 30 18:38:43.748585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2328/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:41 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:43.803952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:43.805533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:43.822780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:43.835736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:43.837707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:43.839798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:43.842660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:43.847050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:44.107538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:44.124274 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1fb37e8-9c99-4c42-bb7b-8fd9307e3f9a tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1245 microversion: 2.1 time: 0.325526 Aug 30 18:38:44.125241 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2217/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:43 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1245 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:44.780834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:44.781461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:44.799047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:44.799793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:44.803016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:44.803795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:44.804584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:44.807065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.146439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:45.147766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:45.166355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:45.166857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:45.167296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.178289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:45.180141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:45.183923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:45.286705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:45.304293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2e5bc891-9fe9-452c-be10-d1d484bc29d6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.534967 Aug 30 18:38:45.305875 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2329/4546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:44 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:45.663376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:45.677355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e28c58d-459b-4ab2-bb1f-daa88fa00317 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1307 microversion: 2.1 time: 0.536028 Aug 30 18:38:45.678049 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2218/4547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:45 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1307 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:46.336527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:46.337264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:46.351494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:46.352068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:46.352526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:46.353276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:46.355791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:46.356264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:46.825449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1463576462", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:46.924795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] validate_networks() for [('e2f1cc26-41a5-4701-9a97-76c2514ab6d8', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:38:47.865908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:47.874898 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7522899-b93e-4b14-9722-9f68f93c1c29 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.549029 Aug 30 18:38:47.875497 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2219/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:46 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:47.888807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:47.889420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:47.923110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:47.924936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:47.925440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:47.929174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:47.929734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:47.931614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:48.294490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:48.312684 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2be5ee5b-c0ee-4535-95d7-c5f312a96ba3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1307 microversion: 2.1 time: 0.436034 Aug 30 18:38:48.313726 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2220/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:47 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1307 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:48.896999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:48.897628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:48.917090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:48.917613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:48.918058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:48.918826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:48.919283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:48.919708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:49.272936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:38:49.273430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:38:49.273824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:38:49.274228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:38:49.274712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:38:49.292778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:49.307080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:49.309177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:49.311212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:49.316232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:49.316862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:49.394775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Getting quotas for project 9a6141584287452a80004b9e37e96f6f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:38:49.411154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Getting quotas for user dae3c4152f4d4294b25dbf3f1c3b8621 and project 9a6141584287452a80004b9e37e96f6f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:38:49.452326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:38:49.455415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:38:49.602727 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67ea2b03-0d00-4169-ab1d-59b0c1013e3f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.411083 Aug 30 18:38:49.608772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:49.614727 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2330/4550] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:38:49.629979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:49.652395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6df38c29-61ab-4da2-8c29-86d3d65dcb52 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.759658 Aug 30 18:38:49.659052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2221/4551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:48 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:49.666950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:49.669727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e49d34b-7b1f-44d5-8147-b605f4c0b197 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:49.672518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e49d34b-7b1f-44d5-8147-b605f4c0b197 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:49.709673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:49.710189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:49.710669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:49.717838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:49.718409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:49.718885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:50.094677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4e49d34b-7b1f-44d5-8147-b605f4c0b197 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:50.102834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e49d34b-7b1f-44d5-8147-b605f4c0b197 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1224 microversion: 2.1 time: 0.441290 Aug 30 18:38:50.105777 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2222/4552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:49 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1224 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:50.194743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:50.216648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-020425fc-1b4e-4fce-9d07-2edf337472d3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.600048 Aug 30 18:38:50.217250 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2331/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:49 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:50.677098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:50.678030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:50.724313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:50.724950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:50.726903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:50.727865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:50.735113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:50.737040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:51.134272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:51.135104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:51.154227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:51.158328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:51.167267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:51.169307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:51.173415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:51.175515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:51.503134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:51.524682 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90d3f9d9-9ccd-415c-afa9-b46919069f2d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1220 microversion: 2.1 time: 0.397939 Aug 30 18:38:51.527401 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2332/4554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:51 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1220 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:51.551437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:51.559159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:51.584607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:51.589023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:51.592165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:51.596003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:51.596584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:51.597046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:51.742951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:51.754024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8bfc02bb-2250-4dc8-9125-a10a12cb1a3a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.081521 Aug 30 18:38:51.756186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2223/4555] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:50 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:52.553278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:52.553822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:52.557088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:52.559919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:52.586850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:52.587375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:52.587823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:52.588572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:52.591220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:52.591922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:52.857913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:52.871962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87d3bc78-ea97-42d3-a632-643a044f82d3 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1294 microversion: 2.1 time: 0.323137 Aug 30 18:38:52.887026 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2224/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:52 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1294 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:52.898312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:52.899810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:52.913896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:52.914432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:52.914877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:52.915600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:52.927938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:52.928792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:53.591347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:53.616355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3d6b1f2-e1e3-4528-88cc-98ced97f8e15 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 2.087576 Aug 30 18:38:53.631799 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2333/4557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:51 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:53.754422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6", "tag": "a9c7afdd-8e6c-4a79-9840-137d42e343c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:38:53.793421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:53.794100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:53.802600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:53.802810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:53.810883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e68d98e-5c20-470e-997d-46c73ec24894 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.922442 Aug 30 18:38:53.811470 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2225/4558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:52 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:53.851775 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] Creating event network-changed:a9c7afdd-8e6c-4a79-9840-137d42e343c1 for instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 on n-h1-854119-10 Aug 30 18:38:53.864332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cdc69bee-5def-4bf8-9cc8-aa7c6aba63b5 req-b5a10d79-4142-4043-8a9c-03811ba829f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119210 Aug 30 18:38:53.866434 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2334/4559] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:38:53.893441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:53.894882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:53.913189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:53.914029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:53.914897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:53.915944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:53.918733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:53.919554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:54.056445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:54.068182 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-558a1d22-1ee4-431d-8c60-209cea953b3d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1282 microversion: 2.1 time: 0.178605 Aug 30 18:38:54.073543 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2226/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:53 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:54.638873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:54.640295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:54.655193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:54.657239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:54.657990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:54.660382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:54.661682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:54.663625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:54.836851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:54.837849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:54.851411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:54.852338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:54.853700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:54.855680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:54.857947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:54.860476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:55.286485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:55.299767 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddf182eb-8141-4836-86a6-d793dd828b1e tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.665238 Aug 30 18:38:55.301846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2335/4561] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:54 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:55.343536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:55.343536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:55.372480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:55.377312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:55.378104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:55.387467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:55.388076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:55.388778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:55.609241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:55.628632 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b1674a4-30ed-4c20-a3bd-85188093980d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1282 microversion: 2.1 time: 0.325530 Aug 30 18:38:55.642331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2336/4562] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:55 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1282 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:55.878299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:55.896612 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ccdfb588-4bca-426d-a78e-6c6c68a152d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.061726 Aug 30 18:38:55.899131 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2227/4563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:54 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:56.325753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:56.326827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:56.344049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.344791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.345346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:56.347055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.354203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.362200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:56.653278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:56.658773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:56.674264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.675163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.677718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:56.679756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.681171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.688759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:56.871598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:56.888126 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-883a4529-e7a9-47b2-bc3d-a715ca4b1241 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.566366 Aug 30 18:38:56.904974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2337/4564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:56 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:56.930146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:56.931783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:56.948394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.950776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.951257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:56.954577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:56.955104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:56.964989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:57.700540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:57.714973 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ba34ca3-7032-48fb-9652-ace76787b7a2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.789724 Aug 30 18:38:57.715658 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2338/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:56 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:57.909926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:57.910647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:57.917804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:57.918311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:57.918799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:57.919749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:57.920356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:57.921058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:57.950621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:57.965339 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a41b519c-ab4b-438f-9a8c-c8e93570a6c8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 1.317547 Aug 30 18:38:57.977018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2228/4566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:56 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:58.741210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:58.742599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:58.757849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:58.758429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:58.765028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:58.765820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:58.766302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:58.771379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:58.787217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:58.805237 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1bc6f7f-9580-4792-88ef-0d14d8df36c0 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.895563 Aug 30 18:38:58.807223 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2339/4567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:57 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:38:59.015662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:59.017737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:59.036436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:59.037028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:59.039985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:59.043164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:59.047115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:59.047957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:59.357966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:59.431074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:38:59.482828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:38:59.491657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd041aa5-084a-45e1-823f-710b12b00478 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.756326 Aug 30 18:38:59.504208 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2229/4568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:58 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:38:59.831479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:38:59.832295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:38:59.854246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:59.857332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:59.858335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:38:59.870486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:38:59.871214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:38:59.873679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.033573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:00.044829 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37fdec2b-b7a1-46a9-995d-b6d3794fa160 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 1.043148 Aug 30 18:39:00.059154 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2340/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:58 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:00.102105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.317769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:00.330129 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7c0ad32-4d33-4752-bf70-9b28d6abb8cc tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.501391 Aug 30 18:39:00.350708 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2230/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:38:59 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:00.516937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:00.517901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:00.525651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:00.555704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.558055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.559154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:00.560775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:00.566464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:00.567270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:01.066672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:01.067347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:01.086210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:01.088115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:01.089938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:01.091852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:01.093779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:01.094631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:01.315046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:01.324040 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d3c6d512-6071-4388-bfa0-8ec7271ed41c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.261193 Aug 30 18:39:01.330864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2231/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:01 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:01.356974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:01.358158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:01.390562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:01.395847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:01.397405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:01.402192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:01.406467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:01.410796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:01.938784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:01.972391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-399035e2-b048-4d8b-9066-b44641c9a856 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.620074 Aug 30 18:39:01.975973 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2232/4572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:01 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:01.997859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:02.008245 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-99e99a5b-bb6f-4c63-8163-6d922c891d1a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 1.495844 Aug 30 18:39:02.011367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2341/4573] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:00 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:02.029561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6", "name": "network-vif-plugged", "status": "completed", "tag": "a9c7afdd-8e6c-4a79-9840-137d42e343c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:02.066496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.075096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.075811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.126689 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] Creating event network-vif-plugged:a9c7afdd-8e6c-4a79-9840-137d42e343c1 for instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 on n-h1-854119-10 Aug 30 18:39:02.144831 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cb7adb85-7612-4fd1-a4f0-43411c35e5b9 req-92f357e7-73ee-48f4-8c98-e1937047e7ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131244 Aug 30 18:39:02.150575 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2342/4574] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:02.348766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:02.349700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:02.361466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.363159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.364028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.365269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.365817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.366505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.463769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494f0b7f-e95b-4a4c-a804-12ddc7aa57d7", "tag": "58096305-58f0-4e38-8036-952de3f74663"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:02.475672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:02.476618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:02.477315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:02.493552 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] Creating event network-changed:58096305-58f0-4e38-8036-952de3f74663 for instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 on n-h1-854119-10 Aug 30 18:39:02.501825 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-516b0095-8278-487d-b9c9-cbc3e64abf2b req-77b3776c-7e93-40d8-b7a1-ff7d0ac6c199 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522781 Aug 30 18:39:02.503537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2233/4575] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:02.998282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:02.999059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:03.009034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.009519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.009968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.010708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.011136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.011556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.055546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:03.076433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd3c9eaa-dc1a-46b5-8142-9e184f46933b tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.732753 Aug 30 18:39:03.089858 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2343/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:02 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:03.110213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:03.113348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:03.139431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.141186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.142011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.146643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:03.148047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:03.149152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:03.546611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:03.560476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4013bdd-f431-45df-b8ee-a24f57dd3897 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.467944 Aug 30 18:39:03.576181 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2344/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:03 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:03.642964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:03.656163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-512b61be-e9d4-4282-8c14-188cc20a4dc3 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1374 microversion: 2.1 time: 0.662403 Aug 30 18:39:03.656787 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2234/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:02 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1374 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:03.705887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265641585", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3cb87f66-081d-47c7-af4a-f53048472040", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:03.874962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:39:04.101659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:04.102315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:04.117934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.118537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.119199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.120208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.120840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.121437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.127189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:04.337716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:04.350135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1393edd4-bf41-4d9a-adad-cce76711e129 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.250756 Aug 30 18:39:04.370431 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2235/4579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:04 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:04.718121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:39:04.718643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:39:04.719659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:39:04.720297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:39:04.720806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:39:04.736365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.736725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.740018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.741146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:04.741841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:04.744818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:04.796804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1391b82-90e0-4ad0-9fd6-257fa29cfd94 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Action: 'create', calling method: .version_select at 0x7f4e55d1fd30>, body: {"pool": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:04.809921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:04.824405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:04.888002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:39:04.891247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3cb87f66-081d-47c7-af4a-f53048472040',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:39:05.088780 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-282a0f65-8d7d-456f-a587-9f6233e534d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387696 Aug 30 18:39:05.094005 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2345/4580] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:39:05.115702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:05.117163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:05.137336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.138206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.139631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:05.140699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.141395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.142135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:05.513505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:05.525252 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd13c382-26e4-4d1b-8394-902c9da86220 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1501 microversion: 2.1 time: 0.425251 Aug 30 18:39:05.525841 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2346/4581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:05 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1501 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:05.539771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:05.542176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:05.563081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.563595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.564035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:05.564762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:05.570673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:05.571106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:06.066573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:06.090674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00779798-dd1f-451f-9bf1-79da31401852 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1547 microversion: 2.1 time: 0.562800 Aug 30 18:39:06.106790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2347/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:05 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1547 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:06.112174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36ab49b7-24ae-4a32-a838-2fde20b7d242 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:06.113116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36ab49b7-24ae-4a32-a838-2fde20b7d242 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:06.301125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36ab49b7-24ae-4a32-a838-2fde20b7d242 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:06.310296 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36ab49b7-24ae-4a32-a838-2fde20b7d242 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1056 microversion: 2.1 time: 0.202166 Aug 30 18:39:06.320654 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2348/4583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:06 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1056 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:06.340128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:06.352180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:06.368670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:06.374584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:06.375709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:06.376985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:06.377866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:06.379203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:06.389295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:07.069784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:07.084278 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38cca184-0e26-4003-a6ff-75701a361bc5 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.747982 Aug 30 18:39:07.102312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2349/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:06 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:07.107777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a2777b4-57bc-4555-accc-17445a70b696"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:07.110690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:07.126308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.126835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.127273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:07.127983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.128433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.128856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:07.181493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Cannot 'attach_volume' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state rescued Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/os-volume_attachments HTTP/1.1 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 74 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: {"volumeAttachment": {"volumeId": "1a2777b4-57bc-4555-accc-17445a70b696"}} Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'attach_volume' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state rescued Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '5f4e5e21-d569-437d-85ba-fad1bd3361ae', 'body': {'volumeAttachment': {'volumeId': '1a2777b4-57bc-4555-accc-17445a70b696'}}} Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 18:39:07.184185 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state rescued Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state rescued Aug 30 18:39:07.190001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:39:07.193619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 409 to user: Cannot 'attach_volume' instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae while it is in vm_state rescued {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:07.207251 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09b9fabe-e8fd-4aa3-afba-ed14e4e174a8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.103164 Aug 30 18:39:07.210184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2350/4585] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:39:07 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/os-volume_attachments => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:39:07.229309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:07.231034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:07.246211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.248551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.249233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:07.250203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:07.254904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:07.259815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.074408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:08.086870 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1c2a85c-90c8-4f1a-af26-8c143a8824dd tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1547 microversion: 2.1 time: 0.874201 Aug 30 18:39:08.087833 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2351/4586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:07 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1547 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:08.119427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:08.120274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:08.137312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.138131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.138821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.139740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.140367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.140968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.288033 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19eb78c7-bbf3-467c-bbc1-8ccba76dd278 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action" status: 202 len: 0 microversion: 2.1 time: 0.181906 Aug 30 18:39:08.289144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2352/4587] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:39:08 2022] POST /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:08.301698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:08.302845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:08.306002 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1391b82-90e0-4ad0-9fd6-257fa29cfd94 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.792889 Aug 30 18:39:08.308829 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2236/4588] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:39:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:08.314784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:08.317117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:08.329511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.329999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.330587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.331877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.332035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.332358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.332956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.365217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.369225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.371935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.374046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.374778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.828144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:08.841595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4e95e91-dc01-4374-bb97-f433b97906fc tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.529526 Aug 30 18:39:08.844204 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2237/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:08 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:08.888901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:08.895150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:08.908596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.909290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.909700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:08.915130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:08.915818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:08.916480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:09.326513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:09.339149 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5923376b-6204-463b-836a-d30761bde66d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1509 microversion: 2.1 time: 0.486236 Aug 30 18:39:09.340677 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2238/4590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:08 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:09.348473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b9dc6fbc-98bf-46eb-9832-b504b52410a4 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e559cf9d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:09.655860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:09.680906 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eeb2bf3c-9829-4f08-b9a4-c98395ad9872 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1126 microversion: 2.1 time: 1.389111 Aug 30 18:39:09.681728 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2353/4591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:08 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1126 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:09.851755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494f0b7f-e95b-4a4c-a804-12ddc7aa57d7", "name": "network-vif-plugged", "status": "completed", "tag": "58096305-58f0-4e38-8036-952de3f74663"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:09.881132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:09.883268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:09.887364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:09.920499 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] Creating event network-vif-plugged:58096305-58f0-4e38-8036-952de3f74663 for instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 on n-h1-854119-10 Aug 30 18:39:09.928466 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-172f6e6f-b6bc-4ccf-b817-d7c14737dcf7 req-b48a81aa-d1fd-4f25-8b53-a5c745177768 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085757 Aug 30 18:39:09.932225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2354/4592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:39:09.937751 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b9dc6fbc-98bf-46eb-9832-b504b52410a4 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/4130db53-394c-4566-9586-50fcfc1ad6ed" status: 200 len: 141 microversion: 2.1 time: 0.595736 Aug 30 18:39:09.938805 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2239/4593] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:09 2022] GET /compute/v2.1/os-floating-ips/4130db53-394c-4566-9586-50fcfc1ad6ed => generated 141 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:09.950095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:09.950835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:09.952657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d480a52b-8fac-416e-80a1-8f954c7cbe28 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e559cff70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:09.988496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:09.989624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:09.990208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:10.003258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:10.004194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:10.009054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:10.935178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:10.949686 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da03a96f-3031-4bdc-9dac-402d05ffcd8a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 1.015812 Aug 30 18:39:10.951035 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2355/4594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:09 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:10.961086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:10.965690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:10.974377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:10.980006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:10.980907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:10.983557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:10.984262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:10.985793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.380374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d480a52b-8fac-416e-80a1-8f954c7cbe28 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.432462 Aug 30 18:39:11.382054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2240/4595] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:39:09 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:39:11.389437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:11.392506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:11.406131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.412861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.415611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.419764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.420279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.420726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.558244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:11.569992 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80ccda89-4ae0-4b68-b664-a70beb3bc312 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1126 microversion: 2.1 time: 0.186410 Aug 30 18:39:11.582782 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2241/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:11 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1126 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:11.588177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e97d75-c8b7-4c9c-8413-dbb6a5cc44d8 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e55a3a280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:11.814764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:11.823137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-547f0448-01d6-4297-bacd-a9a70738e63e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1509 microversion: 2.1 time: 0.870800 Aug 30 18:39:11.823965 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2356/4597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:10 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1509 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:11.975900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:11.976627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:11.991237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.991791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.992253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:11.997567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:11.998088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:11.998651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:12.687595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:12.718302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c3f4233-df04-4494-9970-5cf3729e766d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1324 microversion: 2.1 time: 0.748385 Aug 30 18:39:12.723601 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2357/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:11 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:12.744358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:12.747133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:12.767161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:12.789063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:12.789604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:12.792806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:12.796727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:12.797312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:13.237973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f6e97d75-c8b7-4c9c-8413-dbb6a5cc44d8 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4130db53-394c-4566-9586-50fcfc1ad6ed" status: 202 len: 0 microversion: 2.1 time: 1.653813 Aug 30 18:39:13.238596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2242/4599] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:39:11 2022] DELETE /compute/v2.1/os-floating-ips/4130db53-394c-4566-9586-50fcfc1ad6ed => generated 0 bytes in 1655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:13.244116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:13.244734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:13.252673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:13.253395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:13.254014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:13.255352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:13.255986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:13.256953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:13.585014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:13.601637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-03e8b747-1b6b-4af9-91d2-4ff17745866b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.869859 Aug 30 18:39:13.602425 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2358/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:12 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:13.624597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88874b3e-d52e-46d9-895f-202d5c76d1f0 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Action: 'create', calling method: .version_select at 0x7f4e56dfeee0>, body: {"pool": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:13.742666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:13.756447 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-448ba6b3-421d-453a-9421-344eb98446ff tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1515 microversion: 2.1 time: 0.516297 Aug 30 18:39:13.758772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2243/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:13 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:13.789332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:13.794658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:13.811967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:13.814765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:13.815786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:13.816730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:13.820766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:13.821458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:14.469185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:14.478873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6bb103d-38fb-4037-8444-9e1b4d250143 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1520 microversion: 2.1 time: 0.701976 Aug 30 18:39:14.482192 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2244/4602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:13 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1520 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:14.636215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:14.637321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:14.663253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:14.663746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:14.664200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:14.664915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:14.676489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:14.676983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:14.775689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:15.162239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:15.179410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a429b1ae-53ca-40e6-bc8d-50479a0a9a44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.545534 Aug 30 18:39:15.180514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2245/4603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:14 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:15.200787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9f836c2-7de0-4089-b914-49cac52c8aa8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183802806", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9f836c2-7de0-4089-b914-49cac52c8aa8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 243 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1183802806", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1183802806', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'e2f1cc26-41a5-4701-9a97-76c2514ab6d8'}]}}} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.206094 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.211664 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.215299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9f836c2-7de0-4089-b914-49cac52c8aa8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:15.226757 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9f836c2-7de0-4089-b914-49cac52c8aa8 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.039166 Aug 30 18:39:15.233917 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2246/4604] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:15 2022] POST /compute/v2.1/servers => generated 175 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:39:15.239621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:15.240695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: a9c92cd7-5694-468e-aaf7-fe7ebe579c83] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:15.248483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] HTTP exception thrown: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/a9c92cd7-5694-468e-aaf7-fe7ebe579c83/metadata HTTP/1.1 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': 'a9c92cd7-5694-468e-aaf7-fe7ebe579c83'} Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.254733 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.259416 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:15.259416 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:15.259416 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. Aug 30 18:39:15.259416 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.261698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 404 to user: Instance a9c92cd7-5694-468e-aaf7-fe7ebe579c83 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:15.263017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0346662e-0cec-44c3-a600-261abeb481ce tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/a9c92cd7-5694-468e-aaf7-fe7ebe579c83/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027571 Aug 30 18:39:15.298965 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2247/4605] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:39:15 2022] GET /compute/v2.1/servers/a9c92cd7-5694-468e-aaf7-fe7ebe579c83/metadata => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:15.486285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65101d8d-e505-4388-ab30-526beec0226a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2120597120", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65101d8d-e505-4388-ab30-526beec0226a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 499 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2120597120", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2120597120', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e2f1cc26-41a5-4701-9a97-76c2514ab6d8'}]}}} Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:39:15.497414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.501373 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.512642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65101d8d-e505-4388-ab30-526beec0226a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:15.513672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65101d8d-e505-4388-ab30-526beec0226a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031621 Aug 30 18:39:15.514393 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2248/4606] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:15 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:39:15.646823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdae6dd7-ddfa-460a-9ac0-be9f0014cc3a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-294261998", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdae6dd7-ddfa-460a-9ac0-be9f0014cc3a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 499 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-294261998", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-294261998', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e2f1cc26-41a5-4701-9a97-76c2514ab6d8'}]}}} Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:39:15.656414 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.659867 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.665797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdae6dd7-ddfa-460a-9ac0-be9f0014cc3a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:15.672537 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bdae6dd7-ddfa-460a-9ac0-be9f0014cc3a tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030725 Aug 30 18:39:15.684852 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2249/4607] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:39:15.783881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b239dd7-7d6d-436a-8e2b-f27b0496d332 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1954971114", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b239dd7-7d6d-436a-8e2b-f27b0496d332 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 754 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1954971114", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1954971114', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e2f1cc26-41a5-4701-9a97-76c2514ab6d8'}]}}} Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:39:15.791123 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:39:15.794143 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:39:15.797894 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.797894 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.797894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b239dd7-7d6d-436a-8e2b-f27b0496d332 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:15.803164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b239dd7-7d6d-436a-8e2b-f27b0496d332 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.031513 Aug 30 18:39:15.803890 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2250/4608] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:15 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 18:39:15.947854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c81072a6-68f7-4316-9db5-be4a8829bb6d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771054437", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c81072a6-68f7-4316-9db5-be4a8829bb6d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 1265 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771054437", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e2f1cc26-41a5-4701-9a97-76c2514ab6d8"}]}} Aug 30 18:39:15.985862 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-771054437', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e2f1cc26-41a5-4701-9a97-76c2514ab6d8'}]}}} Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.992814 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:39:15.997621 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:39:16.004601 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 18:39:16.004601 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.025392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c81072a6-68f7-4316-9db5-be4a8829bb6d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:16.039321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c81072a6-68f7-4316-9db5-be4a8829bb6d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.098107 Aug 30 18:39:16.045972 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2251/4609] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Aug 30 18:39:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 18:39:16.067291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:16.070045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 185db421-e514-42a6-b668-8502ed201d04] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:16.104788 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] HTTP exception thrown: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/185db421-e514-42a6-b668-8502ed201d04/metadata/test2 HTTP/1.1 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': '185db421-e514-42a6-b668-8502ed201d04', 'id': 'test2'} Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:16.111953 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:16.116617 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:16.116617 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:16.116617 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. Aug 30 18:39:16.116617 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:16.116935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 404 to user: Instance 185db421-e514-42a6-b668-8502ed201d04 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:16.117707 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8767aeb8-3e4f-4164-9f99-6788b923814f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/185db421-e514-42a6-b668-8502ed201d04/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.061984 Aug 30 18:39:16.129061 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2252/4610] 10.222.0.25 () {58 vars in 1281 bytes} [Tue Aug 30 18:39:16 2022] GET /compute/v2.1/servers/185db421-e514-42a6-b668-8502ed201d04/metadata/test2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:16.162203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:16.172235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:16.200635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:16.202452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:16.220230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:16.227532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:16.234646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:16.241766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:16.307206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:16.376951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:39:16.798637 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-826024f1-32d3-40f3-859f-3dacdcd6034c tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "DELETE /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 204 len: 0 microversion: 2.1 time: 0.661676 Aug 30 18:39:16.807106 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2253/4611] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:39:16 2022] DELETE /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:39:16.857300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:16.865314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:16.891355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:16.892771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:16.895220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:16.902222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:16.914050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:16.919515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:18.390741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:18.421036 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15920956-b58d-4769-9f74-846a186fec11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.610222 Aug 30 18:39:18.423233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2254/4612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:16 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:18.435060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:18.437624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:18.456414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:18.457268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:18.457891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:18.458890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:18.459521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:18.460122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:19.230581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:19.264628 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c3e78e72-a0a8-4f81-9d57-54473ed8725d tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1526 microversion: 2.1 time: 0.835243 Aug 30 18:39:19.266152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2255/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:18 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1526 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:19.297247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85e6e3df-78ff-4556-9846-6a70e747c186 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: .version_select at 0x7f4e570cca60>, body: {"keypair": {"name": "tempest-keypair-761632789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6EKN0Bn6XQnJdMUIUUTN4gyl+ujmaTHFez+/O80C+JC67WZmahy6b99xzU2iSC1C3ilnMf8hQMN9awQbeUS5B4lEwswALfUeYuS907VpfWf9jRGXBpjfCQwOJqftNhag=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:19.435666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-85e6e3df-78ff-4556-9846-6a70e747c186 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for project 119ec7495f3f4efabf939dec536feb52. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:19.457841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-85e6e3df-78ff-4556-9846-6a70e747c186 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for user faf78635374746d793bae244e2a28989 and project 119ec7495f3f4efabf939dec536feb52. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:19.571617 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85e6e3df-78ff-4556-9846-6a70e747c186 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295839 Aug 30 18:39:19.579161 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2256/4614] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:39:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:19.587958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:19.603521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:19.648861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:19.658112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:19.661064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:19.661982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:19.662627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:19.668268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:21.107660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:21.128196 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6caaea33-795d-4ac8-a849-7c0ea3a9534c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.545829 Aug 30 18:39:21.129518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2257/4615] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:19 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:21.158827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:21.170827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:21.192723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:21.193819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:21.199118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:21.202092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:21.207543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:21.208700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:21.439287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae3c4152f4d4294b25dbf3f1c3b8621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6141584287452a80004b9e37e96f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:21.463740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b6ef747-37d6-4603-9e70-699f94034c7f tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 200 len: 1484 microversion: 2.1 time: 0.317908 Aug 30 18:39:21.464351 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2258/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:21 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 1484 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:21.523075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494f0b7f-e95b-4a4c-a804-12ddc7aa57d7", "name": "network-vif-deleted", "tag": "58096305-58f0-4e38-8036-952de3f74663"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:21.542720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:21.543202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:21.543636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:21.579616 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] Creating event network-vif-deleted:58096305-58f0-4e38-8036-952de3f74663 for instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 on n-h1-854119-10 Aug 30 18:39:21.593052 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6d220bca-b956-4645-a363-fe0f7f697f57 req-678ce44b-9df6-4d77-a7c6-fed5044be9ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074492 Aug 30 18:39:21.602285 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2259/4617] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:39:22.167268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:22.168876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:22.186210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:22.195516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:22.196153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:22.197114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:22.197897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:22.198527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:22.751757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:23.533125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:23.574503 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8d3461b-214d-4785-9213-887d68f7a334 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.412057 Aug 30 18:39:23.596259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:23.608274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2260/4618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:22 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:23.644510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e064158-7b97-4175-9fc7-7bad990e3453", "tag": "4aea18c5-1954-4f2f-b975-5a83734f4234"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:23.665386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:23.688188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:23.694489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:23.695630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:23.758062 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] Creating event network-changed:4aea18c5-1954-4f2f-b975-5a83734f4234 for instance 5e064158-7b97-4175-9fc7-7bad990e3453 on n-h2-854119-10 Aug 30 18:39:23.786241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-17ebdd19-a780-4275-9066-023e21c71d30 req-80c33e68-5ad7-4c49-87c5-658469372a9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172174 Aug 30 18:39:23.787591 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2261/4619] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:23.794304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:23.795417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] [instance: 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:23.804995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:23.806619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:23.807265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:23.810118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:23.810836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:23.811544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:23.897065 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] HTTP exception thrown: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Request method failure captured: Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 HTTP/1.1 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlk1J6yHpL8aWLZRkVqkYa9zYbwM_57qHo3Lucvxnrc9Y5HUm07_BIewR_LVHSSe5v4l7dhxwkF5csehcs31chBwADUA6Q4p3EFmkxXvIHx2bvaXI2gPGdQtJWtlBTjQ3cuyIHNRityu_dh-Xcid4TXmbx9Y8b5im4iADrU8_o5T44k Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9a6141584287452a80004b9e37e96f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9a6141584287452a80004b9e37e96f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 9a6141584287452a80004b9e37e96f6f Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-604930887 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: dae3c4152f4d4294b25dbf3f1c3b8621 Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-604930887-project Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '494f0b7f-e95b-4a4c-a804-12ddc7aa57d7'} Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:23.902819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] Returning 404 to user: Instance 494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4fa01357-4382-4cf1-a9d0-db5bf1cd4f86 tempest-ServerMetadataNegativeTestJSON-604930887 tempest-ServerMetadataNegativeTestJSON-604930887-project] 10.222.0.25 "GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7" status: 404 len: 111 microversion: 2.1 time: 0.115354 Aug 30 18:39:23.924432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2262/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:23 2022] GET /compute/v2.1/servers/494f0b7f-e95b-4a4c-a804-12ddc7aa57d7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:24.631210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:24.631898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:24.648859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:24.654542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:24.655121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:24.655896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:24.656468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:24.656906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:25.159106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:25.171766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5117d4d5-ce30-4239-9b75-b8e27bf6896a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.550338 Aug 30 18:39:25.175120 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2263/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:24 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:26.205330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:26.206800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:26.222846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:26.223735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:26.224346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:26.225253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:26.225861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:26.226542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:26.231577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:26.761630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:26.770385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1684c5b3-dadb-4c02-8cfa-99301e9c170f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.568917 Aug 30 18:39:26.792774 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2264/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:26 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:27.392308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6", "tag": "a9c7afdd-8e6c-4a79-9840-137d42e343c1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:27.419930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:27.420764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:27.421390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:27.448238 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] Creating event network-changed:a9c7afdd-8e6c-4a79-9840-137d42e343c1 for instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 on n-h1-854119-10 Aug 30 18:39:27.456536 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fe1b3620-0c78-40e2-bc2b-15b1bfb2f96a req-626cbedf-3c3e-49d4-85a3-e6f621be6dae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067631 Aug 30 18:39:27.460254 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2265/4623] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:27.766540 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-88874b3e-d52e-46d9-895f-202d5c76d1f0 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 14.157176 Aug 30 18:39:27.775236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2359/4624] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:39:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 14168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:27.780681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be31c6c9-6afd-4ac6-b294-dadd6df2b65e tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e55adf310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:27.799578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:27.801231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:27.847380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:27.848408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:27.863476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:27.871549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:27.872546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:27.873482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:29.088177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:29.112490 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b52a6833-7118-407e-a417-0bd8a1e07a06 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.320625 Aug 30 18:39:29.121898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2360/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:27 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:29.484217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:30.149822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:30.151389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:30.165672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:30.171193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:30.172356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:30.173360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:30.175930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:30.179197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:30.773003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:30.783801 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0042be88-e250-4b29-b323-49cfef6190c1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.640026 Aug 30 18:39:30.790914 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2361/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:30 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:31.074589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1458962988", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ea6885d-b0da-4db6-9332-706da66697de"}], "security_groups": [{"name": "tempest-securitygroup--1253232604"}], "key_name": "tempest-keypair-761632789", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:31.466974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] validate_networks() for [('6ea6885d-b0da-4db6-9332-706da66697de', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:39:32.219520 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be31c6c9-6afd-4ac6-b294-dadd6df2b65e tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb" status: 202 len: 0 microversion: 2.1 time: 4.441910 Aug 30 18:39:32.219520 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2266/4627] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:39:27 2022] DELETE /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb => generated 0 bytes in 4444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:39:32.223839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:32.224614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:32.243472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.243472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.244104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.244492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.245757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.246396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.552870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:32.563241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bbfe3a6-4206-4a70-8efd-3f576ea69b6d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.343342 Aug 30 18:39:32.563847 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2267/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:32 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:32.569035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:32.587775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:32.597799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.597799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.599047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.599047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.599388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.599748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.704811 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44aecffd-86a0-46e8-89f1-79af0fc565e5 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6/action" status: 200 len: 24560 microversion: 2.1 time: 0.139347 Aug 30 18:39:32.705606 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2268/4629] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:39:32 2022] POST /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6/action => generated 24560 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:39:32.713334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:39:32.713926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:39:32.714786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:39:32.715231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:39:32.715646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:39:32.723050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e55961f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:32.745172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.745667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.746175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.747027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:32.747490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:32.747908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:32.818800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:32.836071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Getting quotas for user faf78635374746d793bae244e2a28989 and project 119ec7495f3f4efabf939dec536feb52. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:32.865695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:39:32.868491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:39:32.949241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 13e4f9b2-4e44-495f-8833-927ea03d04eb could not be found", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:39:32.951644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] HTTP exception thrown: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Request method failure captured: Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb HTTP/1.1 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDllIxXv35RvrSZMtaXbn_VjXpbNeqw1MBNrb304NF3GFycb-xdJ952RxogYTWN9jj1lQRY5BsELGv_RqK6c7X5ZDRUgkkGAhCXsKMVjzwf84kSw1GAXLuvD3JHOcJcptr6CLQ68JCbzFONIeanND6GJAdlxqzbCYW77C_X7vp1jKxKs Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 11c9d4f7cd0b489c917fa928191fdd2b Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 11c9d4f7cd0b489c917fa928191fdd2b Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsTestJSON-818064026-project Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 18c25cb6376644289898f3221ad29ff1 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsTestJSON-818064026-project Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: exception: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '13e4f9b2-4e44-495f-8833-927ea03d04eb'} Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 13e4f9b2-4e44-495f-8833-927ea03d04eb could not be found Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c24c91b1-6741-4ae4-896f-a2fb74f05140'] Aug 30 18:39:32.956766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb. Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:32.964382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:32.983278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Returning 404 to user: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:32.984668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d4efb76-e207-44c1-897f-1343b67d8d3a tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb" status: 404 len: 111 microversion: 2.1 time: 0.265846 Aug 30 18:39:32.986672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2269/4630] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:32 2022] GET /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:32.998857 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5078de23-9cf7-4bb4-adb7-660c395e5900 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.928620 Aug 30 18:39:33.010912 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2362/4631] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:39:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:39:33.016617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Calling method '.version_select at 0x7f4e55d1fa60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:33.021547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0057978e-dd6d-4010-af23-356768e98eb2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:33.023539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0057978e-dd6d-4010-af23-356768e98eb2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:33.184909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG neutronclient.v2_0.client [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 13e4f9b2-4e44-495f-8833-927ea03d04eb could not be found", "detail": ""}} {{(pid=122590) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 18:39:33.186082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] HTTP exception thrown: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Request method failure captured: Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb HTTP/1.1 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDllIxXv35RvrSZMtaXbn_VjXpbNeqw1MBNrb304NF3GFycb-xdJ952RxogYTWN9jj1lQRY5BsELGv_RqK6c7X5ZDRUgkkGAhCXsKMVjzwf84kSw1GAXLuvD3JHOcJcptr6CLQ68JCbzFONIeanND6GJAdlxqzbCYW77C_X7vp1jKxKs Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 11c9d4f7cd0b489c917fa928191fdd2b Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11c9d4f7cd0b489c917fa928191fdd2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 11c9d4f7cd0b489c917fa928191fdd2b Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-FloatingIPsTestJSON-818064026 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-FloatingIPsTestJSON-818064026-project Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 18c25cb6376644289898f3221ad29ff1 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-FloatingIPsTestJSON-818064026-project Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: exception: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '13e4f9b2-4e44-495f-8833-927ea03d04eb'} Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 13e4f9b2-4e44-495f-8833-927ea03d04eb could not be found Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc6a0449-9358-4a52-a806-de3ff910806f'] Aug 30 18:39:33.188909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb. Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] Returning 404 to user: Floating IP not found for ID 13e4f9b2-4e44-495f-8833-927ea03d04eb {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:33.196386 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a1ff37b-4349-4f3c-acca-670381b30113 tempest-FloatingIPsTestJSON-818064026 tempest-FloatingIPsTestJSON-818064026-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb" status: 404 len: 111 microversion: 2.1 time: 0.200119 Aug 30 18:39:33.199412 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2270/4632] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:39:32 2022] DELETE /compute/v2.1/os-floating-ips/13e4f9b2-4e44-495f-8833-927ea03d04eb => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:33.250211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0057978e-dd6d-4010-af23-356768e98eb2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:33.262733 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0057978e-dd6d-4010-af23-356768e98eb2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1245 microversion: 2.1 time: 0.244087 Aug 30 18:39:33.267307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2363/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:33 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1245 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:33.586900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:33.588764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:33.604388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:33.605681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:33.608905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:33.610147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:33.610970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:33.614756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:34.260185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:34.271499 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c19ab77-3803-4e75-9fb8-9ae6e8fb992e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.691148 Aug 30 18:39:34.273689 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2271/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:33 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:34.293047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:34.293858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:34.323226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:34.324671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:34.325150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:34.331762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:34.334669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:34.338295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:34.617069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:34.632153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3684f448-05e0-4eb4-ba46-2c672010276b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1249 microversion: 2.1 time: 0.342323 Aug 30 18:39:34.634273 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2364/4635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:34 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1249 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:35.294134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:35.295599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:35.330272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:35.334290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:35.335508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:35.338925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:35.342137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:35.343069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:35.655252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:35.655891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:35.672553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:35.673055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:35.673487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:35.674210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:35.674701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:35.675193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:35.913129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:35.932012 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6bde3b9-6c9b-429e-a0ce-f12337a2c9a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1303 microversion: 2.1 time: 0.280950 Aug 30 18:39:35.935458 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2365/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:35 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:36.010059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:36.021617 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aca77854-2917-49b5-831e-4c6c7a4ddcfd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.731853 Aug 30 18:39:36.024848 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2272/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:35 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:36.955940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:36.959876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:36.975313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:36.983190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:36.984053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:36.986161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:36.987374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:36.988075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:37.048503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:37.049807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:37.081865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:37.084048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:37.085018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:37.085807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:37.086290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:37.089165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:37.218486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:37.245787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d2e74e4-82f4-4033-a235-647c75ee8a53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1303 microversion: 2.1 time: 0.293662 Aug 30 18:39:37.266264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2366/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:36 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:38.268747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:38.269491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:38.302415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:38.303206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:38.309095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:38.316357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:38.317167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:38.319073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:38.357167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:38.370083 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa3b3400-e610-4a48-a96b-23f05c9e3ee9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.326667 Aug 30 18:39:38.375726 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2273/4639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:37 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:39.393278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:39.393978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:39.417633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:39.418131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:39.418657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:39.419397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:39.419912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:39.420346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:39.584104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:39.600738 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c6d1af65-875c-4867-8850-32b86e16369b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 1.335830 Aug 30 18:39:39.615255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2367/4640] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:38 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:39.625296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:39.649064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:39.665247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:39.667384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:39.667943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:39.671051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:39.674988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:39.682211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:39.795452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7c9b3e4-5a9b-4db6-9d00-ea28cea80663 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "POST /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6/action" status: 200 len: 32626 microversion: 2.1 time: 0.177578 Aug 30 18:39:39.803237 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2368/4641] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:39:39 2022] POST /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6/action => generated 32626 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:39:39.910945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:39.921312 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-048268a1-d88b-4652-a854-eafb4540bb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.531092 Aug 30 18:39:39.935968 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2274/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:39 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:40.629350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:40.631187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:40.646754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:40.647599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:40.648288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:40.649268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:40.649964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:40.650685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:40.956055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:40.964651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:40.994794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:41.005011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:41.005830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:41.006888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:41.007500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:41.008191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:41.322537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:41.341454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:41.355291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36f8ebe1-569f-4296-a58e-82cd14f51253 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 0.730546 Aug 30 18:39:41.357123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-54d44c52-be60-468f-8ab9-aba138918084 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.407269 Aug 30 18:39:41.359595 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2369/4643] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:40 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:41.360655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2275/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:40 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:41.381947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:41.421861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:41.431167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:41.432306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:41.476372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] Creating event network-changed:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:39:41.501972 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-760a075a-dec1-44fb-82c1-24c23b6262d6 req-631d1f6c-9c22-4136-b0f9-2d92a9039949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136351 Aug 30 18:39:41.503437 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2276/4645] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:42.383083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:42.384364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:42.384906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:42.386185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:42.402247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:42.405526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:42.406281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:42.408590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:42.410197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:42.411714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:42.412091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:42.412751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:42.413220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:42.414007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:42.414522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:42.414960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:42.796147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:42.914657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:42.930258 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4379a58b-aa9f-4d66-a372-fa7bc9fa8158 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.546883 Aug 30 18:39:42.943253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:42.946471 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2370/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:42 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:42.964307 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b9cd153-427c-430c-92ff-d4a2dfd96e5b tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 0.584200 Aug 30 18:39:42.965644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2277/4647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:42 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:43.177083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:43.177775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:43.188709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.195529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.196319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.197232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.197850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.198415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.259639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:43.273755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:39:43.506951 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-279ddd1f-54a0-4ac7-b274-5ea454bfa518 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 204 len: 0 microversion: 2.1 time: 0.332334 Aug 30 18:39:43.511812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2371/4648] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:39:43 2022] DELETE /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:39:43.522824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:43.523579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:43.539040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6", "tag": "a9c7afdd-8e6c-4a79-9840-137d42e343c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:43.558384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.562315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.564401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.569193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.571715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.572188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.601772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.604243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.604699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.629523 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] Creating event network-changed:a9c7afdd-8e6c-4a79-9840-137d42e343c1 for instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 on n-h1-854119-10 Aug 30 18:39:43.635748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7a05b299-4bc3-4bea-b0b6-53214af5bbb9 req-cf635043-f5b3-4b34-b2d6-52e24b2d5c6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109429 Aug 30 18:39:43.637172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2372/4649] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:43.954023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:43.955242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:43.974798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.979966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.982030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:43.982030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:43.982030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:43.984004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:44.055751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:44.066794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af8fd9d7-9037-40cb-9d4f-09338ecdf45b tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1671 microversion: 2.1 time: 0.553521 Aug 30 18:39:44.080922 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2278/4650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:43 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1671 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:44.093839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:44.094395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:44.104435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:44.105111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:44.105710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:44.106618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:44.107248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:44.107832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:44.592596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:44.609812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e1fe243-be99-4643-ab8f-3dc028997212 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 0.520338 Aug 30 18:39:44.610454 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2279/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:44 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:44.812369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:44.825613 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a6cf2c6-9df2-4a3e-8ca1-197a01419214 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 0.875928 Aug 30 18:39:44.827359 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2373/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:43 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:45.098785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:45.103396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:45.142439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.144922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.145756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.150121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.155937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.161665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.640699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:45.641332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:45.663517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.664240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.667906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:45.669099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:45.673342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:45.675613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:46.956551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:46.978228 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c42321a3-67ec-44cb-80be-8d3a39f9fd5d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 1.346972 Aug 30 18:39:46.983888 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2374/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:45 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:47.001700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:47.008829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:47.021272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:47.021840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:47.022306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:47.023647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:47.025162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:47.025615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:47.892184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:47.901654 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-483c5e0e-4d85-4e6b-9fcf-e1f52dd1a2c8 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1671 microversion: 2.1 time: 2.810750 Aug 30 18:39:47.906020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2280/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:45 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1671 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:48.001263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:48.002358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:48.016673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.018225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.019254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.021701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.023570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.026180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.088702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:48.097709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e69513b4-835b-411a-981c-58dbfd5d2de9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1168 microversion: 2.1 time: 1.112424 Aug 30 18:39:48.107138 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2375/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:46 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1168 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:48.764006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6", "name": "network-vif-deleted", "tag": "a9c7afdd-8e6c-4a79-9840-137d42e343c1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:48.807897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.808482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.819352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.854815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] Creating event network-vif-deleted:a9c7afdd-8e6c-4a79-9840-137d42e343c1 for instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 on n-h1-854119-10 Aug 30 18:39:48.864385 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4d609607-0c39-4bec-a9b9-1bd4eac49a14 req-2c49c66b-73b2-4c5c-856d-7312dfb63bb8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104463 Aug 30 18:39:48.865788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2376/4656] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:48.933589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:48.934380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:48.965431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.970829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.971950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:48.977108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:48.977989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:48.980379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.123175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:49.125842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:49.126621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.129000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lazy-loading 'fault' on Instance uuid 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:39:49.269364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aff2cb00a51480bbdce8ebebd9c3b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c9c9f7134b4f2387e4e1d078afd9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:49.284490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:49.302874 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48e386e1-a8f6-4545-89e1-193c73b8dbe9 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 200 len: 1339 microversion: 2.1 time: 0.374200 Aug 30 18:39:49.314000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:49.314724 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2377/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:48 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 1339 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:49.320759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:49.321389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:49.334166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6598807f-0da3-4f9a-8cff-eb6c4a13b944 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 1.334829 Aug 30 18:39:49.337608 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2281/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:47 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:49.343672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:49.344185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:49.344635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.345361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:49.345822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:49.346253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:49.679032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:49.691853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b19793d2-d51d-4eac-943a-e761244a9a80 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1214 microversion: 2.1 time: 0.375326 Aug 30 18:39:49.692784 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2378/4659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:49 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:50.363853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:50.364797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:50.383457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.383968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.384415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.385143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.385604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.386041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.901625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:50.903163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] [instance: 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:50.913651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.914731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.916471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.917461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:50.918111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:50.918591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:50.956077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] HTTP exception thrown: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Request method failure captured: Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 HTTP/1.1 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlhHgBVmewj5PXPm21iDIJR3DckJgqywwh8kFT-SOlj0MdSXFrBSBjqnOEAfNCFPdSz6V2-ysU69osHO-0UfOMVbgo-heW2QRO6J4sZCfKH4uYpUqGQhnaEdIRS3ZC-2sa9gxIgaDWrjC57m0SYOpPqaMTIgOgA-E5Kf6EtkYSmuIGE Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0c9c9f7134b4f2387e4e1d078afd9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkBasicOps-302948747 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0c9c9f7134b4f2387e4e1d078afd9d4 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkBasicOps-302948747 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3aff2cb00a51480bbdce8ebebd9c3b59 Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkBasicOps-302948747-project Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6'} Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:39:50.958226 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. Aug 30 18:39:50.963209 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:39:50.967938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Returning 404 to user: Instance 4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:39:50.969429 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-29e6c506-3207-48af-b908-1ba15a788652 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6" status: 404 len: 111 microversion: 2.1 time: 0.643203 Aug 30 18:39:50.973287 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2282/4660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:50 2022] GET /compute/v2.1/servers/4be7e9b4-c4b6-476c-a9ad-c9eea8c3a0f6 => generated 111 bytes in 648 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:39:50.979023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:50.985078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "name": "network-vif-plugged", "status": "completed", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:50.996166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6aa58a82-5995-43ae-a077-ebce9101577e tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 0.632738 Aug 30 18:39:50.998042 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2379/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:50 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:51.001800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:51.002513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:51.003137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:51.004962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:51.005584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:51.031718 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] Creating event network-vif-plugged:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:39:51.047582 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cb03b867-cee1-49c3-9296-e8a8249cacac req-6bce89ef-b3a6-4ca0-b820-664e2dbd0da5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071875 Aug 30 18:39:51.048889 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2283/4662] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:51.053861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:51.066427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:51.067503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:51.070534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:51.071214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:51.071824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:51.720274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:51.729032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c819953-d07a-4d2f-bdb1-06b942d61ab6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 0.727851 Aug 30 18:39:51.747494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2380/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:51 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:51.877993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b3eeea58-2244-4a5d-bc14-ed435c86ef02 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] Calling method '.version_select at 0x7f4e5595f8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:51.929431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b3eeea58-2244-4a5d-bc14-ed435c86ef02 tempest-TestNetworkBasicOps-302948747 tempest-TestNetworkBasicOps-302948747-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1155784455" status: 202 len: 0 microversion: 2.1 time: 0.063441 Aug 30 18:39:51.930152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2284/4664] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 18:39:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1155784455 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:39:52.018251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:52.019281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:52.032587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.033094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.040533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.041619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.042972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.044975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.759268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:52.760746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:52.805645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.865446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.865446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.865446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:52.880964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:52.881872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:52.881872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:52.882051 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19ea326d-a903-4b58-907c-5dbf889a1a70 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1371 microversion: 2.1 time: 0.819710 Aug 30 18:39:52.882051 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2381/4665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:52 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1371 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:53.260061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d04fbcb-b72e-4fae-af26-ccfaee67540b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e5aeb6280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:53.331754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d04fbcb-b72e-4fae-af26-ccfaee67540b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb" status: 200 len: 636 microversion: 2.1 time: 0.075600 Aug 30 18:39:53.341139 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2382/4666] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:39:53 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb => generated 636 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:53.372847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8796aa0-c42f-4077-a5a1-c580a97c3a94 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e56e7d1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:53.390169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:53.426889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e770d3d-4896-4628-972e-cccd2d3b7e16 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 0.669703 Aug 30 18:39:53.429084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2285/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:52 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:53.475362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:53.495357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a8796aa0-c42f-4077-a5a1-c580a97c3a94 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:53.502429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a8796aa0-c42f-4077-a5a1-c580a97c3a94 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:53.854962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:53.855574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:53.863741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:39:53.865527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:53.868983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:53.869572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:53.871216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:53.873766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:53.874300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:54.002866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8796aa0-c42f-4077-a5a1-c580a97c3a94 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.659042 Aug 30 18:39:54.008600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2383/4668] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:53 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:54.014286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73c39402-96e5-4820-b3ae-194ca4d6a5d6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e5aeb4700>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:54.395139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73c39402-96e5-4820-b3ae-194ca4d6a5d6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "DELETE /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.384946 Aug 30 18:39:54.396235 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2384/4669] 10.222.0.25 () {58 vars in 1296 bytes} [Tue Aug 30 18:39:54 2022] DELETE /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_version => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:39:54.407276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2dbef6c0-efa8-4502-b147-2d30b686a3c0 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e5aeb4160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:54.464329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2dbef6c0-efa8-4502-b147-2d30b686a3c0 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 37 microversion: 2.1 time: 0.061373 Aug 30 18:39:54.472261 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2385/4670] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:54 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 37 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:39:54.478941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:54.479616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:54.487191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:54.489295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:54.489791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:54.490981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:54.491050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:54.491426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:54.939334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:54.962093 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2af27b1e-db1f-475c-9eb7-c7773572b79c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1566 microversion: 2.1 time: 1.110969 Aug 30 18:39:54.962755 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2286/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:53 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1566 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:54.985821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7286ca51-0bf7-46bc-91a1-b8612e30f3f6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e5595f670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:55.089896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7286ca51-0bf7-46bc-91a1-b8612e30f3f6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:55.099919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-7286ca51-0bf7-46bc-91a1-b8612e30f3f6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:55.490779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:55.505215 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39c48efa-8dcc-48ed-acb7-1b233b69ec0e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 1.029334 Aug 30 18:39:55.506215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2386/4672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:54 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:39:55.517603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:55.518113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:55.528926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7286ca51-0bf7-46bc-91a1-b8612e30f3f6 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.563449 Aug 30 18:39:55.535582 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2287/4673] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:54 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:55.542606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.543106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.543558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:55.544328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:55.544863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:55.545186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:55.546075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1c443d7-48fb-45ff-a038-596c7f6923fc tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e55adff70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:55.634804 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1c443d7-48fb-45ff-a038-596c7f6923fc tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.096838 Aug 30 18:39:55.635664 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2288/4674] 10.222.0.25 () {58 vars in 1290 bytes} [Tue Aug 30 18:39:55 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_distro => generated 33 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:55.649408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-df841285-0650-4f3f-bcee-45b64e21af6f tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e55d1fdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:55.740676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-df841285-0650-4f3f-bcee-45b64e21af6f tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:55.755595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-df841285-0650-4f3f-bcee-45b64e21af6f tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:56.074627 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-df841285-0650-4f3f-bcee-45b64e21af6f tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.429937 Aug 30 18:39:56.076107 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2289/4675] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:55 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:56.088397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-43306f26-8748-436d-9d33-1cabf244b12b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e55952700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:56.194015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-43306f26-8748-436d-9d33-1cabf244b12b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.109261 Aug 30 18:39:56.197584 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2290/4676] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:56 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:56.211555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18c6cd0c-c65e-4485-8aa5-db86e86e903e tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e55952040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:56.227642 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fde93e4b-1e38-455a-a898-3d1c8d49ca0a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.720352 Aug 30 18:39:56.228735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2387/4677] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:39:55 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-interface => generated 285 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:39:56.323820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-18c6cd0c-c65e-4485-8aa5-db86e86e903e tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:56.350801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-18c6cd0c-c65e-4485-8aa5-db86e86e903e tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:56.529470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:56.531821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:56.547788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:56.548329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:56.548914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:56.549662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:56.550145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:56.554031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:56.736181 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18c6cd0c-c65e-4485-8aa5-db86e86e903e tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.533251 Aug 30 18:39:56.736931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2291/4678] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:56 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:56.747542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-565d7913-74f3-4222-b80e-743c3afc0c77 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e55a3a550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:56.826207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-565d7913-74f3-4222-b80e-743c3afc0c77 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:56.839243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-565d7913-74f3-4222-b80e-743c3afc0c77 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:57.502740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-565d7913-74f3-4222-b80e-743c3afc0c77 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.759513 Aug 30 18:39:57.508975 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2292/4679] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:56 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 64 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:39:57.516575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-961cfce8-d3cb-4cea-9b03-a977430d022b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e55adfd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:57.516848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:57.547798 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f7a9e89a-3011-4a91-8bda-b5a32bd73316 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 1.022382 Aug 30 18:39:57.559531 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2388/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:56 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:39:57.589225 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-961cfce8-d3cb-4cea-9b03-a977430d022b tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.078881 Aug 30 18:39:57.595759 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2293/4681] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:57 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 64 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:57.627157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06b01f91-9d1b-4715-bbee-328ecae2baee tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e56e66280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:57.728031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-06b01f91-9d1b-4715-bbee-328ecae2baee tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:57.736912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-06b01f91-9d1b-4715-bbee-328ecae2baee tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:58.549527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06b01f91-9d1b-4715-bbee-328ecae2baee tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.947745 Aug 30 18:39:58.550724 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2389/4682] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:57 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:58.562178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73573966-8d8c-4626-9f5e-9b92c2b881ed tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update', calling method: .version_select at 0x7f4e5594b1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:58.578303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:58.579330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:39:58.588316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.589215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.589741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.590594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:39:58.592049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:39:58.592738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:39:58.650579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-73573966-8d8c-4626-9f5e-9b92c2b881ed tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:58.663798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-73573966-8d8c-4626-9f5e-9b92c2b881ed tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:59.233391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73573966-8d8c-4626-9f5e-9b92c2b881ed tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.676310 Aug 30 18:39:59.234629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2294/4683] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Aug 30 18:39:58 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata/os_version => generated 31 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:39:59.246530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-adf0d1d4-3ddc-4c76-ae1c-54673a310950 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e55952f70>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:39:59.346426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-adf0d1d4-3ddc-4c76-ae1c-54673a310950 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 58 microversion: 2.1 time: 0.104304 Aug 30 18:39:59.347997 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2295/4684] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:39:59 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 58 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:39:59.367278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba130ffb-f729-4dba-b912-6a914b6760c2 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'update_all', calling method: .version_select at 0x7f4e55962310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:39:59.495844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ba130ffb-f729-4dba-b912-6a914b6760c2 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:39:59.518202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ba130ffb-f729-4dba-b912-6a914b6760c2 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:39:59.709172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:39:59.724291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2a0faddd-0632-4398-a1d8-40d9b2658dff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 1.151193 Aug 30 18:39:59.739571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2390/4685] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:39:58 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:00.068801 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba130ffb-f729-4dba-b912-6a914b6760c2 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712917 Aug 30 18:40:00.079354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c73e77bc-5c84-4dba-877d-44e317822a43 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Action: 'create', calling method: .version_select at 0x7f4e572074c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:00.080326 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2296/4686] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:39:59 2022] PUT /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 61 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:40:00.169292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c73e77bc-5c84-4dba-877d-44e317822a43 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:00.200328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c73e77bc-5c84-4dba-877d-44e317822a43 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Getting quotas for user 978097209a0c4e80a8143152dfc4c132 and project ec1110e7557642d8a24a0eaf70a43109. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:00.678107 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c73e77bc-5c84-4dba-877d-44e317822a43 tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "POST /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.602835 Aug 30 18:40:00.690509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2391/4687] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Aug 30 18:40:00 2022] POST /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 85 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:40:00.692240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3bf16a54-f121-419d-a8bb-b1c6aea6c0dd tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] Calling method '.version_select at 0x7f4e55adfd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:00.747630 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3bf16a54-f121-419d-a8bb-b1c6aea6c0dd tempest-ImagesMetadataTestJSON-297147858 tempest-ImagesMetadataTestJSON-297147858-project] 10.222.0.25 "GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.061955 Aug 30 18:40:00.759433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:00.759981 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2297/4688] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 18:40:00 2022] GET /compute/v2.1/images/16bcb143-629b-4e0b-82fa-7a7d3265e5fb/metadata => generated 85 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:40:00.761754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:00.805413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:00.807406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:00.812968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:00.819877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:00.824533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:00.825396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:01.461149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:01.469758 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba1e81c6-e138-4d24-a3dd-1b4605fea839 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 0.714139 Aug 30 18:40:01.477428 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2392/4689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:00 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:01.720970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e064158-7b97-4175-9fc7-7bad990e3453", "name": "network-vif-plugged", "status": "completed", "tag": "4aea18c5-1954-4f2f-b975-5a83734f4234"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:01.733588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:01.740456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:01.741117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:01.762654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:01.775346 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] Creating event network-vif-plugged:4aea18c5-1954-4f2f-b975-5a83734f4234 for instance 5e064158-7b97-4175-9fc7-7bad990e3453 on n-h2-854119-10 Aug 30 18:40:01.782704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a7ac059a-32d8-4abf-b440-9813e74a40b4 req-f0573844-f7c3-4c75-bae9-3fe78437f501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065661 Aug 30 18:40:01.783877 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2298/4690] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:02.500060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:02.500686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:02.515246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:02.528773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:02.529520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:02.530537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:02.531345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:02.532087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:02.595133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:02.674999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:02.675814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:02.687018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:02.751401 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] Creating event network-changed:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:40:02.767235 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-867520c5-81ca-4ade-8f5a-698b27054ee3 req-d56c4309-1291-4111-8fc8-5793cd343152 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181795 Aug 30 18:40:02.768267 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2299/4691] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:03.212022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:03.224324 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6479f45d-f922-4381-8af6-6be468b7ea4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1202 microversion: 2.1 time: 0.730191 Aug 30 18:40:03.230111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2393/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:02 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1202 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:04.254815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:04.255548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:04.279738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:04.280294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:04.280752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:04.285684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:04.288310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:04.288785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:05.330592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:05.348941 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4335284b-976a-4a38-8380-6acbf6b755f5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1388 microversion: 2.1 time: 1.091762 Aug 30 18:40:05.363262 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2300/4693] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:04 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1388 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:05.384289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: .version_select at 0x7f4e56b71f70>, body: {"keypair": {"name": "tempest-keypair-1217432439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWxU5mIZ+dfF10q7LOLo3gK+YG9sM8McvzDtH6jqUtqWQDRnVl2zIWEjZJmWl382QSilJRsYzWgJkAduCarzflMc2CnC1ifoGhRLSChHYGlCIFHWuw1EtPHpunaaepzIg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:05.392947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:05.396191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:05.433764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:05.435247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:05.440136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:05.444782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:05.449151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:05.452757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:05.482759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for project 2522b169d5b64fee93202209eff67c97. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:05.507891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for user 219c93f311cb4768a65b9aedaf63e2a2 and project 2522b169d5b64fee93202209eff67c97. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:05.596626 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:40:05.969940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:06.009151 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f50cacb9-1506-4f94-b948-b0cfbf01ee45 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1388 microversion: 2.1 time: 0.638423 Aug 30 18:40:06.014980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2301/4694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:05 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1388 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:06.052818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:06.054220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:06.065142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:06.066585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:06.067572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:06.069120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:06.070192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:06.071633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:06.609029 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58882. Aug 30 18:40:06.647205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:06.667810 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd2f6613-5a33-4f84-822a-92ff8027f082 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 2.087127 Aug 30 18:40:06.669592 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2394/4695] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:40:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2093 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:40:06.689660 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e40db28-51ae-4ac6-bdc5-dd94903469c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1388 microversion: 2.1 time: 0.643784 Aug 30 18:40:06.719448 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2302/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:06 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1388 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:06.884445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:06.886334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:06.905802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:06.907610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:06.908147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:06.909549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:06.912674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:06.913231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:07.020511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:40:07.259394 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d471647-fca7-45e2-8ff7-be63886a5708 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 204 len: 0 microversion: 2.1 time: 0.378533 Aug 30 18:40:07.261771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2395/4697] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:40:06 2022] DELETE /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:40:07.271020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:07.272087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:07.288536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:07.291281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:07.292057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:07.293883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:07.296918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:07.298168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:08.282266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:08.309143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b84881da-8181-48e6-823e-ffcd08507e7b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1394 microversion: 2.1 time: 1.042484 Aug 30 18:40:08.328772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2303/4698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:07 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1394 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:09.340720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:09.342884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:09.376814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:09.377996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:09.380669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:09.381900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:09.383468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:09.385616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:09.714303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4e19719-6836-47b5-83b9-2b8488b1d7d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55954280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:09.763772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=24 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:09.819347 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4e19719-6836-47b5-83b9-2b8488b1d7d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3" status: 200 len: 660 microversion: 2.1 time: 0.111966 Aug 30 18:40:09.821375 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2304/4699] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:09 2022] GET /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3 => generated 660 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:09.837627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-168f5c48-02d6-4055-992b-b9abd08c481b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559cf3a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:09.924867 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-168f5c48-02d6-4055-992b-b9abd08c481b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3" status: 200 len: 660 microversion: 2.1 time: 0.091633 Aug 30 18:40:09.928283 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2305/4700] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:09 2022] GET /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3 => generated 660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:10.573904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:10.591189 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1008748-6a3e-41c9-99ff-59c418b4792d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1394 microversion: 2.1 time: 1.258446 Aug 30 18:40:10.599176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2396/4701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:09 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1394 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:11.530569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1595933815", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef985d86-0ffd-4a51-95e8-4bca74e6cc2c"}], "security_groups": [{"name": "tempest-securitygroup--312294069"}], "key_name": "tempest-keypair-1217432439", "user_data": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:11.620007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:11.626958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:11.655603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:11.656111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:11.656549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:11.677779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:11.678481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:11.678946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:11.776410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] validate_networks() for [('ef985d86-0ffd-4a51-95e8-4bca74e6cc2c', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:40:12.075192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:12.098069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acd60da5-6ab6-41ed-b948-f419f55832da tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1352 microversion: 2.1 time: 0.473989 Aug 30 18:40:12.098607 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2397/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:11 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1352 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:12.818306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fff0ff12-6988-48db-a448-fbbdeee0ac37 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Action: 'create', calling method: .version_select at 0x7f4e5aee58b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-50597129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcMfTBrzFKlFcn39E8IYdtfoMY+P7jVZ0gorpNWdFvM9xcxVMHzXdXZk8RBA0xF+dhuokhrFq1O9QQvVPrUHdnlOxS5ZVLnDutsg5kcRbvBQv/stixcZ5kdzewfec16ow=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:12.867182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fff0ff12-6988-48db-a448-fbbdeee0ac37 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for project 17aa20801b2a4948a6820565bffd97c5. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:12.888101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fff0ff12-6988-48db-a448-fbbdeee0ac37 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for user 83e04bc3c5824c62b4ad1a1c309912fb and project 17aa20801b2a4948a6820565bffd97c5. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:12.966163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fff0ff12-6988-48db-a448-fbbdeee0ac37 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.756986 Aug 30 18:40:12.966962 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2398/4703] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:40:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:12.980434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e064158-7b97-4175-9fc7-7bad990e3453", "name": "network-vif-deleted", "tag": "4aea18c5-1954-4f2f-b975-5a83734f4234"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:12.993988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:12.994764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:12.995374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:13.010049 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] Creating event network-vif-deleted:4aea18c5-1954-4f2f-b975-5a83734f4234 for instance 5e064158-7b97-4175-9fc7-7bad990e3453 on n-h2-854119-10 Aug 30 18:40:13.017235 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b77a5cf-f0c9-4003-8b7c-15ce4a4fd915 req-bfb02db2-de8a-4fc8-a836-c0f7027f4ace service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040829 Aug 30 18:40:13.017814 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2399/4704] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:13.033433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-663d52f5-49fc-45f9-8207-ab4e4809c720 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e58d05f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:13.132505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-663d52f5-49fc-45f9-8207-ab4e4809c720 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55" status: 200 len: 661 microversion: 2.1 time: 0.096456 Aug 30 18:40:13.134324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2400/4705] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:13 2022] GET /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55 => generated 661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:13.156646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:13.159132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:13.183230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:13.183871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:13.185304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:13.187175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:13.188598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:13.189134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:13.250230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:40:13.250803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:40:13.251391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:40:13.251893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:40:13.252405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:40:13.273814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:13.276274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:13.276848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:13.277817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:13.279777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:13.282245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:13.312044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for project 2522b169d5b64fee93202209eff67c97. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:13.321275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for user 219c93f311cb4768a65b9aedaf63e2a2 and project 2522b169d5b64fee93202209eff67c97. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:13.347133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:40:13.353773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:40:13.514300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-744568ee-d5d7-47eb-99fc-d17d223cc583 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.992344 Aug 30 18:40:13.517278 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2306/4706] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:40:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:40:13.532640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48053af7-10fa-4ce5-a56d-d45454ed3b07 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56f9e790>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:13.625506 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48053af7-10fa-4ce5-a56d-d45454ed3b07 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55" status: 200 len: 661 microversion: 2.1 time: 0.103657 Aug 30 18:40:13.627672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2307/4707] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:13 2022] GET /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55 => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:13.639422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:13.642994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:13.775848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:13.803445 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd1c8265-0d3c-4bb9-8295-a79365b86e9d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.659590 Aug 30 18:40:13.818126 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2401/4708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:13 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:13.848798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:13.893033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:13.895611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:13.914217 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03c4776f-ed9f-43ed-ae62-a8b11fbb6f20 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1282 microversion: 2.20 time: 0.283993 Aug 30 18:40:13.916619 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2308/4709] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:13 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:14.825578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:14.826585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:14.864336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:14.864849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:14.865296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:14.866025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:14.866514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:14.866948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:14.943796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:14.945198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:14.993074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:14.993712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:14.994171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:14.998808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:15.002179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:15.003837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:15.084503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:15.089279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:15.102785 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be3dc2fd-5aa7-492c-983e-d5fd34704c09 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.273817 Aug 30 18:40:15.113790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2402/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:14 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:15.196701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:15.214936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:15.218360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:15.219599 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59611e7b-1c74-4045-bbd4-ebf1304f600f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1278 microversion: 2.20 time: 0.280671 Aug 30 18:40:15.220201 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2309/4711] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:14 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:40:15.791323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c40d30d-61de-4854-be81-1ac2d14fda04 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55b76f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:15.875742 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c40d30d-61de-4854-be81-1ac2d14fda04 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7" status: 200 len: 662 microversion: 2.1 time: 0.090934 Aug 30 18:40:15.880969 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2403/4712] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:15 2022] GET /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:15.892075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cffa0dad-8780-4500-94c0-877f4f10a2ce tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55a1c4c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:15.949508 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cffa0dad-8780-4500-94c0-877f4f10a2ce tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7" status: 200 len: 662 microversion: 2.1 time: 0.062895 Aug 30 18:40:15.957231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2310/4713] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:15 2022] GET /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7 => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:16.129749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:16.130520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:16.170044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.171120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.171576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.174731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.189055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.189055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.195557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1598368520", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:16.289497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] validate_networks() for None {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:40:16.398131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:16.408070 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dffa60e9-4c58-4fd8-9ea7-eb3088f9aa39 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.284288 Aug 30 18:40:16.427161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2404/4714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:16 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:16.438376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:16.440337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:16.470223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.470791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.471239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.471996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:16.472626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:16.483163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:16.741391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:16.750329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:16.752021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:16.753408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-961870f6-6243-4916-88a4-6c42c0a2537a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1340 microversion: 2.20 time: 0.325124 Aug 30 18:40:16.754116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2405/4715] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:16 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1340 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:17.277323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:40:17.278011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:40:17.278273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:40:17.278724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:40:17.279149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:40:17.316038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.316551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.317147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.317899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.334876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.335355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.448522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:17.449145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:17.461449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.465206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.465717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.468662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.469148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.470047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.475763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Getting quotas for project a328425416b74131b7552d04e1c6d389. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:17.503946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Getting quotas for user 64511a61b3974110a40baf9343dbd1dc and project a328425416b74131b7552d04e1c6d389. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:17.537741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:40:17.540472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:40:17.605398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:17.678667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ce547e03-b6b9-4f0a-bbee-1da8ab5d0a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488230 Aug 30 18:40:17.685054 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2311/4716] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:40:17.771299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:17.777533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:17.778643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:17.787464 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-703fa3a8-2165-491f-ba96-dc2b17917d29 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.342764 Aug 30 18:40:17.789318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.792886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.798570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2406/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:17 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:17.800380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.806396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:17.812752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:17.813468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:17.953587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1070716112", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:17.974001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:17.984192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:17.986066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:17.987666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0cee8467-48d5-43a9-8976-1eceec992dbc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1340 microversion: 2.20 time: 0.214670 Aug 30 18:40:18.002055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2312/4718] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:17 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:18.083767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:40:18.821132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:18.821869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:18.841556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:18.846372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:18.847193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:18.849226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:18.851704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:18.855226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:19.433728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:19.443880 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e26bdcd5-2a59-4df5-a6d5-65f96da11a7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.627888 Aug 30 18:40:19.460860 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2313/4719] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:18 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:19.482322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:19.490760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:19.535891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:19.543966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:19.546420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:19.547233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:19.551959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:19.555004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:19.974843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:40:19.975323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:40:19.975742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:40:19.976320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:40:19.976886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:40:20.007937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:20.008662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:20.009805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:20.027769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:20.029310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:20.029937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:20.062467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Getting quotas for project a328425416b74131b7552d04e1c6d389. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:20.078524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Getting quotas for user 64511a61b3974110a40baf9343dbd1dc and project a328425416b74131b7552d04e1c6d389. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:20.110828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:40:20.113393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:40:20.211782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-300587a1-e596-47f3-8692-df2095367c9e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.262739 Aug 30 18:40:20.215224 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2407/4720] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:40:20.230510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-766f2261-7705-402b-bc5f-6e1fbf08b83c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:20.231120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-766f2261-7705-402b-bc5f-6e1fbf08b83c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:20.233116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:20.721508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-766f2261-7705-402b-bc5f-6e1fbf08b83c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:20.730225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-766f2261-7705-402b-bc5f-6e1fbf08b83c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1218 microversion: 2.1 time: 0.503775 Aug 30 18:40:20.735540 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2408/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:20 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1218 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:20.759396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:20.765116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:20.783445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:20.783957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:20.784493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:20.785227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:20.791118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:20.792844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:20.861949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:20.880009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:20.886658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:20.891656 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76565244-77fb-46a6-9c37-0c40404ac812 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 1.424355 Aug 30 18:40:20.895725 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2314/4722] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:19 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:21.158051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:21.190305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6367ca42-59d5-4d12-b0f1-fed28a5f0a01 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 0.451205 Aug 30 18:40:21.192032 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2409/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:20 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:21.769383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:21.769383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:21.785734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.791259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.791685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:21.794138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.794756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.795755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:21.919282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:21.919903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:21.947298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.947827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.948318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:21.950765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:21.951248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:21.951688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:22.148501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:22.165374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61fdcae1-bef2-4ff8-91c6-0b5694c587c2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1214 microversion: 2.1 time: 0.404222 Aug 30 18:40:22.166334 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2315/4724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:21 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1214 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:22.214099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:22.215199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:22.228325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:22.231390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:22.232746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:22.236691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:22.237377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:22.238586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:22.939353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:22.958222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:22.962849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:22.969479 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-015dc6f9-2c14-4969-a9de-a91a6ed3eef2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 1.055204 Aug 30 18:40:22.974270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2410/4725] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:21 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:40:23.189345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:23.190673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:23.205281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:23.206138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:23.220093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:23.223763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:23.226947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:23.229195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:23.376979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:23.403509 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ff19c7a-50a0-42cc-bd39-4ce897cfd209 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 200 len: 1187 microversion: 2.1 time: 1.187587 Aug 30 18:40:23.405896 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2316/4726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:22 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 1187 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:23.627888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:23.642040 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9a1e9c6-caaa-4ae3-9ec3-3c91b1a2b0eb tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1276 microversion: 2.1 time: 0.457685 Aug 30 18:40:23.649428 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2411/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:23 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1276 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:23.995030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:23.995818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:24.034018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.061403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.065411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.066527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.067783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.072422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.219517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:24.261777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.264610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.267066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.336948 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] Creating event network-changed:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h1-854119-10 Aug 30 18:40:24.367920 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-880a767e-ede0-464d-a45a-1454a455ec03 req-7929f608-bae4-4d2f-8e92-4cfe921c554a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331076 Aug 30 18:40:24.368947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2412/4728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:24.437370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:24.438776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:24.460142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.460655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.461106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.461875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.466771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.467406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.501133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 HTTP/1.1 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5e064158-7b97-4175-9fc7-7bad990e3453'} Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:24.506860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:40:24.512133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66a7747b-b536-4b22-9518-d45e54cc4b72 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 404 len: 111 microversion: 2.1 time: 0.084901 Aug 30 18:40:24.512986 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2413/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:24 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:40:24.673889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:24.674715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:24.689690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.690554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.691217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:24.692417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:24.698160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:24.699390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:25.023752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:25.036491 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-529529c8-8012-42fb-8ae1-f8a4803db5d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1276 microversion: 2.1 time: 0.366971 Aug 30 18:40:25.040757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2414/4730] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:24 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1276 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:26.036728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:26.049898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:26.059351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:26.061242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:26.061854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:26.069165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3cc7d112-6c04-47a9-95f6-176373f7aa77 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 2.070396 Aug 30 18:40:26.071199 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2317/4731] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:23 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:26.080517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:26.081085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:26.081519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:26.082242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:26.082718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:26.083136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:26.404037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:26.412664 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cfcddcae-4056-4866-b0d8-8f69b1ec20cd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1276 microversion: 2.1 time: 0.355269 Aug 30 18:40:26.434748 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2415/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:26 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1276 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:27.100044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:27.100817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:27.115580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:27.116093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:27.119016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:27.120035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:27.123590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:27.124481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:27.376981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:27.443589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:27.444939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:27.473906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:27.480028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:27.485132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:27.489965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:27.490737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:27.491886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:27.515325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=14 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:27.713510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:27.729773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-264f019d-f667-49bf-a59b-6c91f8f3dcbc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1276 microversion: 2.1 time: 0.293424 Aug 30 18:40:27.733542 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2416/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:27 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:28.052869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ac8983-5cb0-4de0-af01-ce52479d1d18"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:28.055708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:28.078580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:28.078580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:28.080968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:28.084873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:28.085403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:28.085862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:28.348001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:28.383117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:28.390302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:28.396096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74fd5b1a-1d29-4972-8a32-471d12432745 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 1.300166 Aug 30 18:40:28.397711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2318/4734] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:27 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:28.755817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:28.756627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:28.779960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:28.784364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:28.785745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:28.792484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:28.796207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:28.799497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:29.482359 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-46ab09cc-79b5-4d8a-a5e0-c398569d4fe1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.434379 Aug 30 18:40:29.486768 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2417/4735] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:40:28 2022] POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 194 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:29.518882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:29.521841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:29.544479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:29.546550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:29.547192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:29.552448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:29.555365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:29.555974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:30.045014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:30.287282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:30.301761 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d3ad10d2-c3c6-4963-8261-b01f698b8085 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 1.548806 Aug 30 18:40:30.319924 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2319/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:28 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:30.685103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:30.685948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:30.697750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:30.705540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:30.706445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:30.707528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:30.715410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:30.719036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:30.729433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=28 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:30.764773 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 HTTP/1.1 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5e064158-7b97-4175-9fc7-7bad990e3453'} Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:40:30.767611 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.772368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.781550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:40:30.782716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16506ea8-dc5e-4417-89cc-78374fffebc7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 404 len: 111 microversion: 2.1 time: 0.101722 Aug 30 18:40:30.786464 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2320/4737] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:40:30 2022] DELETE /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:40:30.810249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:30.811123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5e064158-7b97-4175-9fc7-7bad990e3453] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:30.832624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:30.833140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:30.833582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:30.834315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:30.834820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:30.835248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:30.904756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:30.918434 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 HTTP/1.1 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5e064158-7b97-4175-9fc7-7bad990e3453'} Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:40:30.920406 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 5e064158-7b97-4175-9fc7-7bad990e3453 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:40:30.924198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b7b0de3-a3cd-4272-b479-5a86fbaeaf31 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453" status: 404 len: 111 microversion: 2.1 time: 0.132038 Aug 30 18:40:30.926213 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2321/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:30 2022] GET /compute/v2.1/servers/5e064158-7b97-4175-9fc7-7bad990e3453 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:40:30.934247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:30.943728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:30.944949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96870005-9ba0-47c7-986b-46a1d1d95eb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 1.451044 Aug 30 18:40:30.960323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2418/4739] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:29 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:31.328730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:31.329685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:31.351251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:31.351737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:31.359261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:31.360289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:31.360916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:31.361349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:31.920410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:31.979334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:31.992688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:31.995437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:32.046417 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] Creating event network-changed:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:40:32.059959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d53aeeb0-a083-4ded-9eae-216cb47c0b15 req-1b942e29-238d-4f46-8a01-ff96d3caa731 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151446 Aug 30 18:40:32.061276 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2419/4740] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:32.070702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:32.071844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:32.081837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:32.082801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:32.083483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:32.085380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:32.086198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:32.087036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:32.952423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:32.977931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:32.983249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:32.992226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdfea055-d7ab-4cce-bbc1-4bbbb3880ed1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 0.929446 Aug 30 18:40:33.005518 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2420/4741] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:32 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:33.237515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:33.248112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=94 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:33.260841 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d060af2-28f5-4de5-a582-a081d9754f34 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 1.936831 Aug 30 18:40:33.261473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2322/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:31 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:33.680290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b546f0-bb05-46d4-a51f-dde507b7f266", "tag": "17a0f7b9-69d8-41c5-bd62-357d09003cf2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:33.708060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:33.708558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:33.709000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:33.739900 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] Creating event network-changed:17a0f7b9-69d8-41c5-bd62-357d09003cf2 for instance b5b546f0-bb05-46d4-a51f-dde507b7f266 on n-h1-854119-10 Aug 30 18:40:33.749545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-871b7bba-0d95-44b6-8812-d78207a51fa3 req-9b942139-fd79-424a-a22e-d2e28058b5a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074256 Aug 30 18:40:33.752320 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2421/4743] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:34.021059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:34.021729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:34.050294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:34.051236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:34.051888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:34.052803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:34.058111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:34.058873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:34.282576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:34.283895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:34.306107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:34.309536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:34.310042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:34.310846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:34.311326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:34.320087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:34.881761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:34.895529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:34.897338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:34.904355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd035c4e-722a-4d30-bdf2-6961eafc63c4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 0.887830 Aug 30 18:40:34.905216 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2323/4744] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:34 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:35.447279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:35.462206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a71b9cfd-4e06-40e7-bad6-92d9ed813c28 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 1.179163 Aug 30 18:40:35.462975 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2422/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:34 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:35.943003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:35.945204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:35.954140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:35.958574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:35.959580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:35.960690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:35.961610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:35.962287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:36.459971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "name": "network-vif-plugged", "status": "completed", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:36.483433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:36.486536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:36.489419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:36.531543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] Creating event network-vif-plugged:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h1-854119-10 Aug 30 18:40:36.545009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:36.554330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5e48a061-b196-45aa-9ee4-a61430748068 req-6861588f-996a-4aaa-ab12-d6d15736f199 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098946 Aug 30 18:40:36.562388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2423/4746] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:36.572508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:36.581777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:36.595673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:36.599862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:36.604103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88d43fe4-c219-4095-b7f8-043341f9cd95 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 0.675558 Aug 30 18:40:36.606773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:36.607743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:36.608391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:36.609436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:36.610113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:36.610721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:36.634630 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2324/4747] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:35 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:36.645719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:36.979736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:36.995702 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d0963a6-152c-4bbb-a61c-16dc339c6a7e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 0.429626 Aug 30 18:40:36.996319 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2424/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:36 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:37.631434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:37.632059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:37.648456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:37.654739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:37.657465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:37.658556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:37.659364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:37.661279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:38.024960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:38.028408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:38.070236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:38.070236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:38.080027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:38.080969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:38.081444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:38.085020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:38.422286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:38.435610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:38.438079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:38.439494 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-917c4d6b-23cb-4b41-a1de-d71fae05b7d1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1407 microversion: 2.20 time: 0.812855 Aug 30 18:40:38.441336 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2325/4749] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:37 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1407 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:38.448096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-965844980-access_point-629721155", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5b509a2d-ff76-45c6-b2dd-5f029c76d3ef"}], "key_name": "tempest-TestSecurityGroupsBasicOps-50597129", "security_groups": [{"name": "tempest-secgroup_access--886275994"}, {"name": "tempest-secgroup_general--1714714021"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:38.510162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:38.525041 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4610ac6-bba0-49f6-bc8c-a963a86050e7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 0.511925 Aug 30 18:40:38.537815 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2425/4750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:38 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:38.752656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] validate_networks() for [('5b509a2d-ff76-45c6-b2dd-5f029c76d3ef', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:40:39.475063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:39.477416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:39.492194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.492986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.503176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.508172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.509588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.511319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.753508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:40:39.754752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:40:39.755477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:40:39.756261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:40:39.756884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:40:39.776515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.776749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:39.779301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.780783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.783563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.784373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.786222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.789461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:39.792444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:39.794454 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c80e65ee-c98f-4ced-9a20-dcca9dc1a43b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1598 microversion: 2.20 time: 0.324847 Aug 30 18:40:39.795520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2426/4751] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:40:39 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1598 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:40:39.802961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:39.804051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:39.811890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.813227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.833896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for project 17aa20801b2a4948a6820565bffd97c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:40:39.844685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.850460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:39.851271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:39.851723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:39.867593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for user 83e04bc3c5824c62b4ad1a1c309912fb and project 17aa20801b2a4948a6820565bffd97c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:40:39.909933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:40:39.915405 n-d-854119-10 devstack@n-api.service[122590]: WARNING nova.utils [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-965844980-access_point-629721155 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-965844980-acc Aug 30 18:40:39.918637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:40:40.167025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12b5b64a-c2c1-4172-aba1-d0fec9243f70 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.724231 Aug 30 18:40:40.175307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2326/4752] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:40:38 2022] POST /compute/v2.1/servers => generated 457 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:40:40.195766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:40.199051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:40.222985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:40.225067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:40.225721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:40.232939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:40.236430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:40.246039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:40.410382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:40.430172 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e183df35-8db3-4ce6-88f8-a31683aee1b5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 0.626710 Aug 30 18:40:40.432388 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2427/4753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:39 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:40.444254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5788542d-012d-4e8e-855f-524cbe6896f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:40.446880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5788542d-012d-4e8e-855f-524cbe6896f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:40.521349 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e5aa746-dd5b-4f1b-aab7-f0555521c563 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.344505 Aug 30 18:40:40.522130 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2327/4754] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:40:40 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:40:40.660240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5788542d-012d-4e8e-855f-524cbe6896f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:40.670027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5788542d-012d-4e8e-855f-524cbe6896f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1291 microversion: 2.1 time: 0.236050 Aug 30 18:40:40.671236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2428/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:40 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1291 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:41.213680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b546f0-bb05-46d4-a51f-dde507b7f266", "name": "network-vif-plugged", "status": "completed", "tag": "17a0f7b9-69d8-41c5-bd62-357d09003cf2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:41.242106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:41.248498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:41.258080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:41.303054 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] Creating event network-vif-plugged:17a0f7b9-69d8-41c5-bd62-357d09003cf2 for instance b5b546f0-bb05-46d4-a51f-dde507b7f266 on n-h1-854119-10 Aug 30 18:40:41.315138 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c2ac5486-6f54-4c8c-9ae1-15dab99cd0d4 req-67e1c569-46ea-403c-910d-d2546694abcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477740 Aug 30 18:40:41.318847 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2328/4756] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:41.453934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:41.454957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:41.468058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:41.469784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:41.471431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:41.473736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:41.474470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:41.475132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:41.694791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:41.697639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:41.706282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:41.707429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:41.708924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:41.709875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:41.710662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:41.711408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:41.801793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:41.815704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ef4fec53-8e1d-4669-b5db-ad244c233646 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1287 microversion: 2.1 time: 0.126254 Aug 30 18:40:41.816855 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2329/4757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:41 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:42.670610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:42.697356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9189d1df-2535-450b-8346-e17000e54a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1318 microversion: 2.1 time: 1.246615 Aug 30 18:40:42.701512 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2429/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:41 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1318 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:42.838213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:42.839436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:42.854582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:42.856188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:42.857188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:42.859504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:42.860856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:42.872832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:43.025735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:43.037080 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfe4973d-b312-4fd6-ac80-e751f70a7cdd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1361 microversion: 2.1 time: 0.202605 Aug 30 18:40:43.053027 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2330/4759] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:42 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:43.385993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-plugged", "status": "completed", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:43.408844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:43.409332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:43.409770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:43.440245 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] Creating event network-vif-plugged:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:40:43.459274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8af866f5-ee0f-497a-b893-22de16786223 req-a5710e7a-e03e-4a42-a45e-3eb9be47ef8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076568 Aug 30 18:40:43.461066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2430/4760] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:43.721806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:43.723398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:43.742655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:43.744085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:43.744876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:43.745885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:43.746630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:43.747251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:44.064520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:44.065417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:44.094330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:44.094956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:44.095400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:44.101653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:44.102202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:44.106432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:44.150829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:44.164668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be79b3d4-e978-4c24-8809-4d51cce45a3e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1468 microversion: 2.1 time: 0.449539 Aug 30 18:40:44.165259 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2331/4761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:43 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:44.188367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:44.188995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:44.199996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:44.200498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:44.201120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:44.201838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:44.207755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:44.208483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:44.361011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:44.379439 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b11c9388-a2ee-440c-998a-7b8f7e915435 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1349 microversion: 2.1 time: 0.319655 Aug 30 18:40:44.381677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2431/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:44 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1349 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:44.546329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:44.569694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bdcb43ee-7ea9-431b-9371-6fdd0531b474 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1318 microversion: 2.1 time: 0.387129 Aug 30 18:40:44.596941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2332/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:44 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:45.132834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:45.151115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:45.153581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:45.154832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:45.203986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] Creating event network-changed:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h1-854119-10 Aug 30 18:40:45.247657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-dbd4a324-1986-46f9-8a0c-6997deca2ec4 req-0e72d8ce-ecd5-4c89-902f-6943d174376f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128002 Aug 30 18:40:45.251849 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2432/4764] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:45.412020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:45.412692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:45.428215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:45.437765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:45.439307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:45.448422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:45.452725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:45.459413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:45.618061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:45.619229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:45.639924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:45.639924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:45.639924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:45.651138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:45.652883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:45.657281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:46.481088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:46.491262 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb62bb6a-acdf-45df-90f1-1bce21e3e9bd tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 1.085939 Aug 30 18:40:46.509279 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2333/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:45 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:46.544753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:46.556843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca1952eb-7ed0-4051-9ccd-7ff95798aa83 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1468 microversion: 2.1 time: 0.943322 Aug 30 18:40:46.560318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2433/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:45 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1468 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:46.590941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1054222568"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:46.593719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:46.620654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:46.622570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:46.625448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:46.626487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:46.631811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:46.633447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:47.253528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2de7d0b4-dc17-482d-8706-708ea3f1aa26 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "POST /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2/action" status: 202 len: 0 microversion: 2.1 time: 0.671825 Aug 30 18:40:47.264376 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2334/4767] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:46 2022] POST /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:40:47.272993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2497ee8-0f4b-4e43-ad7c-ff28e8891ed6 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56d41b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:47.440574 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2497ee8-0f4b-4e43-ad7c-ff28e8891ed6 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.177895 Aug 30 18:40:47.451774 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2434/4768] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:47 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:47.469016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413b867c-6bf5-471e-ac66-4a895b18c0b3", "tag": "61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:47.513831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:47.514260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:47.522825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:47.523315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:47.524101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:47.525136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:47.525741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:47.540919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:47.547956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:47.553689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:47.563142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:47.581380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] Creating event network-changed:61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c for instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 on n-h2-854119-10 Aug 30 18:40:47.602391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c699de90-e9f1-4424-bd8c-ca0638fa61e3 req-e31679c5-e717-414c-92c8-c7902c6da909 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138175 Aug 30 18:40:47.605423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2335/4769] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:48.211606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:48.225051 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c46416c-9f6e-40f9-9a89-0863a91c517c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.713606 Aug 30 18:40:48.243047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2435/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:47 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:48.456972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39b72792-bbff-4c2e-9a43-9997243910e8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559625e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:48.550290 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39b72792-bbff-4c2e-9a43-9997243910e8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.097181 Aug 30 18:40:48.560154 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2336/4771] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:48 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:49.250439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:49.251071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:49.270294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:49.270851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:49.271297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:49.272138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:49.272607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:49.273059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:49.531286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:49.540982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a826fcc6-e975-47ed-80f5-31ded217d802 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.294641 Aug 30 18:40:49.541987 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2436/4772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:49 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:49.566656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-944bd593-8145-4969-9125-cc7caddd898c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596c940>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:49.641948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-944bd593-8145-4969-9125-cc7caddd898c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.080379 Aug 30 18:40:49.650259 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2337/4773] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:49 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:50.570142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:50.571701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:50.586648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=60 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.591001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:50.594509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:50.596972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:50.598252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:50.600737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:50.601763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:50.654059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.654883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.660644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4c998b2-8e5d-46e7-bc38-a1404009fa58 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55962dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:50.678748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:50.781293 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4c998b2-8e5d-46e7-bc38-a1404009fa58 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.127837 Aug 30 18:40:50.785002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2338/4774] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:50 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:51.515047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:51.532480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68968cf4-12df-4b89-a8f6-51da422c77fc tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.966876 Aug 30 18:40:51.540494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2437/4775] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:50 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:51.802082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c134ee9-c157-449d-bf96-d288bcb38a2f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5597e8b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:52.564260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:52.565109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:52.593635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:52.594326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:52.594695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:52.595474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:52.595989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:52.596432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:53.001955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:53.023088 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bc7eed00-1636-42a5-9c74-9733f0bc4786 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.462215 Aug 30 18:40:53.025982 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2438/4776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:52 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:53.703661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-plugged", "status": "completed", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:53.744239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:53.747034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:53.748526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:53.818331 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] Creating event network-vif-plugged:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:40:53.844173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-33085bfe-84eb-42f3-9a0d-3bf8f5550194 req-fed271f9-f20e-479c-bf9c-8812746e9293 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146073 Aug 30 18:40:53.851550 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2439/4777] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:40:54.073124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:54.076215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:54.101381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:54.104490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:54.106316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:54.107865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:54.110913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:54.114301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:54.765840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:54.804780 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ce8c8e2-8d8c-47bb-a952-bd021a4f3cf7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.745295 Aug 30 18:40:54.806170 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2440/4778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:54 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:40:55.748663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:55.752883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:55.773792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:55.774950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:55.774950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:55.775625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:55.777083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:55.778540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:55.832706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'flavor' on Instance uuid b5551131-3e02-4926-b3f9-d8b3acf37b62 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:40:56.164444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5167634c-7ae4-4e71-ab4b-8b1d1227fa39 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/action" status: 200 len: 32 microversion: 2.1 time: 0.420532 Aug 30 18:40:56.166697 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2441/4779] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:40:55 2022] POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:40:56.186924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:56.189642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:56.205344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.207828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.210887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.216296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.225497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.226869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.476274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:56.483010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:56.500367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fae8bbf3-4576-4f97-84d8-eba7e33103fe tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.332026 Aug 30 18:40:56.503773 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2442/4780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:56 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:56.511031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:56.512155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:56.535237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.538477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.545355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.546642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:56.549129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:56.550941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:56.936893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:56.953290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a005ff7-37c9-4bd8-b0b8-a9efec880450 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.439867 Aug 30 18:40:56.954014 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2443/4781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:56 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:57.305809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413b867c-6bf5-471e-ac66-4a895b18c0b3", "name": "network-vif-plugged", "status": "completed", "tag": "61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:40:57.336765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:57.337302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:57.337854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:57.388519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] Creating event network-vif-plugged:61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c for instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 on n-h2-854119-10 Aug 30 18:40:57.432952 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-040a43d3-db17-4099-987f-7ff46a8ca431 req-386a1fc0-bf9a-4bb9-a992-4849c28d900f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137511 Aug 30 18:40:57.434745 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2444/4782] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:40:57.477053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=61 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:57.530705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:57.531338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:57.546993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:57.548885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:57.565328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:57.570939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:57.571906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:57.574080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:57.577516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:40:58.003344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:58.018478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d54283be-9f0a-4a60-b9d4-0e8fc6f4f686 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.493114 Aug 30 18:40:58.027645 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2445/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:57 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:58.040983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:58.041602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:58.076992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:58.077305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:58.091068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:58.092384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:58.097566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:58.098294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:58.423539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:58.438370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01464ea0-dd13-45c0-b904-d36a5ff19494 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.408278 Aug 30 18:40:58.439581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2446/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:58 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:59.051044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:59.051693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:59.063247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.065565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.068466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.070173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.075826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.076366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.463509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:59.480900 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64070d51-0537-4311-aaf7-86df06eb2296 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1468 microversion: 2.1 time: 0.432635 Aug 30 18:40:59.481807 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2447/4785] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:59 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1468 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:40:59.509381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:40:59.510001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:40:59.532327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.532829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.533335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.538852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:40:59.541116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:40:59.541583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:40:59.829489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:40:59.848571 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83c35d4a-3137-4f21-a408-b91be3cdeb67 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.365415 Aug 30 18:40:59.849108 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2448/4786] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:40:59 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:00.507170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:00.509251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:00.521544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.525420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.526873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.531122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.534387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.535002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.732481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:00.743399 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ba7290b-f60e-4cc6-87d5-0cee8548e530 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1641 microversion: 2.1 time: 0.240868 Aug 30 18:41:00.745025 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2449/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:00 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1641 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:00.773233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:00.774493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:00.782415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.783206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.783792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:00.784872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:00.785739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:00.786366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:01.002313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:01.026433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c040e99-806d-487b-89dd-845c41ec8639 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1641 microversion: 2.1 time: 0.261632 Aug 30 18:41:01.027545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2450/4788] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:00 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1641 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:01.039451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:01.040904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:01.067214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:01.070279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:01.071402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:01.073124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:01.073657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:01.075122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:01.310070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:01.331669 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be371c3d-389a-4faa-9555-e9618c5f8fac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.302863 Aug 30 18:41:01.332948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2451/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:01 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:01.341554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:01.343583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:01.354495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:01.363613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:01.365627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:01.368936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:01.370729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:01.371359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:01.974528 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a6fa998-d099-469a-b029-f903939867d0 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1794 microversion: 2.1 time: 0.636718 Aug 30 18:41:01.976116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2452/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:01 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1794 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:02.360462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:02.361604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:02.388391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.388934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.389320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:02.390047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:02.390674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:02.391324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:03.312659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:03.339952 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd6e347a-0919-4c6c-a04d-642e7f8c82fc tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.981878 Aug 30 18:41:03.343019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2453/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:02 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:04.368919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:04.370933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:04.391059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.391912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.392737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:04.393855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:04.394655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:04.395358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:05.220215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:05.242005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd575252-9a86-4130-8793-115a2c261981 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.876829 Aug 30 18:41:05.244423 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2454/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:04 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:06.263707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:06.270666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:06.313609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:06.315084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:06.316299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:06.319104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:06.321564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:06.322268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:06.797223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:06.808051 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-060dc164-6f34-4fb3-9d2a-25a3933c7a7a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.548234 Aug 30 18:41:06.809254 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2455/4793] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:06 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:07.025663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413b867c-6bf5-471e-ac66-4a895b18c0b3", "tag": "61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:07.038523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:07.039019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:07.039511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:07.053008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] Creating event network-changed:61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c for instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 on n-h2-854119-10 Aug 30 18:41:07.062743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-94a5101d-1e15-4a33-b718-fab61a2d586b req-6563c6d8-2f7b-474a-9692-e322ba97e8aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040353 Aug 30 18:41:07.068594 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2456/4794] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:07.836540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:07.837989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:07.855892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:07.856402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:07.856851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:07.864038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:07.864569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:07.864979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:08.646261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:08.662106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a0c3248e-b7e8-45f1-ba44-3a8242a29d53 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.832374 Aug 30 18:41:08.674465 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2457/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:07 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:09.687637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:09.688277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:09.704559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:09.705618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:09.706230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:09.707149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:09.707761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:09.708350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:10.067422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:10.078655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3868e7bf-f64d-4f16-b15d-afd4e4cfe848 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.394791 Aug 30 18:41:10.079869 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2458/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:09 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:10.961793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c134ee9-c157-449d-bf96-d288bcb38a2f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 19.165848 Aug 30 18:41:10.963212 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2339/4797] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:40:51 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 19168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:11.105388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:11.109135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:11.127242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:11.128389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:11.129298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:11.131266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:11.132227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:11.132882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:11.511146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:11.527256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d2e3e019-41d1-4fee-8386-a87bddf2d684 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.429031 Aug 30 18:41:11.529361 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2459/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:11 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:11.978742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-93750a83-bacc-4f1b-a0d9-c435e9958d8e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596c310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:12.109095 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-93750a83-bacc-4f1b-a0d9-c435e9958d8e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.134562 Aug 30 18:41:12.111062 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2340/4799] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:11 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:12.572836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:12.578804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:12.627419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:12.630825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:12.631668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:12.632587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:12.633065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:12.633686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:13.125422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9389a6ce-7b6a-4fcc-9dea-6958e035dcb0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55965b80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:13.137411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:13.141977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:13.153198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a792dc43-5fe8-4002-bf00-a4d73040da43 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.602162 Aug 30 18:41:13.172830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2460/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:12 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:13.244462 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9389a6ce-7b6a-4fcc-9dea-6958e035dcb0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.123592 Aug 30 18:41:13.257501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2341/4801] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:13 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:14.177128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:14.178593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:14.207446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:14.208329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:14.209010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:14.211261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:14.213324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:14.215122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:14.264563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2209040-7eb6-4b5f-b6a3-822dce67d0e3 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596cd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:14.373930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2209040-7eb6-4b5f-b6a3-822dce67d0e3 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1455 microversion: 2.1 time: 0.113225 Aug 30 18:41:14.374644 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2342/4802] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:14 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:14.569913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:14.588724 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c98ee406-1c99-49fc-a1e7-089d6e06bfcb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.408590 Aug 30 18:41:14.592247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2461/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:14 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:14.762294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:14.763261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:14.776353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:14.777145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:14.777744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:14.778686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:14.779878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:14.780860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:14.811008 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ff83771-fb92-4219-9262-60a28efbc496 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/ips" status: 200 len: 150 microversion: 2.20 time: 0.052575 Aug 30 18:41:14.831191 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2343/4804] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Aug 30 18:41:14 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:41:15.393156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-834a4cd3-aea1-4582-96db-730439a74a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5aec09d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:15.507893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-834a4cd3-aea1-4582-96db-730439a74a11 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1464 microversion: 2.1 time: 0.119093 Aug 30 18:41:15.508540 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2462/4805] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:15 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1464 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:15.522184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-615f881f-ba21-4657-8ea4-4e8724bbd6f7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5590e550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:15.618059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:15.620264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:15.633135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-615f881f-ba21-4657-8ea4-4e8724bbd6f7 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 200 len: 1464 microversion: 2.1 time: 0.114632 Aug 30 18:41:15.634010 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2344/4806] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:15 2022] GET /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 1464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:15.656268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.656775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.657229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:15.658090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.662582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:15.663238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:15.666867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.667343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:15.692623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.693256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.696472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:15.700257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:15.703560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:15.705285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:16.270894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:16.308366 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b9616b2-0896-495f-914e-8fab7ec89726 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1468 microversion: 2.1 time: 0.661538 Aug 30 18:41:16.313586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:16.331753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28977bdb-2200-49ce-bb52-6fcce2bd2783 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.718061 Aug 30 18:41:16.332823 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2463/4807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:15 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:16.346034 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2345/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:15 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1468 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:16.382124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-93776129"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:16.388946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:16.405524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:16.406291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:16.406858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:16.407683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:16.408203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:16.408859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:16.749259 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56a43ce0-3d60-451a-9b4d-e82a6aeb10d9 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "POST /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266/action" status: 202 len: 0 microversion: 2.1 time: 0.387594 Aug 30 18:41:16.750430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2464/4809] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:16 2022] POST /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:41:16.764883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1335712f-5cea-411a-aa86-ab60f8d5d1b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55a3a550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:16.835528 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1335712f-5cea-411a-aa86-ab60f8d5d1b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.078246 Aug 30 18:41:16.836351 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2346/4810] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:16 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:17.379938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:17.380738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:17.390628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:17.391348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:17.392010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:17.392900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:17.393582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:17.394169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:17.730940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:17.747442 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58a8bfe7-8c60-416b-b2b6-acc0be913c28 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.374479 Aug 30 18:41:17.748260 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2465/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:17 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:17.853295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f02f631-2a8e-432b-94a1-300275292d13 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55962af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:17.926109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f02f631-2a8e-432b-94a1-300275292d13 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.077772 Aug 30 18:41:17.927254 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2347/4812] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:17 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:18.480323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:18.480894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:18.490567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.491294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.491910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.492804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.493415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.494276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.521573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lazy-loading 'flavor' on Instance uuid 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:41:18.772228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:18.773252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:18.788174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.790761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.793409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.795533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.796706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.798829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.892965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd3b32b4-c34e-4e01-a53e-738e1abba981 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/action" status: 202 len: 0 microversion: 2.20 time: 0.439016 Aug 30 18:41:18.893730 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2466/4813] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:41:18 2022] POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:41:18.919805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:18.920523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:18.970473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.971114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.971557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:18.972280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:18.972733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:18.973155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:19.098414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:19.109387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dbf4812-c39c-48bf-b924-9d32f07f7cfa tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.342480 Aug 30 18:41:19.122865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2348/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:18 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:19.129321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86e05746-6ebe-497a-9db0-4128485e8704 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55962040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:19.195521 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86e05746-6ebe-497a-9db0-4128485e8704 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.071376 Aug 30 18:41:19.201915 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2349/4815] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:19 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:19.225459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-unplugged", "status": "completed", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:19.255144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:19.255632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:19.256065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:19.303564 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] Creating event network-vif-unplugged:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:41:19.311068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f0eefba6-0a5d-4192-b93b-1144afa7ebf4 req-f382d06f-2a39-460b-9334-3e069aebfecc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099626 Aug 30 18:41:19.316599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2350/4816] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:19.362457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:19.372497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:19.374130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:19.375880 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61f32be7-396a-4fe7-bbfb-af01f84f61cc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.467342 Aug 30 18:41:19.393898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2467/4817] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:18 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:20.135955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:20.136796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:20.146772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.147645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.148279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.150514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.151155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.152080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.216324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-541f8768-2808-42f5-8acc-4e9742894a0b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56d799d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:20.335770 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-541f8768-2808-42f5-8acc-4e9742894a0b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.123322 Aug 30 18:41:20.343509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2468/4818] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:20 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:20.401901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:20.402768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:20.419374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.420283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.420921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.421865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:20.422623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:20.423333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:20.570641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:20.591213 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0575f413-adc4-4978-bf01-6595e01e83e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.456039 Aug 30 18:41:20.591905 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2351/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:20 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:20.857855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:20.902489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:20.904157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:20.905517 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b2e1caf-a81a-4435-949b-1989f525769c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.508144 Aug 30 18:41:20.918451 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2469/4820] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:20 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:41:21.357735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff39713a-86ac-48a3-8c78-c448198df088 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5595faf0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:21.470773 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff39713a-86ac-48a3-8c78-c448198df088 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.117401 Aug 30 18:41:21.471370 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2352/4821] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:21 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:21.618958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:21.619578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:21.622634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=62 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:21.655836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.656327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.656766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:21.657547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.668472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.669124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:21.961478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:21.962531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:21.975451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.976250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.977595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:21.978560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:21.979187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:21.979772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:22.077005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:22.140923 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e4e7ec6-2a6d-42a7-80b3-901c65445918 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.526926 Aug 30 18:41:22.141540 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2470/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:21 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:22.196330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:22.207103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:22.208859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:22.210909 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be226e62-1693-418d-bf71-ec076da72c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.255438 Aug 30 18:41:22.211991 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2353/4823] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:21 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:22.466373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b546f0-bb05-46d4-a51f-dde507b7f266", "name": "network-vif-plugged", "status": "completed", "tag": "17a0f7b9-69d8-41c5-bd62-357d09003cf2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:22.485185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d632e274-086e-4656-b3e8-a165d16ff04f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5595f5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:22.503840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:22.504802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:22.505398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:22.553956 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] Creating event network-vif-plugged:17a0f7b9-69d8-41c5-bd62-357d09003cf2 for instance b5b546f0-bb05-46d4-a51f-dde507b7f266 on n-h1-854119-10 Aug 30 18:41:22.566672 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a2998977-87db-4d30-b586-d139d575b17d req-2455370b-a815-41bf-bbe9-0f79a626ad07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102881 Aug 30 18:41:22.579358 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d632e274-086e-4656-b3e8-a165d16ff04f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.097977 Aug 30 18:41:22.593902 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2354/4824] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:22 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:22.594761 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2471/4825] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:23.168295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:23.169161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:23.202868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.205422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.207571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.210038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.211678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.214789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.244718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:23.249738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:23.276348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.277307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.280741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.283998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:23.284501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:23.284952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:23.545552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:23.561370 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cf5bdd4f-6761-48f3-ac3f-5bec53a23716 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.397467 Aug 30 18:41:23.563163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2355/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:23 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:23.598755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75df5975-589c-48ff-a50b-b17d3c6598be tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5594b550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:23.684421 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75df5975-589c-48ff-a50b-b17d3c6598be tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.093046 Aug 30 18:41:23.692124 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2356/4827] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:23 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:23.792518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:23.806614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:23.808682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:23.810756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a006531f-aa6a-40e0-9fd1-481a80232d80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.576543 Aug 30 18:41:23.812059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2472/4828] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:23 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:24.599246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:24.600208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:24.608291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:24.609059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:24.609514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:24.610250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:24.610985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:24.611649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:24.700103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c316770-8581-475d-8335-896c167ec45a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56b66a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:24.867701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c316770-8581-475d-8335-896c167ec45a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.173000 Aug 30 18:41:24.868500 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2473/4829] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:24 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:24.881388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1562503569", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8b024670-c718-4af4-a9b3-aeb3e3f2dee3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:25.012551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.046981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7137173-0061-46ee-ae05-ce97b5d63675 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.465686 Aug 30 18:41:25.047592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2357/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:24 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:25.056726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:25.057340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:25.089731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:25.090238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:25.093582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:41:25.099876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:25.100838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:25.101328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:25.101765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:25.389848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.415439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.432406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:25.434961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e004208-f937-488b-b087-19b1b23a02b0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.384593 Aug 30 18:41:25.437407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2358/4831] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:25 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:25.897429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfb25414-19dd-40a2-9f3b-5c9ad1d08d39 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55954040>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:26.072847 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfb25414-19dd-40a2-9f3b-5c9ad1d08d39 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.189443 Aug 30 18:41:26.079668 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2359/4832] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:25 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:26.098038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:26.115483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:26.130664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.131416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.132002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.133060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.133659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.134977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.188882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:41:26.190170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:41:26.191880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:41:26.192465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:41:26.193021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:41:26.221102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.222326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.223370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.228204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.232111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.232775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.283836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:41:26.299491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:41:26.441157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:41:26.445274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b024670-c718-4af4-a9b3-aeb3e3f2dee3',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:41:26.550205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:26.587509 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba011ce1-c877-429b-9583-cbc7ef9ab986 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.501259 Aug 30 18:41:26.588484 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2360/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:26 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:26.610843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:26.617500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:26.648721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.662934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.671424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.672458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:26.673002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:26.674141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:26.901678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13e084b8-4d25-4fdf-8876-40e34d7df2f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.031857 Aug 30 18:41:26.912301 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2474/4834] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:41:26.945770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-abaec1e7-f62e-41c5-94cc-bab5486f2bbf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:26.946431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-abaec1e7-f62e-41c5-94cc-bab5486f2bbf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:27.085560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.129955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.145624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.154002 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0500091b-74fc-4db5-849c-d73d4a684b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.557914 Aug 30 18:41:27.154845 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2361/4835] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:26 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:27.180820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-725fdf1f-24ad-4669-b4aa-5064e0c6339e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5597e700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:27.293263 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-725fdf1f-24ad-4669-b4aa-5064e0c6339e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.133430 Aug 30 18:41:27.294173 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2362/4836] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:27 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:27.616761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:27.617427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:27.637155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:27.640110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:27.640565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:27.641385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:27.641996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:27.642275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:27.941195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.947263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-abaec1e7-f62e-41c5-94cc-bab5486f2bbf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:27.998551 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-abaec1e7-f62e-41c5-94cc-bab5486f2bbf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1071 microversion: 2.1 time: 1.084354 Aug 30 18:41:28.016187 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7ae2f01-001d-4d62-bbb2-25e4c316e8e1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.404674 Aug 30 18:41:28.030884 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2475/4837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:26 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1071 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:28.038061 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2363/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:27 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:28.185328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:28.186314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:28.208771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:28.211668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:28.212432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:28.213985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:28.218300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:28.219420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:28.309074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15e3e892-26c7-498b-a87f-9becf43a909f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55962af0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:28.451069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15e3e892-26c7-498b-a87f-9becf43a909f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.145745 Aug 30 18:41:28.452181 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2364/4839] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:28 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:28.664892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:28.681308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:28.683070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:28.684348 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2df7a618-da3e-486e-9537-be5fb6d5583b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.503591 Aug 30 18:41:28.705517 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2476/4840] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:28 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:29.019955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:29.020568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:29.037788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:29.039138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:29.041242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.042861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.043456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:29.044892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.045503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.046269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:29.057242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.061352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.062114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:29.063835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.064637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.066903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:29.235105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:29.268441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-00708c57-e08e-48d1-b774-db3e1073e684 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1169 microversion: 2.1 time: 0.252713 Aug 30 18:41:29.282965 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2365/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:29 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1169 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:29.381745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:29.390796 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9003facf-9783-4b15-a226-c1ee11ab3a71 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.357275 Aug 30 18:41:29.413362 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2477/4842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:29 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:29.468850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35ca74f2-84a8-4ecc-aa6c-17ab90769b5c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596c160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:29.603578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-35ca74f2-84a8-4ecc-aa6c-17ab90769b5c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.129577 Aug 30 18:41:29.604350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2366/4843] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:29 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:29.712381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:29.712892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:29.746368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.747457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.748245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:29.749550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:29.750281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:29.756335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:30.295084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:30.295850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:30.315644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:30.316057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:30.316500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:30.317226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:30.317685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:30.318120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:30.402791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:30.422813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:30.434634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:30.436013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b9054af-7445-4eb1-9a92-49e4eeba4188 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.727808 Aug 30 18:41:30.446756 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2478/4844] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:29 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:30.468165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:30.473119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:30.494142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:30.494643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:30.495105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:30.495105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:30.495816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:30.496273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:30.496701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:30.504532 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87b2e60f-367a-42ad-bc4c-4aeded563cf6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1187 microversion: 2.1 time: 0.214645 Aug 30 18:41:30.510184 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2367/4845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:30 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1187 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:30.563283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:30.618625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a887fd5a-8909-4bd7-9239-22b13d99d785 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5595c670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:30.711843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a887fd5a-8909-4bd7-9239-22b13d99d785 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.097172 Aug 30 18:41:30.712905 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2368/4846] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:30 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:31.484691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:31.487572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:31.511884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:31.513724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:31.514689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:31.516328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:31.517434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:31.518364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:31.834840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:31.863848 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11a5fbca-1697-420d-af1c-1311448e0530 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 1.415239 Aug 30 18:41:31.866860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2479/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:30 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:31.883545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:31.887685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:31.912227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:31.913416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:31.914522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:31.915906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:31.923707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:31.927468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:32.125197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:32.135543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:32.153251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:32.154561 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-270694e7-d04e-4dc4-8a81-f329185a26cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.694147 Aug 30 18:41:32.155162 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2369/4848] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:31 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:32.198126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-865c9c3d-8caf-4dbf-a1b5-a7f51139cf7d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596cb80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:32.285178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-865c9c3d-8caf-4dbf-a1b5-a7f51139cf7d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.121516 Aug 30 18:41:32.286028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2370/4849] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:32 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:32.776429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:32.793644 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e23eb675-d66f-4cec-b47c-93a797b20d0a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 0.924867 Aug 30 18:41:32.807396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2480/4850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:31 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:32.892920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:32.894102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:32.911366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:32.914714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:32.915551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:32.921698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:32.923282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:32.925252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:33.198201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:33.199109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:33.215966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:33.224142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:33.229787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:33.230901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:33.231818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:33.234035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:33.340727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:33.363573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1fa087d-9f64-49d6-ae0c-7a7e78fd6bc7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.467840 Aug 30 18:41:33.364571 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2371/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:32 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:33.372685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a5f4478-0038-41fc-83be-8c7a5bc3e366 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596cd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:33.478672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a5f4478-0038-41fc-83be-8c7a5bc3e366 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.112857 Aug 30 18:41:33.486729 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2372/4852] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:33 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:33.754233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:33.763750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:33.770780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:33.773506 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f369d1c8-4ec6-4972-8b40-c2810c3afeb6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.587185 Aug 30 18:41:33.775990 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2481/4853] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:33 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:33.842688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:33.842957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:33.878123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:33.901592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:33.902455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:33.905248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:33.911342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:33.912453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.318009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:34.334844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-94eb6eaa-97b1-4743-b43a-49c5535602c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 0.507202 Aug 30 18:41:34.357886 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2373/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:33 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:34.387773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:34.388507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:34.414448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:34.417548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:34.418056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.418907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:34.419389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:34.419828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.464004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5", "tag": "b9eb4c9f-1979-485f-8dd1-e184f37fcad0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:34.496738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:34.497217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:34.497641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.538800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] Creating event network-changed:b9eb4c9f-1979-485f-8dd1-e184f37fcad0 for instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 on n-h2-854119-10 Aug 30 18:41:34.554082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4e6bb193-125c-44fa-93e8-86eb6c23556b req-9fa4768f-a1fa-41c9-a23c-e86e18afe282 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093954 Aug 30 18:41:34.555477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2374/4855] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:34.561223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a488775-debf-4b95-a460-c29a9ccf624c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5ae859d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:34.692116 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a488775-debf-4b95-a460-c29a9ccf624c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.134919 Aug 30 18:41:34.692729 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2375/4856] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:34 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:34.812717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:34.812717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:34.833276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:34.836452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:34.837075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.840614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:34.845082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:34.845783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:34.871042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:35.272803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:35.296961 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e445d9b0-0969-47e7-8256-d8149413f36f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.914974 Aug 30 18:41:35.298483 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2482/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:34 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:35.366469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:35.367267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:35.380618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:35.381237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:35.381811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:35.395445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:35.395943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:35.396536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:35.403262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:35.423041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:35.426556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:35.428143 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77e684b8-6ee7-46b5-b721-0c2e6770edc5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1743 microversion: 2.20 time: 0.625785 Aug 30 18:41:35.434423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2376/4858] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:34 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1743 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:35.713601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05e60832-53d4-46b8-84c3-2e7becb12620 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596ca60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:35.809062 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05e60832-53d4-46b8-84c3-2e7becb12620 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.099962 Aug 30 18:41:35.810084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2377/4859] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:35 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:36.023204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:36.033920 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0b4c052-a615-4daa-b693-ccf4a3dabfd9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 0.672025 Aug 30 18:41:36.054437 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2483/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:35 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:36.323591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:36.324208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:36.338249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:36.341345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:36.347313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:36.350047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:36.350759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:36.355972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:36.461774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:36.462648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:36.474198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:36.488699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:36.491666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:36.492275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:36.497969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:36.502832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:36.507210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:37.045069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:37.057635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-949cf718-3916-452c-8425-65484ad02c41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.737860 Aug 30 18:41:37.079799 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2378/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:36 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:37.136041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-698de444-8827-4601-ba82-4189c345db3d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559cf550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:37.249854 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-698de444-8827-4601-ba82-4189c345db3d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1453 microversion: 2.1 time: 0.168412 Aug 30 18:41:37.250707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2379/4862] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:37 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:37.291489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:37.292675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:37.345960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:37.351920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:37.355057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:37.364223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:37.364896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:37.371063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:37.464700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:37.489603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:37.497467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:37.505732 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0eaf8643-615d-4ea7-b5e3-ba817aed4b79 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1743 microversion: 2.20 time: 1.048186 Aug 30 18:41:37.510566 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2484/4863] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:36 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1743 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:38.102600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:38.103222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:38.113998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:38.128487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:38.128994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:38.129433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:38.130162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:38.130694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:38.131163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:38.875566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:38.896856 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e327097-c17f-470f-888e-25e697dc58f0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1737 microversion: 2.1 time: 0.798449 Aug 30 18:41:38.898327 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2485/4864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:38 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1737 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:38.907900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4cf51b0e-4447-44ae-81f3-d339e8d43559 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e577804c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:39.619670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:39.632246 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33f1f4c5-98f9-41ed-a508-d29cf9c326f2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 2.379506 Aug 30 18:41:39.632698 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2380/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:37 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:39.649479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:39.650107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:39.693320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=43 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:39.695298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:39.695844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:39.696443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:39.706757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:39.707255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:39.707709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:40.384815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:40.435036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:40.440178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:40.441442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50d9713d-6f59-4742-9681-7ed79513efd5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.807801 Aug 30 18:41:40.450611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2381/4866] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:39 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:40.476435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "name": "network-vif-plugged", "status": "completed", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:40.512328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:40.512832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:40.513276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:40.573991 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] Creating event network-vif-plugged:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h1-854119-10 Aug 30 18:41:40.611835 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f2b934fe-69e5-4ac7-87cb-90658f287876 req-4a31711f-1d3c-4e4a-9bb9-58f8c2de36bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151988 Aug 30 18:41:40.619618 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2382/4867] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:40.635902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:40.636576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:40.670773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:40.671464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:40.672108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:40.679843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:40.681924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:40.687269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:41.131010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:41.166767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c63e8129-60a2-411c-9479-834af4fd9aac tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1717 microversion: 2.1 time: 0.541866 Aug 30 18:41:41.168033 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2383/4868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:40 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1717 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:41.204343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:41.209881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:41.226764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:41.228612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:41.230527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:41.238030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:41.239033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:41.239821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:41.798842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:41.825961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-975a1f67-9953-4b9b-a868-e2292971f373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 0.656483 Aug 30 18:41:41.828376 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2384/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:41 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:41.836170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:41.837043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:41.848100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:41.849036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:41.849633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:41.850592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:41.851212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:41.851853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:42.327928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:42.364668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:42.379407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:42.382534 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cacd5800-2d5e-4677-a9c9-f98b02cdeba6 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.551469 Aug 30 18:41:42.383694 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2385/4870] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:41 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:42.410532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:42.412161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:42.469053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:42.469738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:42.470546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:42.494205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:42.495062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:42.495797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.088436 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Cannot 'detach_volume' instance b5551131-3e02-4926-b3f9-d8b3acf37b62 while it is in vm_state rescued Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments/b0ac8983-5cb0-4de0-af01-ce52479d1d18 HTTP/1.1 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'detach_volume' instance b5551131-3e02-4926-b3f9-d8b3acf37b62 while it is in vm_state rescued Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': 'b5551131-3e02-4926-b3f9-d8b3acf37b62', 'id': 'b0ac8983-5cb0-4de0-af01-ce52479d1d18'} Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b5551131-3e02-4926-b3f9-d8b3acf37b62 while it is in vm_state rescued Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:41:43.090096 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b5551131-3e02-4926-b3f9-d8b3acf37b62 while it is in vm_state rescued Aug 30 18:41:43.094009 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:41:43.095019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 409 to user: Cannot 'detach_volume' instance b5551131-3e02-4926-b3f9-d8b3acf37b62 while it is in vm_state rescued {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:41:43.096132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f947ba41-3001-413b-9e9d-ecd53a6e91bb tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments/b0ac8983-5cb0-4de0-af01-ce52479d1d18" status: 409 len: 152 microversion: 2.1 time: 0.703561 Aug 30 18:41:43.099647 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2386/4871] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:41:42 2022] DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments/b0ac8983-5cb0-4de0-af01-ce52479d1d18 => generated 152 bytes in 715 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:41:43.121188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:43.135501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:43.148892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.149756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.150436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.153155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.153918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.158728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.519944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:43.534534 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0139bec2-8a90-488b-8865-2ee9ca1ef232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1229 microversion: 2.1 time: 0.429163 Aug 30 18:41:43.540345 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2387/4872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:43 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1229 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:43.545812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:43.553503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:43.568016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.568812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.569425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.570328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.570974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.571559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.792173 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4508762-e8e9-4479-8283-64f7a77bd7c4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/action" status: 202 len: 0 microversion: 2.1 time: 0.249972 Aug 30 18:41:43.800016 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2388/4873] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:43 2022] POST /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:41:43.823315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:43.831503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:43.853468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.883882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.884356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:43.885138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:43.885615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:43.923313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:45.188107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:45.204555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:45.210712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:45.212303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-439443d2-6497-4a42-a84c-c04004e19dad tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 1.409770 Aug 30 18:41:45.213163 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2389/4874] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:43 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:45.231123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:45.232255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:45.243935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:45.244788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:45.251393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:45.252854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:45.253551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:45.254178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:45.677147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:45.701151 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eef6c0cd-56cc-4ccb-927c-2eef979c4792 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1725 microversion: 2.1 time: 0.485636 Aug 30 18:41:45.704875 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2390/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:45 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:45.733953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:45.749243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:45.788953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:45.789884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:45.790605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:45.798275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:45.800451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:45.813579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:46.551410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:46.562799 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a86efbd-9aaf-4743-8fe7-cdcaed61afee tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.846533 Aug 30 18:41:46.577796 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2391/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:45 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:46.577796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:46.577796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:46.581360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:46.593449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:46.596541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:46.606537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:46.607586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:46.614714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:47.153042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:47.173802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:47.181869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:47.190526 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6369f251-5ae1-4497-8a50-56196b3271ea tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.621383 Aug 30 18:41:47.214325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2392/4877] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:46 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:47.227527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:47.230645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:47.247185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:47.251415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:47.252239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:47.255506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:47.256167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:47.257333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:47.878456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:47.899998 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-25a624f6-d544-446d-b5bd-50002d223c42 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1725 microversion: 2.1 time: 0.682718 Aug 30 18:41:47.914724 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2393/4878] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:47 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1725 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:47.927190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:47.928045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:47.956296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:47.956924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:47.958875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:47.970417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:47.976736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:47.977190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:48.149115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:48.177588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:48.887914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=38 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:41:49.412950 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4cf51b0e-4447-44ae-81f3-d339e8d43559 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1462 microversion: 2.1 time: 10.512757 Aug 30 18:41:49.414983 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2486/4879] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:38 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1462 bytes in 10516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:49.420984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:49.422211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:49.431071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:49.431922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:49.432722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:49.433960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:49.435275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:49.435965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:49.436810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:49.450237 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56def06d-3904-47b3-aa41-0dadff388351 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 1.542133 Aug 30 18:41:49.465094 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2394/4880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:47 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:49.477515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:49.479340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:49.501527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:49.502997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:49.515712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:49.526997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:49.528069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:49.529056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:49.756759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:49.776256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:49.788386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:49.799082 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ddc2e6c-70fe-4a2a-a4f9-2962dca7cc4f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.374178 Aug 30 18:41:49.801451 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2487/4881] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:49 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:49.828648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ced75ae0-419f-402d-ad4e-d4086af72c3a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56aefca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:50.080879 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ced75ae0-419f-402d-ad4e-d4086af72c3a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 200 len: 1462 microversion: 2.1 time: 0.272420 Aug 30 18:41:50.085099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2488/4882] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:49 2022] GET /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 1462 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:50.111465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:50.113185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:50.139817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.142132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.148501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.150209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.151639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.152686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.401394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:50.437708 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09593356-a3a0-425d-8ada-b709d7da6320 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1731 microversion: 2.1 time: 0.970085 Aug 30 18:41:50.441357 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2395/4883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:49 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1731 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:50.501803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:50.513039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:50.540846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.552172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.553268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.554995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.556223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.557306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.571072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:50.585449 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e26e7c10-6dd9-4f98-8d08-278b60a91cd0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1468 microversion: 2.1 time: 0.489625 Aug 30 18:41:50.587687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2489/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:50 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1468 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:50.594529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:50.595581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:50.608404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.609459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.611934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.613084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.613781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.615449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.820290 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e248c5a2-a65c-4b13-a1a0-51d1beecabc2 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.336989 Aug 30 18:41:50.823088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2396/4885] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:41:50 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:50.846706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-647951088"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:50.851457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:50.894704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.895537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.896281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:50.897575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:50.898458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:50.899203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:51.076924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:51.093267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98177d33-ad59-4bdc-9343-7a2f9bba76a0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.503944 Aug 30 18:41:51.107605 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2490/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:50 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:51.107605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:51.107605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:51.133067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:51.133938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:51.134429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:51.135218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:51.136339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:51.136791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:51.675595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:51.692827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:51.696874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:51.703163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c6d4d6ef-f441-43bd-bd1e-76d36fdf2ce8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.603029 Aug 30 18:41:51.704151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2491/4887] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:51 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:51.980935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cff5c7b0-503b-47ab-8981-e715235b03b4 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "POST /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2/action" status: 202 len: 0 microversion: 2.1 time: 1.155644 Aug 30 18:41:51.981988 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2397/4888] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:41:50 2022] POST /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2/action => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:41:52.000804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b8e3a89-0765-463f-86b4-5a65075aa418 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56aef1f0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:52.119418 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b8e3a89-0765-463f-86b4-5a65075aa418 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.128366 Aug 30 18:41:52.121228 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2492/4889] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:51 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:52.144333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:52.145299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:52.210744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:52.215746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:52.221474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:52.230583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:52.240343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:52.246580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:52.747014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:52.763475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:52.800141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:52.801003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:52.801800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:52.810085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:52.811516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:52.815557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:53.158229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:53.185277 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ef81f04-9956-4e83-b220-243dde954210 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 1.046829 Aug 30 18:41:53.227662 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2398/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:52 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:53.259197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4c3264b-67ae-4ba1-ac62-aa01ddb20056 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5597eee0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:53.451667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4c3264b-67ae-4ba1-ac62-aa01ddb20056 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.221666 Aug 30 18:41:53.454198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2399/4891] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:53 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:53.636102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:53.652870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:53.659185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:53.664081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8eec7b1-5430-4f2f-833f-bb6a1f74b96e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.925427 Aug 30 18:41:53.665669 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2493/4892] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:52 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:54.227469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:54.228094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:54.249735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:54.250677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:54.254679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:54.265384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:54.266942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:54.267413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:54.368266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:54.413870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:54.414401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:54.417539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:54.515694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] Creating event network-changed:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:41:54.529381 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-36a2c6d8-c696-425c-96c7-6e51692b2af8 req-7205503c-fa00-4a6c-b3fc-5e283b47555e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165445 Aug 30 18:41:54.531427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2494/4893] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:41:54.541580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd6b211f-b838-4d95-995a-a5cbabd94f32 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a85280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:54.723029 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd6b211f-b838-4d95-995a-a5cbabd94f32 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.189726 Aug 30 18:41:54.740900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2495/4894] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:54 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:54.775659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:54.777224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:54.838215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:54.840484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:54.841253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:54.843646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:54.845869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:54.904467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:55.090006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:55.109272 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ff2d73e-5a83-44ef-85fc-049e40e4beb0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.883554 Aug 30 18:41:55.109980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2400/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:54 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:55.741302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0277ec4-a246-45e6-a0b8-a099e62a7e97 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5597e4c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:55.839349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:55.864065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:55.869808 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0277ec4-a246-45e6-a0b8-a099e62a7e97 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.135975 Aug 30 18:41:55.871572 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2401/4896] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:55 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:55.887820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:55.889493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e08857c-ed01-4e30-9f1d-f9cfbb82dd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 1.145626 Aug 30 18:41:55.903027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2496/4897] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:54 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:56.131263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:56.132933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:56.157585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:56.159783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:56.166224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:56.171152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:56.172055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:56.173636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b546f0-bb05-46d4-a51f-dde507b7f266", "name": "network-vif-unplugged", "status": "completed", "tag": "17a0f7b9-69d8-41c5-bd62-357d09003cf2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:56.176783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:56.236824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:56.246525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:56.254488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:56.310399 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] Creating event network-vif-unplugged:17a0f7b9-69d8-41c5-bd62-357d09003cf2 for instance b5b546f0-bb05-46d4-a51f-dde507b7f266 on n-h1-854119-10 Aug 30 18:41:56.331743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cec5ee8c-6cad-4764-9b95-b575df317045 req-021423e8-c688-4e45-8a5f-2114dfdc9c82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161360 Aug 30 18:41:56.332747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2497/4898] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:56.548637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:41:56.579049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:56.598009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:56.601679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:56.717582 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] Creating event network-changed:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:41:56.753428 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f5220da1-5aad-42c2-b6f2-c1201c825ea0 req-e88ca6e4-bc5f-4a67-8eb0-9cab926b7698 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211447 Aug 30 18:41:56.771470 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2498/4899] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:41:56.889082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a49d4ac-d9ff-40cb-b742-00e533137713 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a85f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:57.109896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a49d4ac-d9ff-40cb-b742-00e533137713 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.226017 Aug 30 18:41:57.127443 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2499/4900] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:56 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:41:57.150675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:57.152038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:57.180987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.182786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.185650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.194097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:57.196553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:57.197937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:57.833542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:57.848919 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3ff34c9-a5c5-4260-ae50-4f0d25f19c41 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 1.721711 Aug 30 18:41:57.849488 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2402/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:56 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:58.116354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:58.133854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09ec4489-e87c-48e4-88c5-462a67acadbe tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5594b1f0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:58.147737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:58.155774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:58.160954 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e341cf44-8798-4efa-97c6-bea8acc31162 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 1.027674 Aug 30 18:41:58.162310 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2500/4902] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:57 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:41:58.882890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:58.884311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:58.943308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:58.943815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:58.946748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:58.947777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:58.951204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:58.952131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:59.430169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:41:59.454410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e184821-5484-4b37-a276-71ad0909ab4d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.577739 Aug 30 18:41:59.458468 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2501/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:41:58 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:41:59.480488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:41:59.488486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:41:59.504519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:59.511396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:59.513512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:41:59.517782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:41:59.531558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:41:59.539119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:00.126993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:00.144613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:00.150251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:00.155187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70ad3855-b6d2-4b81-8379-0c477eb3e683 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.684477 Aug 30 18:42:00.159417 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2502/4904] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:41:59 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:00.484364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:00.485828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:00.502040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:00.504766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:00.507342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:00.510005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:00.513551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:00.514771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:01.066646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:01.075468 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-12bc8b01-72b8-4da1-9e95-5e9cf89547a3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.596051 Aug 30 18:42:01.084686 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2503/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:00 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:01.189444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:01.190070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:01.237963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:01.246881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:01.261550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:01.284046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:01.299948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:01.311817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:02.042199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:02.053918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:02.061980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:02.067483 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-681d84db-4653-48e0-afde-75b4e2c501ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.885199 Aug 30 18:42:02.081075 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2504/4906] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:01 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:02.104425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:02.105047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:02.135796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:02.136294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:02.136736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:02.137471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:02.138412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:02.157934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:02.617183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:02.630553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a33953e-8c35-4f96-b397-7f85c91e591e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.528804 Aug 30 18:42:02.632869 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2505/4907] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:02 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:03.057964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-70965276", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "3a5d4b2d-a18c-4c82-a201-60cc62572835"}], "key_name": "tempest-TestSecurityGroupsBasicOps-50597129", "security_groups": []}, "os:scheduler_hints": {"different_host": ["413b867c-6bf5-471e-ac66-4a895b18c0b3"]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:06.152123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=39 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:07.839144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:10.012397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] validate_networks() for [('3a5d4b2d-a18c-4c82-a201-60cc62572835', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:42:10.019913 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09ec4489-e87c-48e4-88c5-462a67acadbe tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 11.888437 Aug 30 18:42:10.026117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2403/4908] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:41:58 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 11897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:10.036858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:10.041227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:10.055260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.056020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.056691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.057721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.058583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.059263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.435749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:10.447928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:10.449754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:10.461098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-20906d37-05e9-4e3a-8230-49686b1dcc13 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1738 microversion: 2.20 time: 0.431791 Aug 30 18:42:10.462215 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2404/4909] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:10 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:10.467375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:10.468318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:10.480713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.487606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.488163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.489070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.489692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.490603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.830217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:42:10.831153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:42:10.831865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:42:10.832497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:42:10.833466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:42:10.851567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.852158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.852799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.854092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:10.854878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:10.859799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:10.913477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for project 17aa20801b2a4948a6820565bffd97c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:42:10.931113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Getting quotas for user 83e04bc3c5824c62b4ad1a1c309912fb and project 17aa20801b2a4948a6820565bffd97c5. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:42:10.966176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:42:10.977229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:42:11.094685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b56ed332-1e34-4a4d-b05b-320d0f307e6a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 8.040931 Aug 30 18:42:11.103212 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2506/4910] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:42:03 2022] POST /compute/v2.1/servers => generated 361 bytes in 8050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:42:11.111836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5", "name": "network-vif-plugged", "status": "completed", "tag": "b9eb4c9f-1979-485f-8dd1-e184f37fcad0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:11.156439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:11.157272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:11.157888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:11.172792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] Creating event network-vif-plugged:b9eb4c9f-1979-485f-8dd1-e184f37fcad0 for instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 on n-h2-854119-10 Aug 30 18:42:11.184515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-cd643751-768b-4c3f-90d6-7f9121f7ff8d req-8976195b-1921-4326-af1d-07bec693d001 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078532 Aug 30 18:42:11.186610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2507/4911] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:11.201713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:11.203999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d11ee1c-36a5-4662-9706-5e361dcde6f6 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a85280>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:11.242819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07a4b53c-4030-4d83-9bd5-8114b2a84198 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.772747 Aug 30 18:42:11.243462 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2405/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:10 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:11.248737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d6f0741-76ec-4aac-9d35-db7638d8849f tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:11.249367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d6f0741-76ec-4aac-9d35-db7638d8849f tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:11.362194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d11ee1c-36a5-4662-9706-5e361dcde6f6 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.171374 Aug 30 18:42:11.362992 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2508/4913] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:11 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:11.485366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:11.486113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:11.500942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:11.501452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:11.504555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:11.505349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:11.505832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:11.511246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d6f0741-76ec-4aac-9d35-db7638d8849f tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:11.518733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d6f0741-76ec-4aac-9d35-db7638d8849f tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1238 microversion: 2.1 time: 0.274158 Aug 30 18:42:11.519324 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2406/4914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:11 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1238 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:11.520003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:11.957350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:11.978034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:11.980060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:11.981608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b8d1813-8681-470e-9261-fe81e2053fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1720 microversion: 2.20 time: 0.500399 Aug 30 18:42:11.982684 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2509/4915] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:11 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1720 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:12.272752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:12.274569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:12.303038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:12.303943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:12.304629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:12.305640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:12.307854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:12.308501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:12.378391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-588294e4-5587-48c7-b490-6e837df1b0cf tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a85790>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:12.466998 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-588294e4-5587-48c7-b490-6e837df1b0cf tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.087016 Aug 30 18:42:12.468605 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2510/4916] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:12 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:12.547234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:12.548381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:12.566218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:12.569077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:12.573528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:12.574669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:12.584790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:12.588269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:12.633576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:12.650438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8b55a580-9ce4-4115-b516-6e1301ae2ff0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1217 microversion: 2.1 time: 0.379923 Aug 30 18:42:12.651972 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2407/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:12 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1217 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:12.809992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:12.818828 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bab15194-c021-40af-9f0a-c7eba0213670 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1242 microversion: 2.1 time: 0.276181 Aug 30 18:42:12.830644 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2511/4918] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:12 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1242 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:13.014647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:13.015722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:13.032680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.033514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.034156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.035258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.035916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.036613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.202913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-plugged", "status": "completed", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:13.218259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.225646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.226326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.253801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:13.266508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] Creating event network-vif-plugged:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:42:13.268760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:13.271006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:13.272505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4361213-86aa-47ca-b40b-5622c772b014 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1720 microversion: 2.20 time: 0.264506 Aug 30 18:42:13.279017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2408/4919] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:13 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:13.284844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0907c3d2-2582-4c4d-9b07-35af71752c66 req-73a3e6a5-a84c-41e4-8fa6-0318025c6d39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085095 Aug 30 18:42:13.288616 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2512/4920] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:42:13.489685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-774deeb3-8b8d-4c09-8eaf-e080319015d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559cfca0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:13.541458 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-774deeb3-8b8d-4c09-8eaf-e080319015d0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.055805 Aug 30 18:42:13.542693 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2409/4921] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:13 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:13.682142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:13.683053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:13.696283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.700833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.701594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.702796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.703632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.704166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.750578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:13.878795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:13.879816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:13.890981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.892582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.893511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:13.894713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:13.895418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:13.896090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.024624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:14.034932 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e87a82a3-0a7a-4214-84e8-ba545300f0b5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1234 microversion: 2.1 time: 0.160430 Aug 30 18:42:14.036095 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2410/4922] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:13 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1234 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:14.063634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:14.075980 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3d6309d-d6dd-4afd-b5e6-1cb8d3cfb9ca tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1404 microversion: 2.1 time: 0.398296 Aug 30 18:42:14.076770 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2513/4923] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:13 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:14.099338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:14.100179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:14.107456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.108292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.108947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.110614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.114294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.114966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.299068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:14.300656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:14.339292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.340112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.340727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.341836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.343344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.343344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.526503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:14.538205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbc0d236-d9ef-429f-8657-cd1ad6858153 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1404 microversion: 2.1 time: 0.442600 Aug 30 18:42:14.554652 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2411/4924] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:14 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:14.570377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3348f05a-8096-4413-80cf-7e8ca53955ed tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5679fa60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:14.769600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3348f05a-8096-4413-80cf-7e8ca53955ed tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.212234 Aug 30 18:42:14.771349 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2412/4925] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:14 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:14.805914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1782020736"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:14.815524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:14.853293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.854962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.858255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:14.861952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:14.867020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:14.880106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:15.061244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:15.091233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:15.094420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:15.100648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9dcf94a4-0b42-4ca6-aab9-b2b94f6b46d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1720 microversion: 2.20 time: 0.807008 Aug 30 18:42:15.111799 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2514/4926] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:14 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1720 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:42:15.130263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:15.142797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:15.168793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:15.171175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:15.177755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:15.185011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:15.193464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:15.194515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:15.332071 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Attempting to quiesce instance before volume snapshot. Aug 30 18:42:15.424905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:15.432442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 30 18:42:15.440134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d70147a4-9f78-4d0e-9aeb-40b0d90b9464 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1298 microversion: 2.1 time: 0.325880 Aug 30 18:42:15.447572 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2515/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:15 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1298 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:15.479747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "name": "network-vif-unplugged", "status": "completed", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:15.525487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:15.526500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:15.527291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:15.571966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.server_external_events [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] Unable to find a host for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e. Dropping event network-vif-unplugged {{(pid=122589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:42:15.586226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d3633934-cafd-4396-941a-7ce0d167815c req-1590448b-3dc3-4101-8591-91327771ed47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.131406 Aug 30 18:42:15.589531 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2516/4928] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 138 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:42:15.789844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Creating snapshot from volume 8b024670-c718-4af4-a9b3-aeb3e3f2dee3. {{(pid=122590) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 30 18:42:15.798201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4278b532-60de-41fe-9a54-6a489f05afdc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56ae0550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:15.994525 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4278b532-60de-41fe-9a54-6a489f05afdc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.202349 Aug 30 18:42:16.002646 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2517/4929] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:15 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:16.132903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:16.139583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:16.175483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.180241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.183268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:16.184967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.191714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.193013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:16.668828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:16.688244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:16.699204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:16.708438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25547960-46d1-4cf1-8139-00e83aaf7bdd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1663 microversion: 2.20 time: 0.580109 Aug 30 18:42:16.710751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2518/4930] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:16 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1663 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:16.727819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:16.730015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:16.755717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.755717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.757542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:16.760646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.762920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.765274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:16.900604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:16.910817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c864b490-ce91-4c1a-979c-b9ec767415fb tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.198661 Aug 30 18:42:16.912509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2519/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:16 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:16.917944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b63c4f-8ec2-46e6-9364-5e7713ae7466"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:16.920765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:16.929271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.930121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.931123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:16.932564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:16.933265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:16.933901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:17.719557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-792483ee-7cdb-4cd1-9a5e-007588c3d026 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.805648 Aug 30 18:42:17.733197 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2520/4932] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Aug 30 18:42:16 2022] POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 188 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:42:17.749313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4af9b96-3d2d-412d-b68a-9a9b2c24163e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56b710d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:18.333557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4af9b96-3d2d-412d-b68a-9a9b2c24163e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.597423 Aug 30 18:42:18.341628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2521/4933] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:17 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:18.350797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:18.367154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:18.376592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:18.391016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.391463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.391920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:18.393737 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-63d71a1d-73e3-458e-bd8f-f2a364b7aa4e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5/action" status: 202 len: 0 microversion: 2.1 time: 3.601424 Aug 30 18:42:18.394555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.395242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.396406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:18.400983 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2413/4934] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:42:14 2022] POST /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5/action => generated 0 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 18:42:18.426493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:18.430205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:18.463538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.464485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.464947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:18.465730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.466185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.479140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:18.671692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:18.680371 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be8ea3fc-097c-4aed-8666-5f95ea9bb1f0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.335726 Aug 30 18:42:18.680974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2522/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:18 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:18.730237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122590) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 18:42:18.907197 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4dda363d-e203-4940-9c6c-84585c7e232f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/action" status: 202 len: 0 microversion: 2.20 time: 0.504239 Aug 30 18:42:18.907842 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2414/4936] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:42:18 2022] POST /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:18.919122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:18.919808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:18.948616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.950654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.951131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:18.951876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:18.956686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:18.972891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:19.349250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0a02218-e437-46ed-ad7c-7645b362807a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e558d8310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:19.540313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:19.645498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:19.667709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:19.669523 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff660d73-3e8e-414d-bfd0-cd622b50c14f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1749 microversion: 2.20 time: 0.756983 Aug 30 18:42:19.681184 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2523/4937] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:18 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1749 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:19.736691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:19.737709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:19.760772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:19.761610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:19.762211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:19.765502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:19.766335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:19.768876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:19.972895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0a02218-e437-46ed-ad7c-7645b362807a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.610806 Aug 30 18:42:19.973681 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2415/4938] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:19 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:20.052651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:20.068101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-750ad7be-ca9c-4448-b51a-1e54ab5457f1 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.358422 Aug 30 18:42:20.082764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d0d94a-bdd7-46ad-9f57-77eafa919b51", "tag": "db5e01a1-f56d-4689-bf68-00ec0747392c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:20.091764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2524/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:19 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:20.117314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:20.117861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:20.118485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:20.196129 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] Creating event network-changed:db5e01a1-f56d-4689-bf68-00ec0747392c for instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 on n-h1-854119-10 Aug 30 18:42:20.230583 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d3a8ee62-be48-4057-9a09-6bcac3a41649 req-167ce4bc-98d5-4259-8395-561300d1c4f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166235 Aug 30 18:42:20.231196 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2416/4940] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:20.711718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:20.712363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:20.729914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:20.730800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:20.733640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:20.735007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:20.735824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:20.736441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:20.914763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:20.953296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:20.991344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56c94bbf-06b0-4f35-99d8-c3b8f13d2a4a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e558d8160>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:21.110622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56c94bbf-06b0-4f35-99d8-c3b8f13d2a4a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.124740 Aug 30 18:42:21.122376 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2417/4941] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:20 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:21.171091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:21.172454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:21.232428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:21.233025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:21.233654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:21.235447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:21.236235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:21.237006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:21.518814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:21.648980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:21.667341 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4992324-50bc-47d3-8dcc-b4aa5579620b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.530857 Aug 30 18:42:21.685948 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2418/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:21 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:21.786301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:21.800261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:21.818003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:21.819590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1610a2e2-4baa-49c2-9fa5-bfb5e2ae4776 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1749 microversion: 2.20 time: 1.118087 Aug 30 18:42:21.820335 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2525/4943] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:20 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1749 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:22.130392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9888dca5-ec49-4072-8d71-119de652576a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5597ec10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:22.249495 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9888dca5-ec49-4072-8d71-119de652576a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.126879 Aug 30 18:42:22.250189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2419/4944] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:22 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:22.371427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1511707844", "imageRef": "7f615ddf-1ab7-4b35-ae8f-7b9fd6c3ea2b", "flavorRef": "452", "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:22.506022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:42:22.700471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:22.701333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:22.715736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:22.717704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:22.719173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:22.720369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:22.722445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:22.724704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:23.003360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:23.024388 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8db388c1-2b3e-44da-a75f-77af35329e4c tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.330699 Aug 30 18:42:23.029087 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2420/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:22 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:23.067654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:23.068306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:23.080635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:23.090969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:23.096795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:23.118470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:23.123607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:23.128524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:23.293107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:42:23.294548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:42:23.295370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:42:23.296556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:42:23.296896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:42:23.312611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:23.314068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:23.315035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:23.316503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:23.317456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:23.318370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:23.350890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:42:23.358752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:42:23.383004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:42:23.387335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='13ba0fa7-9a60-41c9-9014-9bc895080233',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:42:23.627897 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4c12aac-1c09-42a2-8c5a-3b0230c03e97 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260342 Aug 30 18:42:23.632878 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2526/4946] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:42:23.652964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f6b42e78-be56-48b9-8e46-b662b48ca3af tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5676ba60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:23.759527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f6b42e78-be56-48b9-8e46-b662b48ca3af tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.123255 Aug 30 18:42:23.762610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2527/4947] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:23 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:23.774865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c243de4-ad45-4df8-94de-857e4887fbb3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:23.775669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c243de4-ad45-4df8-94de-857e4887fbb3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:23.913302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c243de4-ad45-4df8-94de-857e4887fbb3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:23.946475 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c243de4-ad45-4df8-94de-857e4887fbb3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1230 microversion: 2.1 time: 0.176010 Aug 30 18:42:23.952148 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2528/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:23 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1230 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:24.062017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:24.066292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:24.071791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:24.081340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:24.089735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:24.091985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0fabf1f8-0c15-4351-a76f-d3c638b6e9b9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1749 microversion: 2.20 time: 1.047853 Aug 30 18:42:24.093330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:24.094674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:24.096444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:24.097933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:24.099807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:24.101650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:24.113632 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2421/4949] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:23 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1749 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:24.318850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:24.335904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9866efb7-0037-42a9-b1af-4c2a449f2dc8 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.281024 Aug 30 18:42:24.339140 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2529/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:24 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:24.776456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-295ec6fa-5143-43b4-b9b9-abdce569ce58 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559628b0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:24.789424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:24.791095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:24.811152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:24.812260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:24.815373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:24.816540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:24.817186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:24.819412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:24.859836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-295ec6fa-5143-43b4-b9b9-abdce569ce58 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.085837 Aug 30 18:42:24.862106 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2422/4951] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:24 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:24.983264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:24.991337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:25.017701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.019357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.021218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:25.029656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.032663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.033261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:25.248382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'services' on Instance uuid b5551131-3e02-4926-b3f9-d8b3acf37b62 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:42:25.331098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:25.345108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd67f167-37b3-48ba-ba60-6812eba3c9b4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1234 microversion: 2.1 time: 0.363598 Aug 30 18:42:25.346814 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2423/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:24 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1234 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:25.358115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:25.363469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:25.382202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.383199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.386240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:25.388360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.390684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.391568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:25.663998 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-267077e9-2f86-4236-8153-330cd1ca9135 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments/b0ac8983-5cb0-4de0-af01-ce52479d1d18" status: 202 len: 0 microversion: 2.1 time: 0.876566 Aug 30 18:42:25.669584 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2530/4953] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:42:24 2022] DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments/b0ac8983-5cb0-4de0-af01-ce52479d1d18 => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:42:25.699436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:25.702633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:25.729403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.739432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.740444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:25.742126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:25.743744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:25.748183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:26.178987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:26.197018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:26.199400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:26.202030 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-579ffffd-63d9-4552-95b5-2a7994c562e8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.853355 Aug 30 18:42:26.203441 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2424/4954] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:25 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:26.211585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:26.215392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:26.223825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:26.245399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:26.247046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:26.250571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:26.252663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:26.253095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:26.267952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:26.291374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:26.304166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8df73f04-b2c6-4452-b498-34bfa9440dae tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.632606 Aug 30 18:42:26.319647 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2531/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:25 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:26.324503 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c5c5355-3646-43ec-b42f-531b13207ac6 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118718 Aug 30 18:42:26.328063 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2425/4956] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:26 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:26.336192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-530219a7-d80b-4321-86b0-366b23110560 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a9f940>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:26.368610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:26.369597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:26.425141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:26.426735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:26.432684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:26.437291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:26.447719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:26.449551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:26.511709 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-530219a7-d80b-4321-86b0-366b23110560 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1454 microversion: 2.1 time: 0.190435 Aug 30 18:42:26.538887 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2532/4957] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:26 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:26.623387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:26.642491 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dad4c92-5960-4e52-92b5-d25ccb7023c8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1282 microversion: 2.1 time: 0.278780 Aug 30 18:42:26.643678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2426/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:26 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:27.231190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:27.231799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:27.257225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.257735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.260218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.261109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.270793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.271498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.281747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:27.327325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:27.328072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:27.349297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.349942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.352050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.352887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.353376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.361027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.672284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:27.716253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:27.729129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:27.735783 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aa4b9720-038e-443e-8205-28a6b96961d0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.505931 Aug 30 18:42:27.757307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2533/4959] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:27.764231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:27.778428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:27.792025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:27.801650 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbfafdba-9b14-43a9-a190-7a7ca4b9a855 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.478064 Aug 30 18:42:27.803129 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2427/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:27.822490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e790a9b5-4cda-4513-a129-5e2bb2fd96ee tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5594b550>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:27.831781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.832296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.832745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.833489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.833970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.834427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.938779 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e790a9b5-4cda-4513-a129-5e2bb2fd96ee tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1463 microversion: 2.1 time: 0.130843 Aug 30 18:42:27.939808 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2428/4961] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1463 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:27.950983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:27.951628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:27.962503 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5b1b353-ffb6-476d-9e1c-4db4a50b0138 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204258 Aug 30 18:42:27.970699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.971270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.971730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.972845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:27.972937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:27.973810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:27.979133 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2534/4962] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:27.985473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4402ca1-df96-432b-8645-2c565846c0d2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5695d160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:28.068509 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4402ca1-df96-432b-8645-2c565846c0d2 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 200 len: 1463 microversion: 2.1 time: 0.087249 Aug 30 18:42:28.069840 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2535/4963] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:28.086224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:28.087186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:28.094735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.098542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.099192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:28.101119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.105825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.106922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:28.510233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:28.534834 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2958e33a-9eeb-49b4-a002-8ff65ff8b77c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1468 microversion: 2.1 time: 0.452480 Aug 30 18:42:28.536861 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2536/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:28 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:28.567388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bbbd949-2b9b-4828-86ad-2407829df6f8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e57207820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:28.827035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:28.834233 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bbbd949-2b9b-4828-86ad-2407829df6f8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-08-30T18%3A40%3A14Z" status: 200 len: 1901 microversion: 2.1 time: 0.270558 Aug 30 18:42:28.835106 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2537/4965] 10.222.0.25 () {58 vars in 1199 bytes} [Tue Aug 30 18:42:28 2022] GET /compute/v2.1/images?changes-since=2022-08-30T18%3A40%3A14Z => generated 1901 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:28.839706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a0c83e7-cde2-44ae-8b1b-e012004819ef tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1300 microversion: 2.1 time: 0.898442 Aug 30 18:42:28.848860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:28.849491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:28.855393 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2429/4966] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:27 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1300 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:28.862990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:28.863889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:28.871420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.872203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.872964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:28.873933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.874938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.876151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:28.883838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.884357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.884829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:28.890590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:28.891666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:28.892331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.272691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:29.284350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:29.285888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:29.287275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-79a2d9b5-15d4-4ddf-be75-494f220a3e32 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.449468 Aug 30 18:42:29.287789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2538/4967] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:28 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:29.309718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d0d94a-bdd7-46ad-9f57-77eafa919b51", "name": "network-vif-plugged", "status": "completed", "tag": "db5e01a1-f56d-4689-bf68-00ec0747392c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:29.324362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:29.337938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d450800b-7ee6-4153-a547-57903d8fde82 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.477875 Aug 30 18:42:29.341035 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2430/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:28 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:29.341611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:29.342304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:29.343053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.358853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-902d5d14-fc85-42e3-9090-1d322757646e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55914ee0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:29.364570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] Creating event network-vif-plugged:db5e01a1-f56d-4689-bf68-00ec0747392c for instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 on n-h1-854119-10 Aug 30 18:42:29.380818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3b288380-39dd-48c4-a603-1e615cf69a85 req-6695c038-3998-4df2-a793-9562e98d3754 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085320 Aug 30 18:42:29.384190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2539/4969] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:29.398577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:29.401281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:29.416705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:29.423419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:29.424056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.425315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:29.426002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:29.426747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.518987 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72b14bae-d2f9-4c12-ac0a-b62e5203895c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133245 Aug 30 18:42:29.519686 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2540/4970] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:29 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:29.552553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-902d5d14-fc85-42e3-9090-1d322757646e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-39820155" status: 200 len: 483 microversion: 2.1 time: 0.209044 Aug 30 18:42:29.569517 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2431/4971] 10.222.0.25 () {58 vars in 1227 bytes} [Tue Aug 30 18:42:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-39820155 => generated 483 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:29.584561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-691210c8-2533-4ae9-a3ae-0be2d62c556b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e57207430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:29.823207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-691210c8-2533-4ae9-a3ae-0be2d62c556b tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?server=df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 957 microversion: 2.1 time: 0.242462 Aug 30 18:42:29.824178 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2541/4972] 10.222.0.25 () {58 vars in 1209 bytes} [Tue Aug 30 18:42:29 2022] GET /compute/v2.1/images?server=df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 957 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:29.841662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f00148c-087c-4231-88a8-c00c1c89da6e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55933700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:29.906407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:29.923345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:29.944408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:29.944914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:29.945366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.946070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:29.951049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:29.951470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:29.991724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3f00148c-087c-4231-88a8-c00c1c89da6e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 483 microversion: 2.1 time: 0.153434 Aug 30 18:42:29.992820 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2432/4973] 10.222.0.25 () {58 vars in 1317 bytes} [Tue Aug 30 18:42:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 483 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:30.008481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-414e18ee-49b7-44c8-aad7-8869f6095124 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559144c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.090168 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-414e18ee-49b7-44c8-aad7-8869f6095124 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 483 microversion: 2.1 time: 0.087532 Aug 30 18:42:30.107693 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2433/4974] 10.222.0.25 () {58 vars in 1303 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 483 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:30.116233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2bd10f4-e637-41aa-bbb2-69a2be884677 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559330d0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.312117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:30.322840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a8e2465-c129-42df-a918-b045e033f005 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.429446 Aug 30 18:42:30.323997 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2542/4975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:29 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:30.329873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.330790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:30.337585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.338503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.339280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.340296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.340988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.341901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.348252 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2bd10f4-e637-41aa-bbb2-69a2be884677 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.238681 Aug 30 18:42:30.353514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2434/4976] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:30.371308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.376799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:30.397099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.397602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.398052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.398818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.399466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.400060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.524138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:30.535910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:30.537601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:30.539269 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67647ece-bfc3-4dcc-847e-f43fb2e6399a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.214103 Aug 30 18:42:30.540520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2543/4977] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:30.548787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d9694a7-031d-47b0-9750-4d9ac527bc1f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e568c0160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.577785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:30.613198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07627152-0cbf-4161-bdba-fc2d942ddace tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1296 microversion: 2.1 time: 0.244959 Aug 30 18:42:30.614854 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2435/4978] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:30.634831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.641408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:30.649168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.649683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.650266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.651043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.651672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.652165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.718335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d9694a7-031d-47b0-9750-4d9ac527bc1f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.176278 Aug 30 18:42:30.721491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2544/4979] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:30.725438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab32c41e-581a-430d-a8dd-25036444741c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109372 Aug 30 18:42:30.726282 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2436/4980] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:30.736139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9457261a-11b6-42b6-96c8-c88037ea18f8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e569a6af0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.795013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9457261a-11b6-42b6-96c8-c88037ea18f8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.064020 Aug 30 18:42:30.796147 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2545/4981] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:30.812988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f753b602-f456-4194-bac3-54a5432c131c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55962dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:30.829026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2b8fff-5160-414d-9053-52a57659aa89", "tag": "132547c9-744f-4a47-8c49-46fab0cc5717"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:30.867065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:30.868080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:30.868743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:30.885524 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] Creating event network-changed:132547c9-744f-4a47-8c49-46fab0cc5717 for instance fc2b8fff-5160-414d-9053-52a57659aa89 on n-h2-854119-10 Aug 30 18:42:30.894723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b66e3ff8-87f9-45df-8289-7d227c25144a req-c11d754f-24f1-41ef-837f-b29a9f87d080 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069500 Aug 30 18:42:30.896377 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2546/4982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:30.974016 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f753b602-f456-4194-bac3-54a5432c131c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-08-30T18%3A40%3A07Z" status: 200 len: 6330 microversion: 2.1 time: 0.164515 Aug 30 18:42:30.975907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2437/4983] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-30T18%3A40%3A07Z => generated 6330 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:31.003391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27859f96-b63e-4d91-9972-88f295f3bc19 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56d791f0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.088043 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27859f96-b63e-4d91-9972-88f295f3bc19 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-39820155" status: 200 len: 663 microversion: 2.1 time: 0.091473 Aug 30 18:42:31.088931 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2547/4984] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:42:30 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-39820155 => generated 663 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:31.115847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72201b76-8853-4bdb-b357-10bcf7f329e1 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5596cd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.187819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72201b76-8853-4bdb-b357-10bcf7f329e1 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1465 microversion: 2.1 time: 0.086902 Aug 30 18:42:31.189026 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2438/4985] 10.222.0.25 () {58 vars in 1338 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1465 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:31.215823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-236e4b8e-3651-4b50-8eec-8aa1cd03bebd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e57884f70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.291540 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-236e4b8e-3651-4b50-8eec-8aa1cd03bebd tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1465 microversion: 2.1 time: 0.083334 Aug 30 18:42:31.292260 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2548/4986] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1465 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:31.309263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7988f222-09c8-4050-b874-86a5d3b86c00 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e558fc3a0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.351135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.351933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:31.361357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:31.361873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:31.362403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:31.363271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:31.363750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:31.364192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:31.420115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7988f222-09c8-4050-b874-86a5d3b86c00 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.115199 Aug 30 18:42:31.421081 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2439/4987] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:31.443630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0e2c979-b0b8-476f-928c-60e54f1c1f2a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55965940>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.715241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0e2c979-b0b8-476f-928c-60e54f1c1f2a tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.277394 Aug 30 18:42:31.727533 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2440/4988] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:31.740246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:31.740889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:31.758706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:31.763528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:31.764223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:31.765060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:31.766979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:31.768498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.127022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.147457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.160512 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-08744625-9834-40c6-b47d-db383a0351f3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.819446 Aug 30 18:42:32.163375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.165157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.166545 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c26f191-4f31-486b-b4f1-31e9aad16770 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.437761 Aug 30 18:42:32.176850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2549/4989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:32.182228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.182928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:32.190507 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2441/4990] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:31 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:32.195326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.195832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.196679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.198626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.199337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.199927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.203018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-unplugged", "status": "completed", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:32.226632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.227409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.227859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.241668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] Creating event network-vif-unplugged:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:42:32.259524 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7f2f1064-04c2-478e-876b-86535de9a77f req-0ca0f958-0837-4398-b27e-93a48b1ce1c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067140 Aug 30 18:42:32.260546 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2442/4991] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:32.268762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e6a79fb-1d8d-445a-bacb-74dfff9262ad tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559cf310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.309206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.318482 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4158c83-a5a8-4c88-bc33-0e7b593d72ea tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1468 microversion: 2.1 time: 0.140449 Aug 30 18:42:32.319343 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2550/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1468 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:32.324792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.327747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:32.334953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.335714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.336330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.337270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.337935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.338591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.374820 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e6a79fb-1d8d-445a-bacb-74dfff9262ad tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292" status: 200 len: 784 microversion: 2.1 time: 0.112130 Aug 30 18:42:32.377231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2443/4993] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/images/56ee09fc-3dcc-4737-853e-2c27d4afd292 => generated 784 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:32.387180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.388219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:32.397880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.398806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.399460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.400370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.401648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.402266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.403873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21897158-c50a-4e57-a440-8689f746d687 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082618 Aug 30 18:42:32.405028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2551/4994] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:32.414563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5df9cd5-df4c-4cc2-a10b-34afff94f7ce tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56aefca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.479265 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b5df9cd5-df4c-4cc2-a10b-34afff94f7ce tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.068674 Aug 30 18:42:32.479265 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2552/4995] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:32.493577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3dcb144-9253-4393-9af8-d061c5d638fc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e569a60d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.539278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:32.553962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-090b547f-d8c4-40db-973a-b79933e5b001 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1468 microversion: 2.1 time: 0.174850 Aug 30 18:42:32.561289 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2444/4996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:32.577312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.577944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:32.584328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.584846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.585295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.586036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.586557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.586998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.713753 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1c4f105f-3692-43a4-aa19-0dd617acbb53 tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1621 microversion: 2.1 time: 0.140626 Aug 30 18:42:32.714706 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2445/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:32.739969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:32.740520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:32.748039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.748561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.749019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.749765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:32.751195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:32.751195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:32.926643 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91bc2cba-71a8-4480-ab92-ab58eb8e89fe tempest-TestSecurityGroupsBasicOps-1439289215 tempest-TestSecurityGroupsBasicOps-1439289215-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1913 microversion: 2.1 time: 0.194193 Aug 30 18:42:32.930561 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2446/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:32 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1913 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:33.013579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.014204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.027577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.027991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.029122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.030110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.030939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.031814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.068767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:33.189724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a830359-b0f3-4cf1-b2d3-2efdede53d57 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 204 len: 0 microversion: 2.1 time: 0.180453 Aug 30 18:42:33.190438 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2447/4999] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:33 2022] DELETE /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:42:33.196369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.197094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.203967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.204533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.204980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.205698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.206151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.206606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.286035 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3dcb144-9253-4393-9af8-d061c5d638fc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3" status: 204 len: 0 microversion: 2.1 time: 0.796756 Aug 30 18:42:33.286753 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2553/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:32 2022] DELETE /compute/v2.1/images/3e7105c2-aee0-43cb-afd8-2a018727f7b3 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:42:33.294147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.294790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.305903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.306373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.306835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.307572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.308677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.309134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.334889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:33.383180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:33.393076 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c8e9170-8e55-4497-a8ea-0bec0e08a204 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.201407 Aug 30 18:42:33.402334 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2448/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:33 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:33.409104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.409746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.417503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.418005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.418576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.419522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.419981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.420413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.469319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:33.485365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:33.488303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:33.490585 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98a706df-8081-4fbb-acf6-eaf7ea3f9f73 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.200797 Aug 30 18:42:33.497722 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2554/5002] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:33 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:33.500683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64669e99-df85-4735-8577-f96fe18860a1 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e567e3940>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.522372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:33.531431 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7d06fbc5-30da-4429-bcdd-7ba7908bd801 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1474 microversion: 2.1 time: 0.127660 Aug 30 18:42:33.532125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2449/5003] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:33 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1474 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:33.538535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:33.541170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:33.555326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.556349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.556349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.556961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:33.557425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:33.557855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:33.608862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:33.617367 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d4d9c9a-365a-402a-bb6a-d2344b76fb4f tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083658 Aug 30 18:42:33.618448 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2450/5004] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:33 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:33.928897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:34.080190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64669e99-df85-4735-8577-f96fe18860a1 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210" status: 204 len: 0 microversion: 2.1 time: 0.586948 Aug 30 18:42:34.080801 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2555/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:33 2022] DELETE /compute/v2.1/images/5bd18b66-9e8a-4e94-9ca4-cb5e1c1fb210 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:34.089505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3132b036-5046-4aee-9d23-3bbdaebb4df5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e559e7d30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.415495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.416171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:34.423527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.423894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.424694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.425547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.427089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.440312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.622072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:34.633621 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58472fcd-aaa4-4c49-8775-712973913719 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.222569 Aug 30 18:42:34.637246 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2556/5006] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:34 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:34.655337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.656039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:34.663729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.665264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.666213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.667101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.667590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3132b036-5046-4aee-9d23-3bbdaebb4df5 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b" status: 204 len: 0 microversion: 2.1 time: 0.581900 Aug 30 18:42:34.670531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.670531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.670752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2451/5007] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:34 2022] DELETE /compute/v2.1/images/9da54acc-a43b-4dd1-862f-27f0fb15492b => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:34.673520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.674628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:34.693527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.694046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.694524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.695255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.695727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.696168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.829763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:34.844184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:34.848678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:34.854993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:34.855881 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f14aa6d6-00a0-426b-b15c-4d6e99a18ae5 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1474 microversion: 2.1 time: 0.186540 Aug 30 18:42:34.857114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-463d06d6-c3c2-42eb-a5e9-09a94b9fd0fd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.218897 Aug 30 18:42:34.858475 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2557/5008] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:34 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:34.864448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.867164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:34.876244 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2452/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:34 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:34.876969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.877708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.878453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.879746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.880556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.881299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.886298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:34.888577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:34.904208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.904962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.905708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.908291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:34.910161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:34.910931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:34.951614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24f65559-e672-4d89-8a63-b606041e0ed8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091640 Aug 30 18:42:34.952559 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2558/5010] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:34 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:34.967849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:35.074728 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab7a992d-5619-4c83-953f-b0f484add20c tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 204 len: 0 microversion: 2.1 time: 0.195177 Aug 30 18:42:35.078789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2453/5011] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:34 2022] DELETE /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:35.084151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:35.085183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:35.098051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.098671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.099180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.100886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.102316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.103549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.171747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d0d94a-bdd7-46ad-9f57-77eafa919b51", "name": "network-vif-deleted", "tag": "db5e01a1-f56d-4689-bf68-00ec0747392c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:35.183788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.184577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.185031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.201715 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] Creating event network-vif-deleted:db5e01a1-f56d-4689-bf68-00ec0747392c for instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 on n-h1-854119-10 Aug 30 18:42:35.207738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-89180522-4987-4ddb-9eb1-8f37509d26c8 req-ccdae0cc-a23c-4461-9438-4ec512953cf8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Aug 30 18:42:35.212271 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2454/5012] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:42:35.277446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:35.293119 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53c495bc-62b9-45b3-a4e6-b569b5e3323f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1474 microversion: 2.1 time: 0.213145 Aug 30 18:42:35.293710 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2559/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:35 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:35.661783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:35.662677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:35.669849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.670536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.670891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.672348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.672826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.673483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.816325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:35.824551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1c6bafd2-8ab0-4c72-aadc-4f2a6fb96705 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.168085 Aug 30 18:42:35.825190 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2455/5014] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:35 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:35.883544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:35.884486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:35.887332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:35.887992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:35.893930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.894465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.894914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.895055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.895547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.895856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.896146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.896434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.896928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.897040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:35.897556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:35.898059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:35.969103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:35.978670 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-064677dd-6e8b-4b68-9f46-da14b5c63f80 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1474 microversion: 2.1 time: 0.099428 Aug 30 18:42:35.979270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2560/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:35 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1474 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:35.995229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:35.998423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:36.006062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.007072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.007824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:36.008674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.009135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.009559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:36.013984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:36.047205 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed0ebb34-cac6-41e6-8989-5e3c3ca22383 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066658 Aug 30 18:42:36.051638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2561/5016] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:35 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:36.065667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:36.075310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:36.076744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:36.078080 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ff38d4f-f420-45f8-94ec-53ad0dda4f47 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.195107 Aug 30 18:42:36.078717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2456/5017] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:35 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:36.319787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:36.320876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:36.328195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.328943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.329532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:36.330513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.331288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.332012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:36.517941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:36.527294 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b907550-cfe6-49a4-ab53-55d778e33c86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1474 microversion: 2.1 time: 0.211368 Aug 30 18:42:36.541255 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2562/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:36 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1474 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:36.846576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:36.848267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:36.852026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:36.859688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.860419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.861184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:36.862120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:36.862698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:36.863290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.003348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:37.005238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:37.023273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.026896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.030490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.033068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.034653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.035274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.132590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.133401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.134023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.134658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lazy-loading 'fault' on Instance uuid 24d0d94a-bdd7-46ad-9f57-77eafa919b51 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:42:37.208727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.218905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfe7d1dd-0bc1-4d92-b047-1aef3ebc636b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 200 len: 1328 microversion: 2.1 time: 0.221233 Aug 30 18:42:37.232513 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2563/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:36 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 1328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:37.232513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:37.237043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:37.250619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.251114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.253162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.254821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.255618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.256090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.256520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.268915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfa47d34-250d-4029-94b2-0fc9f401ff2e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.426475 Aug 30 18:42:37.271711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2457/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:36 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:37.283237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:37.287614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:37.304232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.308208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.308979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.312707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.313495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.314159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.314640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a42340ce-f665-4cd5-a19b-69fe2b471b41 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092135 Aug 30 18:42:37.315558 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2564/5021] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:42:37 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:42:37.552599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:37.553177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:37.566760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.567341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.571671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.572553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.573040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.573750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.696561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.713931 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c5ea18c-947c-4e25-abf5-9c05b33e7e22 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 200 len: 1432 microversion: 2.1 time: 0.166404 Aug 30 18:42:37.714597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2565/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:37 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 1432 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:37.720106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b546f0-bb05-46d4-a51f-dde507b7f266", "name": "network-vif-deleted", "tag": "17a0f7b9-69d8-41c5-bd62-357d09003cf2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:37.746614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:37.747190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:37.747772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:37.775743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] Creating event network-vif-deleted:17a0f7b9-69d8-41c5-bd62-357d09003cf2 for instance b5b546f0-bb05-46d4-a51f-dde507b7f266 on n-h1-854119-10 Aug 30 18:42:37.800081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-53e49163-486d-4b0b-b66e-8d775dc6544b req-9af7f764-32cb-42f8-ae5d-7c8d814e03fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083668 Aug 30 18:42:37.800708 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2566/5023] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:37.837923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.857823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.859967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:37.861723 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1e12c44a-e893-4700-be77-302fb43de597 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.586758 Aug 30 18:42:37.862407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2458/5024] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:37 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:38.046656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:38.051515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.076802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.082907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.084183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.085506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.086309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.087182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.135924 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Cannot 'reboot' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action HTTP/1.1 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 28 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: {"reboot": {"type": "HARD"}} Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'reboot' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '317146d4-d1ed-4da8-8434-3775abed3953', 'body': {'reboot': {'type': 'HARD'}}} Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 317146d4-d1ed-4da8-8434-3775abed3953 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:42:38.138929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 409 to user: Cannot 'reboot' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-868c5190-4cbb-47b3-92e8-56c695101aa0 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action" status: 409 len: 145 microversion: 2.1 time: 0.106682 Aug 30 18:42:38.146963 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2567/5025] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:42:38 2022] POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:42:38.156202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:38.159705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.186070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.187554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.188163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.190148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.196154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.196834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.244645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.245336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 24d0d94a-bdd7-46ad-9f57-77eafa919b51] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.267628 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Cannot 'rebuild' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.269553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.270323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.271012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.271898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.272505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.273162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action HTTP/1.1 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 65 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'rebuild' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '317146d4-d1ed-4da8-8434-3775abed3953', 'body': {'rebuild': {'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292'}}} Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 317146d4-d1ed-4da8-8434-3775abed3953 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:42:38.278909 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued Aug 30 18:42:38.284041 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.289811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 409 to user: Cannot 'rebuild' instance 317146d4-d1ed-4da8-8434-3775abed3953 while it is in vm_state rescued {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:38.291737 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-45298763-6adf-4708-98b2-a574f0d13a2c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action" status: 409 len: 146 microversion: 2.1 time: 0.140983 Aug 30 18:42:38.295293 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2459/5026] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:42:38 2022] POST /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953/action => generated 146 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:42:38.312775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.317108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.329723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] HTTP exception thrown: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Request method failure captured: Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 HTTP/1.1 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlmIWFtxh_bOLbF9vF9FQd8NOV3XWkvUfFELFIimwKDg_jzCs6COlNkbxl9ZN9ai1vwe0C_HYQ7mb8_W7tma9ydN1aHdfRqhBRFuXGRmTLNdDQwBRsYYW3E41wuOBFNvP-xfrPujdtzXTqW3lMI_jRZITocJp11BUkasU-Fkbbz4nfw Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 17aa20801b2a4948a6820565bffd97c5 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 17aa20801b2a4948a6820565bffd97c5 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestSecurityGroupsBasicOps-965844980-project Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 83e04bc3c5824c62b4ad1a1c309912fb Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestSecurityGroupsBasicOps-965844980-project Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '24d0d94a-bdd7-46ad-9f57-77eafa919b51'} Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.340701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. Aug 30 18:42:38.344934 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.347844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.348752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.349389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.349879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Returning 404 to user: Instance 24d0d94a-bdd7-46ad-9f57-77eafa919b51 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:38.351040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.352055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.353131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.353641 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2188386d-0985-4676-8c1c-604ee251134b tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51" status: 404 len: 111 microversion: 2.1 time: 0.111659 Aug 30 18:42:38.356738 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2568/5027] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:38 2022] GET /compute/v2.1/servers/24d0d94a-bdd7-46ad-9f57-77eafa919b51 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:42:38.376676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.381160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.401728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.402654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.403392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.407389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.408635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.410125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.471270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:38.641555 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89e98bdf-7926-4807-89cf-96ffe07eabf1 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 204 len: 0 microversion: 2.1 time: 0.279982 Aug 30 18:42:38.642954 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2569/5028] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:38 2022] DELETE /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:38.651857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.653218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.670400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.671435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.672141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.673337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.677228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.678032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.739750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:38.749816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b53b2bff-e9d0-42b5-a42f-40416146ba7f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.452759 Aug 30 18:42:38.765808 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2460/5029] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:38 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:38.780276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.791218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: b5b546f0-bb05-46d4-a51f-dde507b7f266] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.802878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.812254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.813078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.814148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.814879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.817303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.856837 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] HTTP exception thrown: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Request method failure captured: Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 HTTP/1.1 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmGwiXAcLFD109W9erxncpIyeShaYPE8g2yH4tzQQRvJ8sauT-lKZwoY7mv0SY5BK38Pnd7SJPjKrjcLgMvJ7q25gNOaWhAqjKDNsxhijlmafDxBe4Dyl3ovetuvSREgu1rsmGNbF_LXWgvbGtw9ASEr2bLDWK-v_vL-ydQwhRDzB8 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a328425416b74131b7552d04e1c6d389 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a328425416b74131b7552d04e1c6d389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a328425416b74131b7552d04e1c6d389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a328425416b74131b7552d04e1c6d389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a328425416b74131b7552d04e1c6d389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a328425416b74131b7552d04e1c6d389 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ListImageFiltersTestJSON-2028391494-project Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 64511a61b3974110a40baf9343dbd1dc Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ListImageFiltersTestJSON-2028391494-project Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b5b546f0-bb05-46d4-a51f-dde507b7f266'} Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:38.859037 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. Aug 30 18:42:38.866821 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:42:38.868829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Returning 404 to user: Instance b5b546f0-bb05-46d4-a51f-dde507b7f266 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:38.870085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ee1f85d-b478-4e96-b20b-a59c003d46c0 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266" status: 404 len: 111 microversion: 2.1 time: 0.102678 Aug 30 18:42:38.871288 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2461/5030] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:38 2022] GET /compute/v2.1/servers/b5b546f0-bb05-46d4-a51f-dde507b7f266 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:42:38.897400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:38.899627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:38.918190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.919008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.919985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.921410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:38.922136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:38.931306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:38.993777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:39.142320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:39.181427 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f462420-aa18-40bd-bac6-bcd83c716899 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1691 microversion: 2.1 time: 0.529995 Aug 30 18:42:39.185557 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2570/5031] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:38 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1691 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:39.194768 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e904516-fee4-4f7d-bd79-0a1b91382ca8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 204 len: 0 microversion: 2.1 time: 0.317448 Aug 30 18:42:39.196245 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2462/5032] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:38 2022] DELETE /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:39.203843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:39.207146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:39.212492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:39.214751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:39.226158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.227500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.227972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:39.230965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.232325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.232450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.232914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:39.234849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.237623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:39.238636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.242143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.242871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:39.590374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:39.609253 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf945f25-6cf9-4013-90cc-383c76052d86 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1474 microversion: 2.1 time: 0.405259 Aug 30 18:42:39.609744 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2463/5033] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:39 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:39.807744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:39.829387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:39.837135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:39.853508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:39.879670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:39.881382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19ddb190-d3ee-4509-b5c6-4f1d4d912fca tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 0.692889 Aug 30 18:42:39.881827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.888753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.894116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:39.895108 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2571/5034] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:39 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:39.897460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:39.898708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:39.901278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.218126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:40.220053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:40.227259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:40.259782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.261111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.262256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.264974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.268972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.269771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.357515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:40.368867 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-118ccd76-eca4-4249-b8fc-6b0e63aa81f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.579431 Aug 30 18:42:40.373609 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2464/5035] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:39 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:40.632523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:40.633532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:40.650435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.655928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.658998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:40.662334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:40.663176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:40.665561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:41.127521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:41.164358 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92f5f16a-1f3a-43b3-9b68-abe25451264e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1474 microversion: 2.1 time: 0.533518 Aug 30 18:42:41.183985 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2465/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:40 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1474 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:41.198733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:41.204202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:41.223957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:41.225820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:41.226628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:41.229038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:41.229950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:41.232239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:41.995581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.007187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb9c9637-9774-4862-9149-10a23be5d2b9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1691 microversion: 2.1 time: 1.795087 Aug 30 18:42:42.023390 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2572/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:40 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1691 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:42:42.038102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:42.049527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:42.095262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.096674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.099968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.102919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.109708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.117249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.585549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.600588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:42.614201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.618610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.623069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4cc13ff2-29f6-4e03-8974-5ab83b6b9780 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 1.434784 Aug 30 18:42:42.645181 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2466/5038] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:41 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:42.667182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:42.671371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:42.708025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.709295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.710121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.710923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:42.711405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:42.711853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:42.872113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:42.905495 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac67ba20-15f7-423a-9801-a965aa3d14aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.876495 Aug 30 18:42:42.907466 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2573/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:42 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:43.036126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:43.038245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:43.053308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:43.058334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:43.059321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:43.060707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:43.062392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:43.063222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:44.019913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:44.032246 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-422fa312-f8e0-4aaa-9330-5c0db25efb05 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1691 microversion: 2.1 time: 1.000049 Aug 30 18:42:44.039520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2574/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:43 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1691 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:44.045436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:44.054506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:44.067175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:44.071628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:44.072480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:44.077431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:44.078449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:44.079143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:45.011735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:45.048683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:45.065710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:45.068293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5573df18-3828-430b-8736-3c21a329d1d7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1751 microversion: 2.20 time: 1.026857 Aug 30 18:42:45.082991 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2575/5041] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:44 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1751 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:45.110702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:45.130289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:45.176591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:45.177411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:45.179319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:45.183601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:45.191254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:45.192932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.093667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:46.140978 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-70896a27-c6bc-499c-8b0f-5bd4e95f242d tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1474 microversion: 2.1 time: 3.481004 Aug 30 18:42:46.144408 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2467/5042] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:42 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1474 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:46.172801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:46.174536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:46.208900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:46.209752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:46.211601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.213881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:46.215037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:46.237550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.246071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:46.295124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c0a075f-72f6-4acb-8a7e-e1069611da27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.202267 Aug 30 18:42:46.319245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2576/5043] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:45 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:46.364443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:46.365059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:46.426325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:46.429700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:46.430575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.431541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:46.439087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:46.439726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.497269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:42:46.667010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:46.719332 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc356749-a722-409a-839f-8fc0fd48a8c5 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 200 len: 1623 microversion: 2.1 time: 0.569979 Aug 30 18:42:46.725717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2468/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:46 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 1623 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:46.764601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551131-3e02-4926-b3f9-d8b3acf37b62", "name": "network-vif-deleted", "tag": "5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:46.789159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:46.794136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:46.801166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:46.855684 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] Creating event network-vif-deleted:5917a5d1-ed74-45a0-bbaf-e9777dc3bdc9 for instance b5551131-3e02-4926-b3f9-d8b3acf37b62 on n-h1-854119-10 Aug 30 18:42:46.882504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-23f1a232-0381-48e2-9a3e-7e30c357484a req-36c3e914-4752-406e-a59e-f21bdc4c792d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152439 Aug 30 18:42:46.889396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2469/5045] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:47.178238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:47.180837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:47.216202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:47.225343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:47.227084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:47.231878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:47.235798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:47.236717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.119995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:48.120627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:48.121439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.122453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lazy-loading 'fault' on Instance uuid df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:42:48.254409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64511a61b3974110a40baf9343dbd1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328425416b74131b7552d04e1c6d389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:48.274593 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b4fbbc0-fae5-4425-b6c7-946faeb41e14 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 200 len: 1308 microversion: 2.1 time: 1.107932 Aug 30 18:42:48.277491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2470/5046] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:47 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 1308 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:48.294943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:48.298574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:48.321827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:48.322790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:48.327651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:48.339284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.345521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:48.347113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:48.354567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.363252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:48.373330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:48.379153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8927ca39-2fa5-43a6-905a-6b9599c46130 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 2.045333 Aug 30 18:42:48.404452 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2577/5047] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:46 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:48.425395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:48.428131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: b5551131-3e02-4926-b3f9-d8b3acf37b62] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:48.449791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:48.451154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:48.453467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.454661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:48.457024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:48.460715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:48.537589 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 HTTP/1.1 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b5551131-3e02-4926-b3f9-d8b3acf37b62'} Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:48.554641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 404 to user: Instance b5551131-3e02-4926-b3f9-d8b3acf37b62 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:48.562694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8ed22d8f-5fbf-49cc-a1bc-707dc2ac0612 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62" status: 404 len: 111 microversion: 2.1 time: 0.149173 Aug 30 18:42:48.568228 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2578/5048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:48 2022] GET /compute/v2.1/servers/b5551131-3e02-4926-b3f9-d8b3acf37b62 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:42:48.580842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28f7b5e4-1403-4dab-9f28-bf2664fd3d88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '.version_select at 0x7f4e56aeff70>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:48.640684 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28f7b5e4-1403-4dab-9f28-bf2664fd3d88 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761632789" status: 202 len: 0 microversion: 2.1 time: 0.071584 Aug 30 18:42:48.647039 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2579/5049] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761632789 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:42:48.991278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9c6994-e935-4f32-bcf4-cb5e02f7dfe2", "name": "network-vif-deleted", "tag": "c003f6b0-c1eb-49b4-b149-8896465048b1"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:49.024335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:49.026765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:49.027684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:49.048401 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] Creating event network-vif-deleted:c003f6b0-c1eb-49b4-b149-8896465048b1 for instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 on n-h2-854119-10 Aug 30 18:42:49.070027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-777f6bfb-65ff-4c75-961f-8b98ba12f8d5 req-cbbdef44-5468-4af6-b44e-06f13e49389a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128349 Aug 30 18:42:49.072178 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2580/5050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:42:49.126885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:49.166113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2398910-49b3-4546-8f6f-8d42152049f0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.886654 Aug 30 18:42:49.179194 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2471/5051] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:48 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:49.322409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:49.323150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] [instance: df9c6994-e935-4f32-bcf4-cb5e02f7dfe2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:49.338075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:49.339590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:49.343715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:49.345120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:49.345792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:49.352178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:49.427347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:49.428224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:49.521244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:49.523294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:49.529255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:49.530169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] HTTP exception thrown: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. Aug 30 18:42:49.537452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:49.538955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Request method failure captured: Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 HTTP/1.1 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlmGwiXAcLFD109W9erxncpIyeShaYPE8g2yH4tzQQRvJ8sauT-lKZwoY7mv0SY5BK38Pnd7SJPjKrjcLgMvJ7q25gNOaWhAqjKDNsxhijlmafDxBe4Dyl3ovetuvSREgu1rsmGNbF_LXWgvbGtw9ASEr2bLDWK-v_vL-ydQwhRDzB8 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: a328425416b74131b7552d04e1c6d389 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a328425416b74131b7552d04e1c6d389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a328425416b74131b7552d04e1c6d389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a328425416b74131b7552d04e1c6d389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a328425416b74131b7552d04e1c6d389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: a328425416b74131b7552d04e1c6d389 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2028391494 Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ListImageFiltersTestJSON-2028391494-project Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 64511a61b3974110a40baf9343dbd1dc Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ListImageFiltersTestJSON-2028391494-project Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'df9c6994-e935-4f32-bcf4-cb5e02f7dfe2'} Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:42:49.539860 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. Aug 30 18:42:49.544712 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:42:49.553337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:49.554189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Returning 404 to user: Instance df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:42:49.555458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29cf8955-dc67-4c1e-9a7a-3bae4b61e24f tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2" status: 404 len: 111 microversion: 2.1 time: 0.237643 Aug 30 18:42:49.564741 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2581/5052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:49 2022] GET /compute/v2.1/servers/df9c6994-e935-4f32-bcf4-cb5e02f7dfe2 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:42:49.599478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67cec35e-e901-4111-9b9a-b6f5fea017cc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e56a5e9d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:50.453103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:50.483710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:50.491542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:50.496729 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bbe5cddc-4dca-4991-8e6b-4ce0ec22a965 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.087358 Aug 30 18:42:50.509495 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2472/5053] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:49 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:50.528274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:50.533348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:50.564721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:50.565215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:50.565736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:50.571516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:50.572637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:50.573545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:51.364774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:51.383858 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0b8ba53-2b57-45f3-bd88-47633e1da8c3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.871180 Aug 30 18:42:51.399073 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2473/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:50 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:51.533044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:51.534062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:51.576306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:51.580186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:51.581155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:51.591507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:51.593994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:51.598947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:51.658636 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67cec35e-e901-4111-9b9a-b6f5fea017cc tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7" status: 204 len: 0 microversion: 2.1 time: 2.085181 Aug 30 18:42:51.658636 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2582/5055] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:49 2022] DELETE /compute/v2.1/images/f037d678-c990-4c40-9440-aa6a7798e0e7 => generated 0 bytes in 2087 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:51.667815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5bc1a65-3b8a-40dc-802f-d822f5400e1e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e55aec160>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:52.636101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:52.652681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:52.656872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:52.660636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d0de901-767b-4513-964b-192cb644bb72 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.132864 Aug 30 18:42:52.664816 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2474/5056] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:51 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:42:52.674441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:52.700988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:52.701482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:52.702202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:52.734677 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] Creating event network-changed:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h2-854119-10 Aug 30 18:42:52.742659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2ce541af-f304-4e5e-9e13-66d6e6f6b300 req-9e73daef-4158-463a-a233-2f209fd20740 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075958 Aug 30 18:42:52.751876 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2475/5057] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:52.766186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:52.767039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:52.787511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:52.787511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:52.787895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:52.788557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:52.789043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:52.789554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:53.019486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5bc1a65-3b8a-40dc-802f-d822f5400e1e tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55" status: 204 len: 0 microversion: 2.1 time: 1.357024 Aug 30 18:42:53.022854 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2583/5058] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:51 2022] DELETE /compute/v2.1/images/e5177ecc-c5db-4c68-991e-54df16e66d55 => generated 0 bytes in 1362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:42:53.033013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d588a2df-2547-440f-93ae-0ed090da76e8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] Calling method '.version_select at 0x7f4e5aef9310>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:53.821187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:53.832713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2945a064-8a95-41f8-8e24-d413a1d802fa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.079467 Aug 30 18:42:53.839421 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2476/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:52 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:53.860711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:53.870690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:53.912411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:53.915544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:53.916902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:53.924828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:53.931670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:53.934401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:54.208198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d588a2df-2547-440f-93ae-0ed090da76e8 tempest-ListImageFiltersTestJSON-2028391494 tempest-ListImageFiltersTestJSON-2028391494-project] 10.222.0.25 "DELETE /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3" status: 204 len: 0 microversion: 2.1 time: 1.180688 Aug 30 18:42:54.209446 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2584/5060] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:53 2022] DELETE /compute/v2.1/images/b2e1bb8f-fac2-4827-a8a7-1bb28a1f6bf3 => generated 0 bytes in 1183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:42:54.873449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:54.874645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:54.905015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:54.907554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:54.910078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:54.915715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:54.919664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:54.923375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:55.084967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:55.099719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:55.104169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:55.107486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e29c110d-1b5f-45a0-b957-c3b55d900181 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.265905 Aug 30 18:42:55.123771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2477/5061] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:53 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:55.480344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:55.496631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26184709-a39f-4527-b7bd-df7d0ceecb23 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.633249 Aug 30 18:42:55.498212 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2585/5062] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:54 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:56.142820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:56.144334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:56.170823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:56.174868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:56.175897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:56.178517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:56.183533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:56.187404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:56.537552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:56.548161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:56.604391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:56.605546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:56.606439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:56.610986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:56.613254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:56.613944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:57.049573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:57.111890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:57.134054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:57.142780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:57.143077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-da0b1a22-6c5b-4550-904c-ca59a9df7a70 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.000688 Aug 30 18:42:57.146941 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2478/5063] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:56 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:42:57.173822 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-128de9b0-6f64-4fe9-99e9-c3caf757b328 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.651945 Aug 30 18:42:57.191315 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2586/5064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:56 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:57.254933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:57.255855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:57.259911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413b867c-6bf5-471e-ac66-4a895b18c0b3", "tag": "61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:42:57.314047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:57.321211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:57.324758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:57.331743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:57.332947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:57.334724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:57.335283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:57.336694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:57.337832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:57.436293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] Creating event network-changed:61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c for instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 on n-h2-854119-10 Aug 30 18:42:57.453991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0c1f7e9e-8be8-407a-a6e7-8d0a71bccf70 req-6ed04166-39f8-4cae-97ea-8e0de0d2f3a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213322 Aug 30 18:42:57.470448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2587/5065] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:42:57.485455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:42:57.765793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95f8e4e4-77d1-4bef-b870-054c7b0e36b0 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "DELETE /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 204 len: 0 microversion: 2.1 time: 0.525189 Aug 30 18:42:57.774629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2479/5066] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:42:57 2022] DELETE /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:42:57.778944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:57.779697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:57.808240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:57.808739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:57.809308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:57.810066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:57.810606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:57.811264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.199172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:58.200043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:58.219566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.222935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.223386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.224384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.226198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.228717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.367966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:58.392230 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e19575b7-263f-4f26-9909-8890cb898206 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1766 microversion: 2.1 time: 0.617316 Aug 30 18:42:58.393739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2588/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:57 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1766 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:58.402775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:58.404269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:58.444145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.452851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.454030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.455514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:58.456570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:58.460224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:58.869556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:58.915903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:58.938716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:58.945567 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-199a3cdb-d11b-445c-a3c2-72fdbe68366d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.745940 Aug 30 18:42:58.958621 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2480/5068] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:58 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:42:59.067648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:42:59.084366 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-175f36c4-b79c-40a2-901c-eea161fe68d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.686101 Aug 30 18:42:59.101784 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2589/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:58 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:42:59.423780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:59.425742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:42:59.453857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:59.457687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:59.459916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:59.466414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:42:59.472763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:42:59.477025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:42:59.980099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:42:59.981027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:00.009491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:00.011170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:00.012383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:00.019300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:00.021855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:00.022645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:01.019837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:01.038805 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d806622a-c4e3-409e-a37d-00558b880840 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1766 microversion: 2.1 time: 1.616061 Aug 30 18:43:01.059269 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2481/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:42:59 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1766 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:01.081381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:01.084248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:01.112892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:01.117401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:01.121240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:01.122392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:01.126567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:01.130130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:01.337367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:01.365024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:01.381958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:01.384549 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cbbe68d4-20f4-431f-b192-c4276b1688c2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.409096 Aug 30 18:43:01.426757 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2590/5071] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:42:59 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:02.067841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:02.068775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:02.091889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:02.095180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:02.095749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:02.101028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:02.101712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:02.104570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:02.680976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:02.698604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:02.705831 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a316df0a-43c9-4403-979b-a3a84a2864e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.641559 Aug 30 18:43:02.709204 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2482/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:01 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:02.777114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413b867c-6bf5-471e-ac66-4a895b18c0b3", "name": "network-vif-deleted", "tag": "61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:02.832468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:02.840119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:02.842479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:02.876529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] Creating event network-vif-deleted:61a0eb7c-3d0d-4ccc-80cb-e656a3c68c2c for instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 on n-h2-854119-10 Aug 30 18:43:02.901897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:02.930617 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3169c17c-d485-4601-b415-5dd664b19afc req-3a203108-6fe8-4318-b7a4-6f12429150af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194295 Aug 30 18:43:02.935248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2483/5073] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:02.964952 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67952bf2-6706-4e8a-87e0-fbd82e7e318a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1528 microversion: 2.1 time: 0.898097 Aug 30 18:43:02.972068 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2591/5074] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:02 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1528 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:02.984332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:02.985139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:03.002681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.003226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.005091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:03.007116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.007650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.009568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:03.731657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:03.732631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:03.753500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.754012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.754470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:03.761427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:03.764807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:03.765634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.028760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.105373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.107960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.110438 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac333114-5cc5-45f4-b05b-0fe7ccc4537e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.172222 Aug 30 18:43:04.112555 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2484/5075] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:02 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:04.118781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:04.120027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:04.161250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:04.164222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:04.166246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.171729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:04.180239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:04.181310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.257704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:04.259209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:04.260061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:04.260877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lazy-loading 'fault' on Instance uuid 413b867c-6bf5-471e-ac66-4a895b18c0b3 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:43:04.557696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.578117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e04bc3c5824c62b4ad1a1c309912fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17aa20801b2a4948a6820565bffd97c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:04.579927 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f76bd08b-1c8c-45ae-a48d-d7c01c86aef5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.849463 Aug 30 18:43:04.582856 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2592/5076] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:03 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:04.630530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97c631ac-f392-458e-8619-91d9928a67f3 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 200 len: 1381 microversion: 2.1 time: 0.510442 Aug 30 18:43:04.635337 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2485/5077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:04 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 1381 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:05.156995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:05.158183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:05.180591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.181440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.182386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:05.185094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.187356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.188240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:05.617423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:05.621626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:05.662956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.663816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.664459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:05.665923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:05.666681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:05.667450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:06.838391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:06.868152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-986e5dc6-1e4a-4ed9-9ca2-b26456d08000 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.260337 Aug 30 18:43:06.875600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2486/5078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:05 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:06.899582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:06.902885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] [instance: 413b867c-6bf5-471e-ac66-4a895b18c0b3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:06.930465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:06.942706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:06.947474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:06.948777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:06.962857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:06.964519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:06.967512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:07.029519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:07.061827 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] HTTP exception thrown: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. Aug 30 18:43:07.077655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Request method failure captured: Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 HTTP/1.1 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmIWFtxh_bOLbF9vF9FQd8NOV3XWkvUfFELFIimwKDg_jzCs6COlNkbxl9ZN9ai1vwe0C_HYQ7mb8_W7tma9ydN1aHdfRqhBRFuXGRmTLNdDQwBRsYYW3E41wuOBFNvP-xfrPujdtzXTqW3lMI_jRZITocJp11BUkasU-Fkbbz4nfw Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 17aa20801b2a4948a6820565bffd97c5 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_17aa20801b2a4948a6820565bffd97c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 17aa20801b2a4948a6820565bffd97c5 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-965844980 Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestSecurityGroupsBasicOps-965844980-project Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 83e04bc3c5824c62b4ad1a1c309912fb Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestSecurityGroupsBasicOps-965844980-project Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '413b867c-6bf5-471e-ac66-4a895b18c0b3'} Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:07.079542 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. Aug 30 18:43:07.084798 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:43:07.090019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Returning 404 to user: Instance 413b867c-6bf5-471e-ac66-4a895b18c0b3 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:43:07.091102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:07.092569 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67923393-f47d-48ba-a35f-89916c0fd8c7 tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3" status: 404 len: 111 microversion: 2.1 time: 0.213417 Aug 30 18:43:07.096315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c45d4851-51d8-4de3-ac0a-40efdf3f2f9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.945898 Aug 30 18:43:07.097703 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2487/5079] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:06 2022] GET /compute/v2.1/servers/413b867c-6bf5-471e-ac66-4a895b18c0b3 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:43:07.111891 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2593/5080] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:05 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:43:07.940065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:07.949638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:08.037276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.045371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.052851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.055891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.067749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.070765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.150766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:08.172152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:08.209285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.216707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.218879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:08.220205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:08.222615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:08.223434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:09.095742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:09.111744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd63da54-cb81-42d6-a33b-c4d4f01ce1c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.198955 Aug 30 18:43:09.137606 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2594/5081] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:07 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:10.145254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:10.146888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:10.161491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:10.166525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:10.167310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:10.169244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:10.171111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:10.172881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:11.055678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:11.085510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:11.100651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:11.103044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:11.117765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4651d06-36f9-4564-ab1e-4ca13290a9b2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 2.977819 Aug 30 18:43:11.120253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2488/5082] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:08 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:11.130708 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5f475f4-ca60-4c8d-86aa-50617b959785 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.981558 Aug 30 18:43:11.148126 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2595/5083] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:10 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:11.871362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e1584c1e-642f-4e27-bae9-2ad1f3717c60 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: .version_select at 0x7f4e559525e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-937799425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK7I9uQa2vhEoLVxljIOebCZky4HtQ+rODP2CJo+5MXYrOkkIsTCUyJJvRloH5fWeOLY8z4s3qUAlomiHDV/tOhbxQmNcQEUQp1YQahDrI4i4rMbvQbIVlOn1bMtUwcDA=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:12.017755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-e1584c1e-642f-4e27-bae9-2ad1f3717c60 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:43:12.051341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-e1584c1e-642f-4e27-bae9-2ad1f3717c60 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:43:12.166741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:12.170273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:12.174844 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e1584c1e-642f-4e27-bae9-2ad1f3717c60 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.046494 Aug 30 18:43:12.176080 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2489/5084] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:43:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:12.200755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:12.204659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.206996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.209821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:12.210943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.211082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:12.212081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.214198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.215520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.257920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.824905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:12.856549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:12.870054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:12.872330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0e539e7-dcf2-4850-9bc8-58599c4d932c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.709653 Aug 30 18:43:12.894933 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2596/5085] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:12 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:43:12.912168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:12.916664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:12.931062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.931943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.932711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.933892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:12.935208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:12.936037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:12.980666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:43:13.098831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:13.108099 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb25f6fb-f5e3-4bc6-b0e3-cabb5a9989e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.919972 Aug 30 18:43:13.115144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2490/5086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:12 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:13.233608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5f82bc7-6fc2-468b-b1fc-0af8c74c48a7 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 204 len: 0 microversion: 2.1 time: 0.332941 Aug 30 18:43:13.238830 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2597/5087] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:43:12 2022] DELETE /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:43:13.247478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:13.248234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:13.275097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:13.275628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:13.276092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:13.276887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:13.277367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:13.277821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:13.901113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:13.901817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:13.915706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:13.916203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:13.916641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:13.917364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:13.917817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:13.918237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:14.071501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:14.084510 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5661180-9489-46cf-93ed-c9f0e47ec22c tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1508 microversion: 2.1 time: 0.841156 Aug 30 18:43:14.088206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2491/5088] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:13 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1508 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:14.142704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:14.143706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:14.156805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:14.157742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:14.158887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:14.161524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:14.163697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:14.164498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:14.706897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:14.718422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:14.724188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:14.740728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:14.756028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-435c5842-c848-4479-9519-341a9a37befe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.833489 Aug 30 18:43:14.760078 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2598/5089] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:13 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:43:14.771158 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b916bcd3-497e-4ef0-8414-c6e7e7571267 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.633398 Aug 30 18:43:14.772180 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2492/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:14 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:15.118159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:15.118159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:15.128257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.128750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.134780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:15.135986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.136673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.137279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:15.183565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:15.626578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:15.667741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa810924-00e1-4a5f-8b31-0f3b17c7b27d tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1508 microversion: 2.1 time: 0.554448 Aug 30 18:43:15.675107 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2599/5091] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:15 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1508 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:15.792431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:15.793262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:15.800347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:15.801526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:15.823614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.825696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.826491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.830913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.831763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:15.832749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.839385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:15.840437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.841559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:15.842279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:15.847923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:15.848788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:16.588890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:16.598279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-986fdf7d-722b-4f68-88bc-6a3e4009c051 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 0.809800 Aug 30 18:43:16.611478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2600/5092] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:15 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:16.698189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:16.699907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:16.710245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:16.713367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:16.714248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:16.717267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:16.721133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:16.721977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:17.095854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:17.105086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-662d4d42-ce69-4029-b3c7-dc549b3304c3 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1508 microversion: 2.1 time: 0.412501 Aug 30 18:43:17.115470 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2601/5093] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:16 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:17.163353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:17.194223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:17.207691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:17.210235 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb786f4f-c1a5-4d73-b7e3-b7b3d30c9712 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.426489 Aug 30 18:43:17.228275 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2493/5094] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:15 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:17.639588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:17.641906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:17.697233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:17.705512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:17.708261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:17.714986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:17.717571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:17.720008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.070315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317146d4-d1ed-4da8-8434-3775abed3953", "name": "network-vif-deleted", "tag": "cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:18.095029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.104880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.105355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.156724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] Creating event network-vif-deleted:cdeb2020-0fef-4eb2-9c0f-5b1d5b2cc150 for instance 317146d4-d1ed-4da8-8434-3775abed3953 on n-h2-854119-10 Aug 30 18:43:18.182843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5ee815a2-61af-4124-adaf-e989d0cc591f req-456e2537-1f16-419f-9dfe-e6992d6a9fb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117495 Aug 30 18:43:18.183529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2494/5095] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 18:43:18.214103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:18.216513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:18.242920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.243450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.244446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.246456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.251200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.252567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.410632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.411420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.412086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.417003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'fault' on Instance uuid 317146d4-d1ed-4da8-8434-3775abed3953 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:43:18.840788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:18.858611 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe4c5008-8e2f-441f-9ee7-dee92de02a5e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.222461 Aug 30 18:43:18.859684 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2602/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:17 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:18.881693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:18.893865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:18.914979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.916117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.921063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:18.924446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:18.937808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:18.942678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:19.011387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:19.024144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7120d218-f90b-48ae-b5b8-3c2e8fb2c4e4 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 200 len: 1311 microversion: 2.1 time: 0.829906 Aug 30 18:43:19.047528 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2495/5097] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:18 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 1311 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:19.539048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:19.569306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:19.573811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:19.577412 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce5fd426-d5ef-4312-9faf-19f94bd72d2e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.716343 Aug 30 18:43:19.586897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2603/5098] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:18 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:19.885329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:19.888208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:19.919737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:19.922919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:19.924435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:19.926794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:19.928566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:19.930651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.061610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:20.062217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 317146d4-d1ed-4da8-8434-3775abed3953] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:20.073804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.081173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.082097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.083019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.083553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.084072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.112903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 HTTP/1.1 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '317146d4-d1ed-4da8-8434-3775abed3953'} Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:20.122465 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 404 to user: Instance 317146d4-d1ed-4da8-8434-3775abed3953 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:43:20.127003 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b91008de-9f6d-4de4-802b-5fe402ba4702 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953" status: 404 len: 111 microversion: 2.1 time: 0.066809 Aug 30 18:43:20.128353 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2604/5099] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:20 2022] GET /compute/v2.1/servers/317146d4-d1ed-4da8-8434-3775abed3953 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:43:20.135626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:20.136117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:20.153208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.154042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.154864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.158763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.159556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.160227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.215173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:43:20.399282 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c6336f2-f561-44b7-9b81-29aabb52819a tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 204 len: 0 microversion: 2.1 time: 0.269594 Aug 30 18:43:20.400352 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2605/5100] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:43:20 2022] DELETE /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:43:20.415993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:20.418015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:20.434746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.437702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.439589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.440859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.443882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.446777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.906287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:20.915837 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-701cd903-2165-4984-a3f1-5ed5debaac72 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.506806 Aug 30 18:43:20.916971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2606/5101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:20 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:20.923490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:20.924761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:20.942973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.943771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.944370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:20.945277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:20.946943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:20.949700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:21.147249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:21.158458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:21.159701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:21.161035 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ecee5a07-694a-48e0-a8e9-dec12c387dfd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.242828 Aug 30 18:43:21.176913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2607/5102] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:20 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:21.201283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:21.215509 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a35c81af-b951-49da-a61b-80d5505a2538 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1342 microversion: 2.1 time: 1.336921 Aug 30 18:43:21.216825 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2496/5103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:19 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1342 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:21.942978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:21.943936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:21.964359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:21.964865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:21.965310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:21.966042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:21.966972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:21.967155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:22.186637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:22.187281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:22.190335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:22.204184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:22.204777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:22.205134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:22.205897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:22.206336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:22.206783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:22.435296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:22.467302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18c8ca75-4b34-4217-ba27-59b8dc38e030 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.531434 Aug 30 18:43:22.491662 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2608/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:21 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:22.496741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:22.497364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:22.524014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:22.524518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:22.537657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:22.538566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:22.539254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:22.539867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:22.866070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:22.882082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:22.887934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:22.903259 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3f0088bb-9ab9-4db3-a1ab-93ba200f7d48 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.721032 Aug 30 18:43:22.908497 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2497/5105] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:22 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:22.926689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82054466-06d3-4385-acc2-400db3eb930a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] Calling method '.version_select at 0x7f4e5595fd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:22.982162 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82054466-06d3-4385-acc2-400db3eb930a tempest-TestSecurityGroupsBasicOps-965844980 tempest-TestSecurityGroupsBasicOps-965844980-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-50597129" status: 202 len: 0 microversion: 2.1 time: 0.069932 Aug 30 18:43:22.985566 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2498/5106] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-50597129 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:43:23.500272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:23.501480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:23.513141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:23.514379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:23.515078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:23.516108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:23.517985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:23.518678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:23.756301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:23.766161 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-547cf9ec-28fb-47f6-b130-42c7a07795bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1388 microversion: 2.1 time: 1.273344 Aug 30 18:43:23.766795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2609/5107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:22 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1388 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:23.949280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:23.949964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:23.970885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:23.977687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:23.979370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:23.986196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:23.987174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:23.989026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:23.991183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:24.000273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b62dd95b-4ad2-42db-b9fc-844fe8a71ea8 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1521 microversion: 2.1 time: 0.506627 Aug 30 18:43:24.000873 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2499/5108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:23 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:24.364581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:24.378325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:24.379970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:24.381090 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d46b0d2d-a646-49e0-8684-225f16b40263 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.435876 Aug 30 18:43:24.381706 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2610/5109] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:23 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:24.792542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:24.794183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:24.803971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:24.804760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:24.805451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:24.807672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:24.808632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:24.809577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:25.029343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:25.031087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:25.044795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:25.045867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:25.046762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:25.047843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:25.048661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:25.049629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:25.158388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:25.177178 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-33889495-0024-4c9a-bd16-4d1dbc46d101 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1479 microversion: 2.1 time: 0.155781 Aug 30 18:43:25.199085 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2611/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:25 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1479 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:25.367744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e5e21-d569-437d-85ba-fad1bd3361ae", "name": "network-vif-deleted", "tag": "f0e33be1-d398-4b97-a493-bed5d7d1d4d2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:25.371862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:25.396565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:25.399713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:25.431393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:25.446215 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6604cd8-1ef1-48fb-a74b-7edd26a7da11 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.637769 Aug 30 18:43:25.462970 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2500/5111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:24 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:25.489155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:25.489815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:25.495101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] Creating event network-vif-deleted:f0e33be1-d398-4b97-a493-bed5d7d1d4d2 for instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae on n-h2-854119-10 Aug 30 18:43:25.519455 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4ebe4d7f-2f74-47e8-bdf3-84e79467fd69 req-d30e07be-7a71-43cf-bf34-e56c0b37b4d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157292 Aug 30 18:43:25.523963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:25.524315 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2612/5112] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:43:25.524604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:25.525077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:25.532094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:25.532851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:25.533324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.202601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:26.203320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:26.213589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:26.240976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:26.248512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:26.251533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.255329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:26.257602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:26.260253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:26.260714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.264313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:26.268935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13176298-c921-42ec-b1d5-bf54307117ed tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.815126 Aug 30 18:43:26.271753 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2501/5113] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:25 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:26.348670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:26.349168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:26.361038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.392878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lazy-loading 'fault' on Instance uuid 5f4e5e21-d569-437d-85ba-fad1bd3361ae {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:43:26.483573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:26.484941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:26.511160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:26.513325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:26.514458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.518041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:26.520123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:26.521310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:26.656216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf78635374746d793bae244e2a28989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119ec7495f3f4efabf939dec536feb52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:26.666919 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27bcc61c-efc7-4ddd-b3ff-064e69e6cf19 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 200 len: 1311 microversion: 2.1 time: 0.466567 Aug 30 18:43:26.683409 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2613/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:26 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 1311 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:26.868610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:26.871694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:26.903009 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac0a5b0d-3e2e-43c7-84ab-bb797332d2f1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.422387 Aug 30 18:43:26.905230 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2502/5115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:26 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:27.060766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e5741bc-1c1c-40c0-adcb-41931c42b85e tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Action: 'create', calling method: .version_select at 0x7f4e55d5d790>, body: {"keypair": {"name": "tempest-keypair-2121712846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARqD74pIQlYZ2pgVjpHV+UUC56mlOQVvGT9uLv9rDahMalKr19vrdXNukATbdfah9uLCGAQEYn4cJXLClkMugiGfJOYEUB6SKW1h+mpgvy++LB+ms+EYdxaDNbKv190lA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:27.087093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7e5741bc-1c1c-40c0-adcb-41931c42b85e tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for project 39cd889057a24e0abb0f3ebf950cecef. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:43:27.095910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7e5741bc-1c1c-40c0-adcb-41931c42b85e tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for user 4dd9c53c452c4d3ea1e6650deb9d2ee8 and project 39cd889057a24e0abb0f3ebf950cecef. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:43:27.147464 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e5741bc-1c1c-40c0-adcb-41931c42b85e tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.461099 Aug 30 18:43:27.151349 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2614/5116] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:43:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:27.313659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:27.314665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:27.333685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.336817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.339325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:27.341831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.344093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.345733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:27.690404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:27.691711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] [instance: 5f4e5e21-d569-437d-85ba-fad1bd3361ae] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:27.719296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.721102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.722194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:27.728669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.730719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.731423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:27.846625 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] HTTP exception thrown: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. Aug 30 18:43:27.881963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Request method failure captured: Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae HTTP/1.1 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDljckzoFs5HdPTlJeZS8t7PwqNgCmq5eGDK6TB4r8PbdBXVxM7ZcTHR2XqYQjzu_Y2vnVf1xchHLUwCIAk-rqGu6HCfB1uFimlHrayCiTXyWFb0EuVV3LYK2S9lEHXN5_SYS5-4AIVW2oksNXO3PF1fGWQv9xpfkdtUbVBoT49-nPwQ Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/119ec7495f3f4efabf939dec536feb52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_119ec7495f3f4efabf939dec536feb52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 119ec7495f3f4efabf939dec536feb52 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164649420 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: faf78635374746d793bae244e2a28989 Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164649420-project Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5f4e5e21-d569-437d-85ba-fad1bd3361ae'} Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:27.894256 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. Aug 30 18:43:27.900905 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:27.930249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] Returning 404 to user: Instance 5f4e5e21-d569-437d-85ba-fad1bd3361ae could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:43:27.931823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-007ce4be-bd58-4d81-8707-bd28a60627d9 tempest-ServerRescueNegativeTestJSON-164649420 tempest-ServerRescueNegativeTestJSON-164649420-project] 10.222.0.25 "GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae" status: 404 len: 111 microversion: 2.1 time: 0.246369 Aug 30 18:43:27.942960 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2615/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:27 2022] GET /compute/v2.1/servers/5f4e5e21-d569-437d-85ba-fad1bd3361ae => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:43:27.956501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:27.959484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:27.960418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:27.961435 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e5f3dcf0-c7a4-4c46-bd1c-fd4862b9be31 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 0.653691 Aug 30 18:43:27.962389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:27.978418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.980223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.981550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:27.984188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:27.987210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:27.988631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:28.010823 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2503/5118] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:27 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:29.004467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:29.005400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:29.022093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:29.026715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:29.027296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:29.028666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:29.038011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:29.044766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:29.605175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:29.613274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:29.671489 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19f36138-f9b0-4ad5-8f25-0e219f6a50af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 1.722707 Aug 30 18:43:29.694589 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2616/5119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:27 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:30.505103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "name": "network-vif-plugged", "status": "completed", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:30.535604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:30.538852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:30.539522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:30.543991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:30.568362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:30.570541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:30.576103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4af8f649-653d-49a4-b795-e37d3f9f9695 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.575523 Aug 30 18:43:30.582186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2504/5120] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:28 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:30.607172 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] Creating event network-vif-plugged:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h2-854119-10 Aug 30 18:43:30.622291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4b1b67e4-c8d0-4bc8-a489-87a5c9afb9a1 req-de2dd9e3-ed75-45cd-83e5-1c9a23c4d042 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122132 Aug 30 18:43:30.623371 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2617/5121] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:30.723979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:30.727876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:30.737592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:30.738205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:30.738695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:30.739448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:30.739927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:30.740376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:31.620382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:31.621126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:31.645680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:31.646250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:31.646734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:31.652992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:31.663537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:31.664176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:31.746424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:31.782535 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b80e631c-8eda-4607-9210-d413e30c32bd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 1.064362 Aug 30 18:43:31.803650 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2505/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:30 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:32.823261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:32.823937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:32.889497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:32.892451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:32.896717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:32.902069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:32.911142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:32.912034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:32.931094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:32.978208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:33.011281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:33.016529 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2df6fe2d-c102-4a11-a70c-b46ca893d6ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.407540 Aug 30 18:43:33.036611 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2618/5123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:31 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:34.044577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:34.045398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:34.063976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:34.067410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:34.067897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:34.068170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:34.070283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:34.070804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:34.071258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:34.082430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a953c8f-f51b-44d7-9490-0bf8776eb95c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 1.274015 Aug 30 18:43:34.086062 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2506/5124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:32 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:35.061969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:35.086656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:35.092637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:35.094529 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78adde10-e430-45d9-8ab9-a89287cd9b06 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1807 microversion: 2.20 time: 1.054691 Aug 30 18:43:35.098816 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2619/5125] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:34 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1807 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:35.109226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:35.110016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:35.130114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:35.130800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:35.131345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:35.132181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:35.132749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:35.133303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:35.611249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:35.635396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf053e1b-fa69-469a-a482-6cdec039caa5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.528551 Aug 30 18:43:35.637108 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2507/5126] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:35 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:36.126104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:36.126670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:36.139558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:36.140035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:36.149592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:36.151328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:36.151823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:36.152256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:36.661496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:36.662836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:36.691860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:36.703011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:36.703768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:36.705004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:36.707439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:36.708225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:36.791126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:36.809756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:36.814588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:36.821130 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e571cc3-78d6-4ce4-aa6f-83e14dcf6dbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1794 microversion: 2.20 time: 0.699770 Aug 30 18:43:36.822325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2620/5127] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:43:36 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1794 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:43:37.481790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:37.497207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c9d6f10-5a82-4c9b-bb00-016d4b521c3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.843719 Aug 30 18:43:37.500939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2508/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:36 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:38.522179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:38.522919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:38.526132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:38.553557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:38.556293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:38.559407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:38.564612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:38.567561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:38.568212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:39.436586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:39.453755 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80e3bda9-37b9-49f4-9f7a-78263d8d256f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.935678 Aug 30 18:43:39.454737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2621/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:38 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:39.753604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2b8fff-5160-414d-9053-52a57659aa89", "name": "network-vif-plugged", "status": "completed", "tag": "132547c9-744f-4a47-8c49-46fab0cc5717"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:39.764983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:39.796240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:39.796749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:39.797201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:39.855853 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] Creating event network-vif-plugged:132547c9-744f-4a47-8c49-46fab0cc5717 for instance fc2b8fff-5160-414d-9053-52a57659aa89 on n-h2-854119-10 Aug 30 18:43:39.877089 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-da7a5e2e-a599-440b-88b8-26c46aaf32a0 req-2c884963-eae3-40a4-bc37-50a455cd28af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128180 Aug 30 18:43:39.886096 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2509/5130] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:43:40.477839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:40.478555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:40.491982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:40.500316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:40.501234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:40.507446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:40.508227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:40.509200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:41.383089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:41.402773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebb24d6a-ea1d-491a-b472-df7e8b420133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1376 microversion: 2.1 time: 0.926600 Aug 30 18:43:41.414416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2622/5131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:40 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1376 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:41.640924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-753915315", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "3e025644-7a75-4aea-9b72-4dccb2ba1c77"}], "key_name": "tempest-TestNetworkAdvancedServerOps-937799425", "security_groups": [{"name": "tempest-secgroup-smoke-2062111664"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:42.431746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:42.432363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:42.451326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:42.507146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.507649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.508092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:42.519477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:42.520048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:42.520505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:43.068415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:43.107139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6dca7c12-ca47-4f33-b100-a58a6c7a3eb7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1562 microversion: 2.1 time: 0.679476 Aug 30 18:43:43.115861 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2623/5132] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:42 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1562 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:43.148381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:43.160096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:43.180402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:43.181206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:43.182438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:43.186602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:43.187078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:43.189717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:43.287278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] validate_networks() for [('3e025644-7a75-4aea-9b72-4dccb2ba1c77', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:43:43.863444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:43.891798 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8a314e2-9198-4587-8c2c-70f2e4259278 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1562 microversion: 2.1 time: 0.750368 Aug 30 18:43:43.896381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2624/5133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:43 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1562 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:44.141715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:44.142233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:44.175249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.178771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.181917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.182862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.183339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.193331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.242881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:43:44.473396 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb557644-72d3-45ab-b3c6-b52d328a58f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 204 len: 0 microversion: 2.1 time: 0.335979 Aug 30 18:43:44.475591 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2625/5134] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:43:44 2022] DELETE /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:43:44.495405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:44.500890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:44.518572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.519529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.520405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.523636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.524486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.525213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.781036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:43:44.781496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:43:44.781969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:43:44.782441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:43:44.782905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:43:44.803350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.803865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.804324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.805103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:44.811052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:44.813484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:44.814736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:44.830759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9bbb375b-eb22-4f2b-a008-1a1c7c6f8b33 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1568 microversion: 2.1 time: 0.346720 Aug 30 18:43:44.845981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:43:44.847492 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2626/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:44 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1568 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:44.867482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:43:44.886685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:43:44.890491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:43:45.011315 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b67d7583-332a-44cb-af2b-bfc149879b8f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.379991 Aug 30 18:43:45.013047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2510/5136] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:43:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:43:45.024854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89866fb4-9e5d-41f9-8e01-b1c1a9910d71 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:45.025546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89866fb4-9e5d-41f9-8e01-b1c1a9910d71 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:45.196087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89866fb4-9e5d-41f9-8e01-b1c1a9910d71 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:45.212589 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89866fb4-9e5d-41f9-8e01-b1c1a9910d71 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1265 microversion: 2.1 time: 0.191502 Aug 30 18:43:45.217290 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2627/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:45 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:45.740690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-887517803", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a875ff71-11e6-4eb2-8e80-8c5490aec24d"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:45.853991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:45.855032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:45.860831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] validate_networks() for [('a875ff71-11e6-4eb2-8e80-8c5490aec24d', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:43:45.915097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:45.918089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:45.918434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:45.922627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:45.925541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:45.927584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:46.379556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:46.399869 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd976821-2fe7-4bf6-8914-0e9970d6bac9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1568 microversion: 2.1 time: 0.549650 Aug 30 18:43:46.401534 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2628/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:45 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1568 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:46.411026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:46.412571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:46.427598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:46.429072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:46.432737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:46.435320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:46.436226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:46.437984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:46.568644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:46.594018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1269 microversion: 2.1 time: 0.185995 Aug 30 18:43:46.599769 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2629/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:46 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:46.602069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:46.604492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4abe3ee8-e548-49e7-87ff-ffb904b6e766 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002949 Aug 30 18:43:46.625925 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2630/5140] 10.222.0.25 () {56 vars in 886 bytes} [Tue Aug 30 18:43:46 2022] GET /compute/ => generated 377 bytes in 25 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 18:43:47.136167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:43:47.137074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:43:47.137950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:43:47.138866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:43:47.139573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:43:47.170675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.172223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.176758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.179372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.179890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.180372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.302136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Getting quotas for project 226af2f12a8c41a2874cf8175b7fd52d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:43:47.312671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Getting quotas for user d5331f1e21384da0b057a4922bae90ec and project 226af2f12a8c41a2874cf8175b7fd52d. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:43:47.410612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:43:47.412913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:43:47.424481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:47.425100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:47.446991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.448315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.449302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.451760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.458633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.462127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.609053 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8ac444a-8d53-438f-8900-d7d2332a8e69 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540653 Aug 30 18:43:47.611221 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2511/5141] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:43:47.640736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:47.647267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:47.669156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.674240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.674922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:47.675779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:47.676328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:47.677807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:48.091382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:48.102530 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca5a661e-16e8-4efd-83ea-444778609f83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1568 microversion: 2.1 time: 0.682891 Aug 30 18:43:48.106987 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2631/5142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:47 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1568 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:48.120068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8f88b42-5726-4f5f-bf2b-f9f6906813ef tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:48.121666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8f88b42-5726-4f5f-bf2b-f9f6906813ef tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:48.157587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:48.166559 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06b8ba26-f9d3-4275-9f20-693d68c24fa1 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1325 microversion: 2.1 time: 0.538311 Aug 30 18:43:48.183183 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2512/5143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:47 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:48.244621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8f88b42-5726-4f5f-bf2b-f9f6906813ef tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:48.258794 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8f88b42-5726-4f5f-bf2b-f9f6906813ef tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1214 microversion: 2.1 time: 0.149556 Aug 30 18:43:48.260214 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2632/5144] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:48 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:48.827495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2b8fff-5160-414d-9053-52a57659aa89", "name": "network-vif-deleted", "tag": "132547c9-744f-4a47-8c49-46fab0cc5717"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:48.869662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:48.871430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:48.880163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:48.925828 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] Creating event network-vif-deleted:132547c9-744f-4a47-8c49-46fab0cc5717 for instance fc2b8fff-5160-414d-9053-52a57659aa89 on n-h2-854119-10 Aug 30 18:43:48.967019 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-034d50ba-80e3-4137-8721-a21edf4a3b1b req-1797616d-0c5a-4aed-9387-2ecf98dece2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144154 Aug 30 18:43:48.974762 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2513/5145] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:49.131262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:49.132476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:49.142251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.147442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.148082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.149670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.155590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.156600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.196758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:49.198140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:49.234432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.235661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.237878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.240620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.249431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.250567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.452779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:49.484707 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5aa3afec-ede7-4c84-9ca7-5415ad3b1b44 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.357003 Aug 30 18:43:49.489299 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2633/5146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:49 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:49.506060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:49.506060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:49.528365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.528725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.529348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.530611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:49.531291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:49.533157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:49.611829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:49.623400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dbc76c47-ec82-4ef0-8802-3e4f5801bc35 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1323 microversion: 2.1 time: 0.431223 Aug 30 18:43:49.636449 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2514/5147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:49 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:49.686419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:49.703881 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3330b70b-3924-41ee-9bbc-a1b67a5905a3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1266 microversion: 2.1 time: 0.212094 Aug 30 18:43:49.707712 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2634/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:49 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:50.510046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:50.519960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:50.551128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:50.552029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:50.552725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:50.554262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:50.555053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:50.561037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:50.662790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:50.663508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:50.678630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:50.679186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:50.679635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:50.680368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:50.680830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:50.681254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:50.726093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:50.773536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:50.786359 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-995fe27d-30e4-4282-8a2d-c0c2aa033f02 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.282201 Aug 30 18:43:50.789451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2515/5149] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:50 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:51.009368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:51.023235 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2505a068-6c8f-47f5-b3aa-56f741284cbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.362882 Aug 30 18:43:51.024557 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2635/5150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:50 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:51.031217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:51.033127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:51.043266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.044412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.045066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.046106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.046858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.047496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.127859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e95d9c48-0029-4680-a44f-f171a5c0a0b5 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Action: 'create', calling method: .version_select at 0x7f4e55c8ea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1746962479", "metadata": {"Type": "work"}}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:51.162007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:51.170781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37323ad8-8807-44ab-9ae2-a2288801adc1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1272 microversion: 2.1 time: 0.144788 Aug 30 18:43:51.171379 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2636/5151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:51 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:51.775458 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e95d9c48-0029-4680-a44f-f171a5c0a0b5 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.984571 Aug 30 18:43:51.776467 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2516/5152] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 18:43:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 986 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 18:43:51.790964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3a80e39-c3cf-4c6a-8c8a-2f3e3e7b45b0 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55c883a0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:51.812061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:51.813105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:51.823605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.824642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.825761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.827874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:51.828650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:51.830131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:51.878001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3a80e39-c3cf-4c6a-8c8a-2f3e3e7b45b0 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 353 microversion: 2.1 time: 0.091734 Aug 30 18:43:51.886415 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2637/5153] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:51 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:52.047635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:52.052630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:52.053254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:52.082242 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07ec72a1-fabf-420a-9c94-861b121dfc6c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.276005 Aug 30 18:43:52.086168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.088396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2517/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:51 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:52.091686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.095269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.097482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.101271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.102417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.198743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:52.201992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:52.233759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.239552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.241398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.245400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.251997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.253179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.528386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:52.542953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fbb46f41-b9c8-40f9-a7a5-3478f2498012 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.500264 Aug 30 18:43:52.549795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2638/5155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:52 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:52.597738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:52.610639 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfa36424-f45a-48f9-9af1-335018eb46b8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.419870 Aug 30 18:43:52.614027 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2518/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:52 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:52.644236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:52.674775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:52.675544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:52.676834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:52.709915 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] Creating event network-changed:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h1-854119-10 Aug 30 18:43:52.721032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-894e75a3-4353-43f2-b512-fb2f8e37725a req-c8d206f4-f373-4de7-ae29-913cb496dd25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083598 Aug 30 18:43:52.723969 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2639/5157] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:52.893291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1728d863-7f97-41e2-ae9e-93fd2732f014 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55cb8b80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:53.036182 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1728d863-7f97-41e2-ae9e-93fd2732f014 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 353 microversion: 2.1 time: 0.147495 Aug 30 18:43:53.037640 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2519/5158] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:52 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:53.113535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:53.115074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:53.138527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.139776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.148642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.150114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.150718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.151185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.371946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:53.390635 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb5c2272-d124-4310-8600-d19947dfa5cb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.284743 Aug 30 18:43:53.393211 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2640/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:53 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:53.575914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:53.577821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:53.589622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.591227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.592245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.593452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.594326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.594951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.643110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:53.645564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:53.659836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.661485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.662329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.663372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:53.664132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:53.664764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:53.863816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:53.884505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f7f0c084-25a7-41fe-be24-9dffbd1e75e5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.317578 Aug 30 18:43:53.886662 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2520/5160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:53 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:53.892438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:53.906564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6bbf09db-cc5a-46bb-8d73-c1e85f381a2b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.271429 Aug 30 18:43:53.908825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2641/5161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:53 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:54.054042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61d70279-d822-4078-bddd-e47b0a8fd811 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55a1cd30>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.176570 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61d70279-d822-4078-bddd-e47b0a8fd811 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 354 microversion: 2.1 time: 0.127618 Aug 30 18:43:54.177139 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2521/5162] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:54.190833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72793236-e402-48b6-8a12-303b4a32101a tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e5aed7820>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.414575 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72793236-e402-48b6-8a12-303b4a32101a tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 354 microversion: 2.1 time: 0.227658 Aug 30 18:43:54.416938 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2642/5163] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:54.420702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.421865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:54.432872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9427680d-211a-477a-817e-32f4451ad908 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e56736940>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.461199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.463976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.469270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.470068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.470765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.471291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.570659 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9427680d-211a-477a-817e-32f4451ad908 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 202 len: 0 microversion: 2.1 time: 0.142392 Aug 30 18:43:54.571238 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2643/5164] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:43:54 2022] DELETE /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:43:54.582428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bb9c49b-621b-4fc2-b6d5-29db23294765 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55de5670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.732411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:54.759273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-172af946-35d0-4222-978b-1cf6317be49b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.335152 Aug 30 18:43:54.760379 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2522/5165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:54.784634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3142e2d8-518a-46e9-b389-1d4abf6b8b9d", "tag": "12a280d1-385d-4de6-93fd-745fce77efd0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:54.812805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.813292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.813986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.844020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bb9c49b-621b-4fc2-b6d5-29db23294765 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 353 microversion: 2.1 time: 0.266213 Aug 30 18:43:54.846093 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2644/5166] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:54.849393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] Creating event network-changed:12a280d1-385d-4de6-93fd-745fce77efd0 for instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d on n-h1-854119-10 Aug 30 18:43:54.864087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3ec92402-0e07-4d66-aa52-f1bd94f742ee req-a4896c8e-7b0d-4e2a-afcd-91c12115cf07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090981 Aug 30 18:43:54.865265 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2523/5167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:54.912539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.913485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:54.931542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:54.932666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:54.941666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.942577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.945154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.947262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.949131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.950948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.959205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.960242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.972472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:54.973623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:54.974633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:54.975630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:55.261781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:55.271990 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37dc8c47-f37c-4677-aff0-a16a56be1547 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.364326 Aug 30 18:43:55.276660 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2645/5168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:55.788461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:55.789497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:55.804324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:55.805770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:55.806471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:55.807488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:55.808154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:55.808793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:55.989224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:56.008883 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-631f2039-f7b6-4f8f-ac21-d204105ae5cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.224624 Aug 30 18:43:56.019222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2646/5169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:55 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:56.036478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9faa213f-054a-4517-a558-48ce1f52513a tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55c4eee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:56.117380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:56.131219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2785169-a03e-4f6e-8a7e-3404f32a2cbd tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 1.205034 Aug 30 18:43:56.136017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2524/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:54 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:56.193063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9faa213f-054a-4517-a558-48ce1f52513a tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 353 microversion: 2.1 time: 0.171429 Aug 30 18:43:56.194553 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2647/5171] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:56 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:56.295940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:56.296794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:56.310554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:56.311415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:56.311971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:56.312744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:56.313234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:56.313690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:56.889357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:56.893793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:56.911852 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e73eb0d-c93d-4d99-b553-a0afabffbae8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.619912 Aug 30 18:43:56.927806 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2525/5172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:56 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:57.032867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:57.033480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:57.048907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.049416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.049882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.055104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.056664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.060911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.156392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:57.158583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:57.170330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.175993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.176834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.177875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.180426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.182337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.222934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:57.242145 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0bd61a2e-806b-4cf6-a938-2e0591e6283f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.213755 Aug 30 18:43:57.244436 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2648/5173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:57 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:57.265028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ccbbac7-c4f2-45f4-8a15-f1ded2be791d tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55dcb4c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:57.270818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:57.353586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:57.396782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ccbbac7-c4f2-45f4-8a15-f1ded2be791d tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 200 len: 353 microversion: 2.1 time: 0.150561 Aug 30 18:43:57.397554 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2649/5174] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:57 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:57.500458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:57.512686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5e61b0a-ffb0-47f2-a68f-53e68e7dd3fa tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.360783 Aug 30 18:43:57.516527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2526/5175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:57 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:57.954305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:57.959779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:57.984280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.988583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.989700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:57.991285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:57.995678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:57.996886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.250783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:43:58.272474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:58.275197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:58.293355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.293873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.294335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.295111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.295583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.296026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.394161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:58.408109 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c96d9692-e731-412b-be8f-a9cd7b0392c9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.462252 Aug 30 18:43:58.411634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2650/5176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:57 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:43:58.439712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a0b4d9b-6126-4a5c-8b73-c7f6f8fd60d9 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Calling method '.version_select at 0x7f4e55d5d670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:58.473441 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-7a0b4d9b-6126-4a5c-8b73-c7f6f8fd60d9 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] HTTP exception thrown: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a0b4d9b-6126-4a5c-8b73-c7f6f8fd60d9 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Request method failure captured: Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 HTTP/1.1 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlpmQKCozSKECoO-7uwhGABBOzuvRpDFAaXe-EwdE58PgKJq2ek6VsmKFzbvrBHFPTQp3eO2-_kjGogl1vnJzx59wYlu9Vj__luI8EjjzRO-RA7d1QRUzXC8zIU6CsItozJaGxcGXAgLpjgt9z_XiIoW37xTscrSgF9hMXIAZ_jHfjU Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2e478d7978d540f393bcb9e5cf5bff31 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesGetTestJSON-647368426 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e478d7978d540f393bcb9e5cf5bff31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e478d7978d540f393bcb9e5cf5bff31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e478d7978d540f393bcb9e5cf5bff31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e478d7978d540f393bcb9e5cf5bff31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesGetTestJSON-647368426 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2e478d7978d540f393bcb9e5cf5bff31 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesGetTestJSON-647368426 Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesGetTestJSON-647368426-project Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: fae2be439cac4e7fb3967e27775af54b Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesGetTestJSON-647368426-project Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: exception: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '011a50b6-37af-47e2-8db7-a58114055248'} Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. (HTTP 404) (Request-ID: req-efdec55b-52c1-49dc-8136-1900702d2059) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:43:58.477402 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. Aug 30 18:43:58.482306 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:43:58.487727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a0b4d9b-6126-4a5c-8b73-c7f6f8fd60d9 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] Returning 404 to user: Volume 011a50b6-37af-47e2-8db7-a58114055248 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:43:58.491701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a0b4d9b-6126-4a5c-8b73-c7f6f8fd60d9 tempest-VolumesGetTestJSON-647368426 tempest-VolumesGetTestJSON-647368426-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248" status: 404 len: 109 microversion: 2.1 time: 0.076472 Aug 30 18:43:58.495215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2651/5177] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:43:58 2022] GET /compute/v2.1/os-volumes/011a50b6-37af-47e2-8db7-a58114055248 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:43:58.537666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:58.538724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:58.552342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.555094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.556964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.558205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:58.568517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:58.571837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:58.664650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:58.674299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4bae7f7-6774-4128-9146-aa0472d236c6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.409888 Aug 30 18:43:58.676001 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2527/5178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:58 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:58.997275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:59.025737 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-433c454c-8b8d-4943-8329-971c59bb05ab tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.493081 Aug 30 18:43:59.032250 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2652/5179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:58 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:43:59.209815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "name": "network-vif-plugged", "status": "completed", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:43:59.236674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.237177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.237635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.280648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] Creating event network-vif-plugged:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h1-854119-10 Aug 30 18:43:59.297371 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c577c046-fdeb-4d5d-aaf0-11abd2001384 req-7b6f8696-1978-43af-a5b1-71c4f9c19335 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092894 Aug 30 18:43:59.298000 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2528/5180] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:43:59.463631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:59.474474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:59.558789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.559731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.560381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.561412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.563395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.564197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.698131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:43:59.700489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:43:59.719181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.720522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.721163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.722071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:43:59.722826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:43:59.723423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:43:59.819974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:43:59.828998 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee5aaa2b-6f2b-4f34-b789-0d7305a941de tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.135739 Aug 30 18:43:59.834716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2529/5181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:59 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:00.051262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:00.059381 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f945e7a-75e2-4b95-bd75-7a2553782abc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1391 microversion: 2.1 time: 0.629301 Aug 30 18:44:00.063889 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2653/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:43:59 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1391 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:00.070186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:00.070917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:00.080509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.081037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.082122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:00.083208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.083711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.084167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:00.562042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:00.571984 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ea1fed4-e5fb-4043-8003-92a82400953d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.506300 Aug 30 18:44:00.574329 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2530/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:00 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:00.849284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:00.849894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:00.876794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.877655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.878115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:00.879481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:00.879481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:00.879909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.034011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:01.053505 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1f634ee4-7721-4e94-8f87-f1fc8b4ef139 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1361 microversion: 2.1 time: 0.208250 Aug 30 18:44:01.055183 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2654/5184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:00 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:01.089631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:01.090585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:01.100964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.101938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.102631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.103657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.104295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.105055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.352376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:01.361474 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb92bc60-b0f0-4585-92c0-e2b96d14ab1e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1564 microversion: 2.1 time: 0.277413 Aug 30 18:44:01.363727 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2531/5185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:01 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:01.387295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:01.387731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:01.410002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.410600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.411349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.412116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.412770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.414102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.596335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:01.598537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:01.612141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.612990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.613738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.614741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:01.618181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:01.618810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:01.756052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:01.769051 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a543ccb-20cb-42f7-aadf-3f06241f73c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1564 microversion: 2.1 time: 0.385715 Aug 30 18:44:01.770296 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2655/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:01 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1564 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:02.030029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:02.045594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c94771ec-20e7-495e-949d-f3079c0a73ff tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.453515 Aug 30 18:44:02.046885 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2532/5187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:01 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:02.078123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:02.078790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:02.090064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.090689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.091156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:02.091907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.105416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.106006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:02.135574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68ce543d-4a1d-4a05-a804-9cb38dc3f570 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Action: 'create', calling method: .version_select at 0x7f4e55c88430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1385325842", "metadata": {"Type": "work"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68ce543d-4a1d-4a05-a804-9cb38dc3f570 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 122 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1385325842", "metadata": {"Type": "work"}}} Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1385325842', 'metadata': {'Type': 'work'}}}} Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:44:02.140836 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 18:44:02.147117 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.149041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68ce543d-4a1d-4a05-a804-9cb38dc3f570 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.150400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68ce543d-4a1d-4a05-a804-9cb38dc3f570 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.285743 Aug 30 18:44:02.151527 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2656/5188] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 18:44:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:44:02.179331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:02.180203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:02.180879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:02.181594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lazy-loading 'fault' on Instance uuid fc2b8fff-5160-414d-9053-52a57659aa89 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:44:02.199556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-683a17aa-fd0f-447d-9526-8d70b94fe342 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Action: 'create', calling method: .version_select at 0x7f4e55a71430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472806171", "metadata": {"Type": "work"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-683a17aa-fd0f-447d-9526-8d70b94fe342 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 120 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472806171", "metadata": {"Type": "work"}}} Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1472806171', 'metadata': {'Type': 'work'}}}} Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '0' Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:44:02.234169 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-683a17aa-fd0f-447d-9526-8d70b94fe342 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.238287 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-683a17aa-fd0f-447d-9526-8d70b94fe342 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.075221 Aug 30 18:44:02.243250 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2657/5189] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 18:44:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:44:02.250726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:02.262663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bea26ad5-ca5f-4f50-a919-835c934c6d3b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 200 len: 1320 microversion: 2.1 time: 0.187734 Aug 30 18:44:02.263994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2533/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:02 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:02.273184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21e3a434-19b7-4656-909e-1abaadc56540 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Action: 'create', calling method: .version_select at 0x7f4e574fcd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2006792529", "metadata": {"Type": "work"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21e3a434-19b7-4656-909e-1abaadc56540 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 119 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2006792529", "metadata": {"Type": "work"}}} Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2006792529', 'metadata': {'Type': 'work'}}}} Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '' Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:44:02.277852 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21e3a434-19b7-4656-909e-1abaadc56540 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21e3a434-19b7-4656-909e-1abaadc56540 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033635 Aug 30 18:44:02.287295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2658/5191] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 18:44:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:44:02.310882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a1ce65c-7057-4859-9611-879cf1655052 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Calling method '.version_select at 0x7f4e55d00a60>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:02.369814 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5a1ce65c-7057-4859-9611-879cf1655052 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] HTTP exception thrown: Volume tempest-invalid-1112993303 could not be found. Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a1ce65c-7057-4859-9611-879cf1655052 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1112993303 HTTP/1.1 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: exception: Volume tempest-invalid-1112993303 could not be found. Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'tempest-invalid-1112993303'} Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1112993303 could not be found. (HTTP 404) (Request-ID: req-d7b33d84-2aae-4c02-aca3-7e0dc7d03d81) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:44:02.372636 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1112993303 could not be found. Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1112993303 could not be found. Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1112993303 could not be found. Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a1ce65c-7057-4859-9611-879cf1655052 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 404 to user: Volume tempest-invalid-1112993303 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.378145 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a1ce65c-7057-4859-9611-879cf1655052 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1112993303" status: 404 len: 99 microversion: 2.1 time: 0.081134 Aug 30 18:44:02.381008 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2534/5192] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:44:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1112993303 => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:44:02.389963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9051ae34-67d4-447d-8b08-8d6e029c7c76 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004313 Aug 30 18:44:02.390720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2659/5193] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 18:44:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 18:44:02.401620 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c896a440-e756-4682-8f72-bf96de5d0634 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004499 Aug 30 18:44:02.428880 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2535/5194] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:44:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 18:44:02.429351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77bbe760-0f16-49b6-abbf-a478e8d4f9fc tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Calling method '.version_select at 0x7f4e55c4e9d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:02.463777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-77bbe760-0f16-49b6-abbf-a478e8d4f9fc tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] HTTP exception thrown: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77bbe760-0f16-49b6-abbf-a478e8d4f9fc tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/os-volumes/d789a3f2-7e8a-4e7e-aeb9-c29282879b26 HTTP/1.1 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: method: Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: exception: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd789a3f2-7e8a-4e7e-aeb9-c29282879b26'} Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. (HTTP 404) (Request-ID: req-501a3f02-81db-4322-ba68-964e18820710) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:44:02.466167 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. Aug 30 18:44:02.470692 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.474635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77bbe760-0f16-49b6-abbf-a478e8d4f9fc tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 404 to user: Volume d789a3f2-7e8a-4e7e-aeb9-c29282879b26 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.475988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-77bbe760-0f16-49b6-abbf-a478e8d4f9fc tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d789a3f2-7e8a-4e7e-aeb9-c29282879b26" status: 404 len: 109 microversion: 2.1 time: 0.051493 Aug 30 18:44:02.487362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-148de327-876c-40b2-bbe8-15a47c89d5c4 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Calling method '.version_select at 0x7f4e55952dc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:02.489726 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2660/5195] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:44:02 2022] DELETE /compute/v2.1/os-volumes/d789a3f2-7e8a-4e7e-aeb9-c29282879b26 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:02.537997 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-148de327-876c-40b2-bbe8-15a47c89d5c4 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] HTTP exception thrown: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-148de327-876c-40b2-bbe8-15a47c89d5c4 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Request method failure captured: Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/os-volumes/433df4b8-3730-4658-ad72-de62b10572ea HTTP/1.1 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlpxqQUdfFs-BPPkbFyDTkbjcr2abPzluiqgYi-y0d20bVhPAoSCMRwCO93RLclXoSb8--G7OylHoF9c66uL8Ippr3lqMzczj0KVxVe2Z2Hn5v9dunKrq4HaO_-EHviLS6CJdvo3umfiYVCXWHYIP2P9Y39nOu-FC0TF2HhvLF96BN0 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2612dfec329f43ed94f3170194802891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2612dfec329f43ed94f3170194802891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2612dfec329f43ed94f3170194802891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2612dfec329f43ed94f3170194802891 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesNegativeTest-1178438771 Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 82575d62deb74b41bf04e5fbcfd21b7c Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesNegativeTest-1178438771-project Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: method: Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: exception: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '433df4b8-3730-4658-ad72-de62b10572ea'} Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. (HTTP 404) (Request-ID: req-31fcd8ea-a639-43ab-90a0-e0ff52babc01) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 18:44:02.540095 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:02.543986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-148de327-876c-40b2-bbe8-15a47c89d5c4 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] Returning 404 to user: Volume 433df4b8-3730-4658-ad72-de62b10572ea could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:02.550863 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-148de327-876c-40b2-bbe8-15a47c89d5c4 tempest-VolumesNegativeTest-1178438771 tempest-VolumesNegativeTest-1178438771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/433df4b8-3730-4658-ad72-de62b10572ea" status: 404 len: 109 microversion: 2.1 time: 0.067554 Aug 30 18:44:02.556569 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2536/5196] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 18:44:02 2022] GET /compute/v2.1/os-volumes/433df4b8-3730-4658-ad72-de62b10572ea => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:03.070962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:03.071928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:03.084009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:03.087981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:03.088804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.093875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:03.094786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:03.095771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.237306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3142e2d8-518a-46e9-b389-1d4abf6b8b9d", "name": "network-vif-plugged", "status": "completed", "tag": "12a280d1-385d-4de6-93fd-745fce77efd0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:03.268734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:03.269497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:03.270194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.301875 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] Creating event network-vif-plugged:12a280d1-385d-4de6-93fd-745fce77efd0 for instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d on n-h1-854119-10 Aug 30 18:44:03.317313 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-067079a4-2a1a-4e95-a9fc-f39bdd24b49f req-dfedaddf-5755-4874-a764-e157f493fb7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086336 Aug 30 18:44:03.318712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2537/5197] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:44:03.349714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:03.354794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:03.365959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:03.366837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:03.367503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.368595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:03.369283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:03.369957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:03.392885 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 HTTP/1.1 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fc2b8fff-5160-414d-9053-52a57659aa89'} Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:03.395178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:03.399868 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:03.402065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:03.403654 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-357be3df-57c3-4c9b-ae4a-91f5ce2dc4d8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 404 len: 111 microversion: 2.1 time: 0.082502 Aug 30 18:44:03.407795 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2538/5198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:03 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:03.963092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:03.977845 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26e9b5ed-2fbe-4d25-9237-62c77566d94b tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1314 microversion: 2.1 time: 0.913333 Aug 30 18:44:03.991714 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2661/5199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:03 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:05.001730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:05.003059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.059042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.060686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.062197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.063497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.065303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.066437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.344185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:05.357277 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34425284-5b65-443a-b2cc-c84af4c60be3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1500 microversion: 2.1 time: 0.360049 Aug 30 18:44:05.372928 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2539/5200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:04 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1500 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:05.382081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:05.382769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:05.390725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.391956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.392412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:05.393160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:05.393625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:05.394058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.518294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:06.541360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fec20c62-4dd0-4c55-93aa-90c8e077fec2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1500 microversion: 2.1 time: 1.162522 Aug 30 18:44:06.548879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2662/5201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:05 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1500 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:06.574568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:06.576292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:06.588958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:06.589959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:06.592580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.594531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:06.596087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:06.596960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.631683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:06.632305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:06.652669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:06.654211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:06.656767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.658971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:06.659468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:06.662687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:06.667564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lazy-loading 'flavor' on Instance uuid 3142e2d8-518a-46e9-b389-1d4abf6b8b9d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:44:06.795078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-770c9ebe-a0b9-410a-ac3f-7559c3d88ed1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action" status: 202 len: 0 microversion: 2.1 time: 0.225935 Aug 30 18:44:06.797360 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2540/5202] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:06 2022] POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:44:06.994837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:07.010140 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd0734df-531d-486a-99ed-ec92af52e82e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1564 microversion: 2.1 time: 0.382858 Aug 30 18:44:07.022391 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2663/5203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:06 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:07.030332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:07.032992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:07.060453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.061008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.063128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.078719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.082054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.082751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.224377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:07.249141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.250497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.251173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.287661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] Creating event network-changed:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h1-854119-10 Aug 30 18:44:07.304845 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0cc9cd2c-0d70-4ff7-b63f-04856b899ed0 req-d77c2414-4072-4529-a908-144398fce3b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502059 Aug 30 18:44:07.307626 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2541/5204] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:07.341091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:07.350131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:07.413107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.415621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.420570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.427421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.433781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.442256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.682929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dcf73ad6-b03d-4a0e-a2cc-0cf2376c4c9c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments/98b63c4f-8ec2-46e6-9364-5e7713ae7466" status: 200 len: 194 microversion: 2.20 time: 0.372189 Aug 30 18:44:07.695655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2542/5205] 10.222.0.25 () {60 vars in 1454 bytes} [Tue Aug 30 18:44:07 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments/98b63c4f-8ec2-46e6-9364-5e7713ae7466 => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:07.767738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:07.772503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:07.787691 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7b22668-ebde-4fde-ad67-7aeb9e8d9636 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1508 microversion: 2.1 time: 0.772759 Aug 30 18:44:07.806144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2664/5206] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:07 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1508 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:07.894332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:07.895093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:07.913965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.915758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.916406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:07.918582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:07.919976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:07.923826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:08.290466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lazy-loading 'services' on Instance uuid 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:44:08.590275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-692a6de8-fe33-47db-b6a1-fbc166297b89 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments/98b63c4f-8ec2-46e6-9364-5e7713ae7466" status: 202 len: 0 microversion: 2.20 time: 0.719022 Aug 30 18:44:08.593356 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2543/5207] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Aug 30 18:44:07 2022] DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments/98b63c4f-8ec2-46e6-9364-5e7713ae7466 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:44:08.602581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:08.606905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:08.626107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:08.627466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:08.629063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:08.631506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:08.638558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:08.642566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:08.789196 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba8c6334-eac5-4735-bd32-84ee76680fe1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187077 Aug 30 18:44:08.792106 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2665/5208] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:08 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:44:08.815426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:08.817671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:08.830781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:08.831295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:08.831754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:08.832922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:08.837301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:08.838741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:09.386271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:09.394894 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4de606b-6d32-41ce-a247-dc7b14555a3d tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1491 microversion: 2.1 time: 0.584494 Aug 30 18:44:09.430186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:09.430839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:09.438327 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2544/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:08 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1491 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:09.504643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:09.508735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.053s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:09.509282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:09.516209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:09.516724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:09.517181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:09.807129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:09.810372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:09.833780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:09.834430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:09.834774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:09.835533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:09.836009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:09.836461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:09.915299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:09.952491 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b79650f-410c-45af-b0aa-1e39aa652298 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action" status: 202 len: 0 microversion: 2.1 time: 0.530235 Aug 30 18:44:09.957854 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2666/5210] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:09 2022] POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:44:10.002310 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b9cfa76-634b-4d2e-99be-a6f88f562007 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200441 Aug 30 18:44:10.015366 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2545/5211] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:09 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:44:10.038096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:10.039262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:10.071244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:10.074620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:10.077519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:10.080854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:10.081529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:10.083092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:10.815379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:10.840052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db74cad8-3974-4167-8dc9-fed94b5fdc00 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1497 microversion: 2.1 time: 0.866933 Aug 30 18:44:10.840792 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2667/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:09 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1497 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:11.021423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:11.023760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:11.062485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:11.063345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:11.063491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:11.064199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:11.064680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:11.065123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:11.266018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96dfb2dd-7de6-4ccb-9e14-50c78f1e7da1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.249037 Aug 30 18:44:11.267303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2546/5213] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:11 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:11.863536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:11.864194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:11.892452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:11.900373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:11.901042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:11.903848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:11.904396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:11.912314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:12.280555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:12.283043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:12.307210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:12.309150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:12.309675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:12.320598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:12.321433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:12.321935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:12.322421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:12.462250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78ac2f19-6857-4c1e-86fb-9494664f15c5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187597 Aug 30 18:44:12.466749 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2547/5214] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:12 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:12.618797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:12.654896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bdbdd41a-21e6-49cf-a3e0-d0e59581b718 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1497 microversion: 2.1 time: 0.787525 Aug 30 18:44:12.658416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2668/5215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:11 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1497 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:13.490104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:13.510412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:13.619396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:13.628026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:13.628997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:13.630466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:13.631466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:13.632368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:13.682144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:13.683123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:13.694459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:13.713448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:13.717396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:13.720355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:13.721337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:13.724515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:13.725234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:13.833868 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e05a22b-1acc-44b5-99b8-b5b06fcbfd5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.358793 Aug 30 18:44:13.836147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2548/5216] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:13 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:14.413989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:14.429044 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b956319-09c0-456b-8220-e5c613bdd194 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1500 microversion: 2.1 time: 0.752317 Aug 30 18:44:14.441516 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2669/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:13 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1500 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:14.462478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:14.465213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:14.478189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.479601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:14.480431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:14.482169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.482753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.483537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.486795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.488128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.491435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.492131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.492622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.493349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.493906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.494723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.529178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:44:14.548834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lazy-loading 'flavor' on Instance uuid 3142e2d8-518a-46e9-b389-1d4abf6b8b9d {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:44:14.674366 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12a2a970-53ea-4406-90a0-9a1f9f669ab3 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action" status: 202 len: 0 microversion: 2.1 time: 0.221273 Aug 30 18:44:14.679738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2549/5218] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:14 2022] POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:44:14.688160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:14.689343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:14.699541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.701071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.701797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.702887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.703535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.704146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.733103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee62847a-2486-46d9-af18-bdc7577d765f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 204 len: 0 microversion: 2.1 time: 0.268426 Aug 30 18:44:14.734449 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2670/5219] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:44:14 2022] DELETE /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:44:14.745713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:14.747236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:14.763081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.767194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.767873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:14.768791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:14.770721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:14.771251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:15.021615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:15.033547 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8254d99-324f-46bc-91c7-cc3b884cd4cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1410 microversion: 2.1 time: 0.292880 Aug 30 18:44:15.034812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2671/5220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:14 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1410 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:15.040996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:15.042885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:15.044499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:15.052933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:15.053965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:15.054719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:15.055823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:15.056693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:15.057360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:15.079163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7281cfac-ab8e-4ae9-ad9d-1fd30e7eecb6 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1508 microversion: 2.1 time: 0.397046 Aug 30 18:44:15.082460 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2550/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:14 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:15.139168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e28439e7-8625-41ee-8075-6617b6fce68a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102767 Aug 30 18:44:15.140680 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2672/5222] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:15 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:16.057888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:16.059515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:16.073755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.077231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.079105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.080190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.081025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.084178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.105641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:16.106726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:16.123353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.124385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.129273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.130419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.131069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.131782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.475084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:16.488552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fbd356f7-6d21-4afd-a815-c2c25c5a6654 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1491 microversion: 2.1 time: 0.387789 Aug 30 18:44:16.491408 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2673/5223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:16 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1491 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:16.501859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:16.509926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:16.515862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:16.535039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.535558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.536275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.537034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.537930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.538391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.560973 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39da61ad-52a8-4811-a6ee-7da78200b983 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1410 microversion: 2.1 time: 0.498747 Aug 30 18:44:16.566216 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2551/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:16 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1410 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:16.598564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:16.600551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:16.625371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.629310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.632063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a0d8c91a-8ee3-4deb-b212-ff5e5f635578 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137581 Aug 30 18:44:16.633478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.634279 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2674/5225] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:16 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:16.635316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.636303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.639426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.822929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b7ab195-a8b8-41cd-9a84-42c10555c78c tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action" status: 202 len: 0 microversion: 2.1 time: 0.248943 Aug 30 18:44:16.825903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2552/5226] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:16 2022] POST /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:44:16.836181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:16.837093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:16.849049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.849836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.855090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:16.856248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:16.856917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:16.857526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.167213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:17.183497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44e6d53f-834e-4cb4-888f-7ef3cdd51765 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1497 microversion: 2.1 time: 0.351485 Aug 30 18:44:17.186644 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2675/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:16 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1497 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:17.594054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:17.595593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:17.610648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:17.611430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:17.615547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.616731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:17.620296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:17.620752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.648055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:17.650273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:17.665848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:17.666640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:17.667232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.669458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:17.672774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:17.673927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.750981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b16a2252-655b-479e-b115-f3972bcd95df tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107843 Aug 30 18:44:17.753902 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2676/5228] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:17 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:17.763875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5", "name": "network-vif-deleted", "tag": "b9eb4c9f-1979-485f-8dd1-e184f37fcad0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:17.789381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:17.790058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:17.790728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:17.820354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] Creating event network-vif-deleted:b9eb4c9f-1979-485f-8dd1-e184f37fcad0 for instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 on n-h2-854119-10 Aug 30 18:44:17.831352 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-80dfcbd7-16f5-4cf1-8168-0638dbad5320 req-d44ab9f1-7fe9-40ac-beed-02c988f3e613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073887 Aug 30 18:44:17.832281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2677/5229] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:18.154523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:18.164298 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c45035a2-5a46-46f3-9776-0bab516774c0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1368 microversion: 2.1 time: 0.576235 Aug 30 18:44:18.169938 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2553/5230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:17 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:18.210269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:18.211809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:18.221910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:18.223173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:18.224610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:18.225563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:18.226422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:18.233721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:18.432154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:18.440882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f75c36b-bf8d-4aba-9b22-8796aa22f744 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1497 microversion: 2.1 time: 0.235891 Aug 30 18:44:18.441469 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2678/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:18 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:18.765353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:18.768090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:18.775715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:18.776617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:18.777283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:18.778336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:18.778939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:18.779484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:18.813282 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b73faa02-8792-41d5-b99c-50e2b3e682bb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052023 Aug 30 18:44:18.818127 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2554/5232] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:18 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:19.188427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:19.189270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:19.195898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.196387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.196819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.197520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.197964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.198602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.220992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:19.271771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:19.281041 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-202830ef-88dd-41d1-82c3-0c7f0de10fdb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.096662 Aug 30 18:44:19.281648 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2679/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:19 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:19.462313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:19.463087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:19.469769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.470436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.471185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.472157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.472681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.473186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.655008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:19.686843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f93b2a9d-6540-4ae3-b124-3102268736e8 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1500 microversion: 2.1 time: 0.228534 Aug 30 18:44:19.688130 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2555/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:19 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:19.707661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1599515188", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a9299fb1-cf7f-4b43-a01c-046665555813"}], "security_groups": [{"name": "tempest-securitygroup--749235982"}], "key_name": "tempest-keypair-2121712846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "897fc954-a23f-42f9-a6e4-d4af32f727d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:19.711606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:19.712302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:19.720420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.720906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.721894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.722991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.723610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.724202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.757074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:44:19.877843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46baa4b1-d87e-4532-8204-86590568d61e tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 204 len: 0 microversion: 2.1 time: 0.170229 Aug 30 18:44:19.878900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2556/5235] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:44:19 2022] DELETE /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:44:19.885266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:19.888315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:19.895865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.896672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.897391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.898290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.899310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.899896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.937960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:19.943113 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2c5612c9-3e1a-4b50-bc31-d9bfa69c0740 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062759 Aug 30 18:44:19.943841 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2557/5236] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:44:19 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:19.956803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:19.957664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:19.966587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.967403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.968049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:19.969014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:19.969637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:19.970695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.240673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:20.270285 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ac53075-3d2a-4ee5-90b0-eff78f048ab0 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1506 microversion: 2.1 time: 0.319287 Aug 30 18:44:20.275987 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2558/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:19 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:20.290679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:20.292714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:20.324782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.334001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.335080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.336247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.338906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.341345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.363130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] validate_networks() for [('a9299fb1-cf7f-4b43-a01c-046665555813', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:44:20.411288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:44:20.547078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ae04a86-79a4-4264-b96a-3a829ae27785 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 204 len: 0 microversion: 2.20 time: 0.267185 Aug 30 18:44:20.547921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2559/5238] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:44:20 2022] DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:44:20.566079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:20.566977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:20.581528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.587560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.588216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.590276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.591011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.593036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.733104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:20.744447 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9357a606-5f9d-4a14-b845-4855df0c48bb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.194214 Aug 30 18:44:20.745286 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2560/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:20 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:20.767295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:20.767934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:20.774505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.775732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.776346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.777306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:20.777937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:20.778567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:20.955963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:20.968382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:20.974418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:20.978085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-83ee2c9d-c619-448d-beb1-4e8e9e90976f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.222073 Aug 30 18:44:20.980007 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2561/5240] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:20 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:21.159767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for project 39cd889057a24e0abb0f3ebf950cecef. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:21.166770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for user 4dd9c53c452c4d3ea1e6650deb9d2ee8 and project 39cd889057a24e0abb0f3ebf950cecef. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:21.190987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:44:21.191922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:44:21.192603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:44:21.193068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:44:21.193544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:44:21.205260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.205812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.206555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.207901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.208485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.209088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.247187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for project 39cd889057a24e0abb0f3ebf950cecef. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:21.256242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Getting quotas for user 4dd9c53c452c4d3ea1e6650deb9d2ee8 and project 39cd889057a24e0abb0f3ebf950cecef. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:21.294901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:21.295519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:21.313189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.313429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.313884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.314649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.315120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.315557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.357292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:44:21.359860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='897fc954-a23f-42f9-a6e4-d4af32f727d3',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:44:21.700921 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43aa32cb-f763-4fd1-9074-112ce8b48e1a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.014146 Aug 30 18:44:21.705619 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2680/5241] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:44:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:44:21.716086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60c81727-3e7a-4f41-81f7-67e778979df4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:21.717108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60c81727-3e7a-4f41-81f7-67e778979df4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:21.828491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60c81727-3e7a-4f41-81f7-67e778979df4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:21.840264 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60c81727-3e7a-4f41-81f7-67e778979df4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1122 microversion: 2.1 time: 0.129061 Aug 30 18:44:21.841412 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2681/5242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:21 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1122 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:21.846494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:21.848044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:21.853994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:21.856655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.857353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.862467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.864203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:21.864861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:21.865441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:21.878916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36404fbf-d582-49ca-84ff-40cc3f1cfef2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1506 microversion: 2.1 time: 0.589015 Aug 30 18:44:21.898971 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2562/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:21 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:21.958941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:21.968307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b336bb9e-0ad5-47f2-8e00-de7f61b64f96 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.125386 Aug 30 18:44:21.968926 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2682/5244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:21 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:22.006995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:22.007786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:22.026848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:22.028044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:22.030006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:22.034522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:22.037087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:22.037985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:22.862059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:22.863767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:22.883895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:22.885116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:22.886496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:22.891927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:22.892701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:22.894152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:23.011160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.020431 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a430f4c1-6918-4ada-b216-5ef8c2696ec4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1164 microversion: 2.1 time: 0.162341 Aug 30 18:44:23.021044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2683/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:22 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1164 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:23.026954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:23.032562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:23.046851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:23.047789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:23.048731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:23.055277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:23.056024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:23.056631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:23.128137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.143708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.150274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.153663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ed5db2f-aa7a-4d94-ba36-3c41f5519eeb tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 1.150717 Aug 30 18:44:23.157435 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2563/5246] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:22 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:23.165849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:23.172537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:23.194818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:23.203179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:23.205102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:23.206222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:23.209207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:23.227439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:23.367926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.380081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b69d9dbd-89b6-4851-b0f9-f2e71eed7b41 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1506 microversion: 2.1 time: 0.357179 Aug 30 18:44:23.381627 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2684/5247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:23 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:23.409019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:23.428794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fcce9678-a742-40da-99b1-ab0fd0fb101a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.269780 Aug 30 18:44:23.429405 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2564/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:23 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:24.053835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:24.058045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:24.100547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.102410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.102994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.110769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.112657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.114510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.184734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:24.186207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:24.210650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.215348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.222160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.223003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.223509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.227048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.517943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:24.529046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-30bf418c-ae9b-455e-a113-dc231be0a002 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1238 microversion: 2.1 time: 0.491638 Aug 30 18:44:24.536796 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2685/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:24 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1238 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:24.553383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:24.558234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:24.586236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.587072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.587663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.591435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.592181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.592939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.800643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:24.824719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:24.830610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:24.832662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5331f1e21384da0b057a4922bae90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226af2f12a8c41a2874cf8175b7fd52d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:24.838646 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b48665ff-7a4a-4e48-aa99-766f8ffa90b4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1722 microversion: 2.20 time: 0.658197 Aug 30 18:44:24.845781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2fb81625-d708-492a-865c-e413b692ecc2 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 200 len: 1299 microversion: 2.1 time: 0.300379 Aug 30 18:44:24.851705 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2686/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:24 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:24.862737 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2565/5251] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:24 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1722 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:24.881449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:24.882481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:24.887126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3142e2d8-518a-46e9-b389-1d4abf6b8b9d", "name": "network-vif-deleted", "tag": "12a280d1-385d-4de6-93fd-745fce77efd0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:24.900835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.901384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.901799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.906085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.909433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.911172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.913600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:24.916925 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] Creating event network-vif-deleted:12a280d1-385d-4de6-93fd-745fce77efd0 for instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d on n-h1-854119-10 Aug 30 18:44:24.918063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:24.918766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:24.926187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-57774be2-f52f-4dec-9478-f14ca39e6f52 req-d72b13bc-1cb7-4110-88d0-292b229c1444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061628 Aug 30 18:44:24.938122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2687/5252] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:25.122962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:25.135102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b982358-f2ca-4486-8439-4248f8c8893c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.277665 Aug 30 18:44:25.149211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2566/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:24 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:25.563214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:25.564520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:25.584901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:25.588456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:25.592845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:25.593883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:25.603378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:25.605351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:25.875376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:25.875810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:25.893616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:25.894454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:25.895131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:25.896104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:25.896779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:25.897397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.147427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:26.166198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:26.167965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:26.172414 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4b86bc2-67e2-4349-af6a-fb76a001f204 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1655 microversion: 2.20 time: 0.310988 Aug 30 18:44:26.195673 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2567/5254] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:25 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1655 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:26.203887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:26.204731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] [instance: 3142e2d8-518a-46e9-b389-1d4abf6b8b9d] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:26.217077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.224280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.225046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.226181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.226841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.227444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.266183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] HTTP exception thrown: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Request method failure captured: Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d HTTP/1.1 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlpZtmGBPzwHuCzqcv8xv9PVLn-uz0RUWmR06ax4_3AoukDDYs3yQpY3x4PmuKl8MUqIocJEDa2a7ae3Wo7C6IrfauEsotal7pkQ_fyyIOYHauY2qW8IuItlKi0Y4XcDAConQKn-BbMyFJxa6vmomLP6TXi9btylJa0Pglp9TCpxyzM Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 226af2f12a8c41a2874cf8175b7fd52d Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestServerAdvancedOps-514625963 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226af2f12a8c41a2874cf8175b7fd52d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226af2f12a8c41a2874cf8175b7fd52d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226af2f12a8c41a2874cf8175b7fd52d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226af2f12a8c41a2874cf8175b7fd52d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestServerAdvancedOps-514625963 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 226af2f12a8c41a2874cf8175b7fd52d Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestServerAdvancedOps-514625963 Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestServerAdvancedOps-514625963-project Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d5331f1e21384da0b057a4922bae90ec Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestServerAdvancedOps-514625963-project Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3142e2d8-518a-46e9-b389-1d4abf6b8b9d'} Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:26.276214 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. Aug 30 18:44:26.281201 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:26.286860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] Returning 404 to user: Instance 3142e2d8-518a-46e9-b389-1d4abf6b8b9d could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:26.288105 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0bcde241-e718-48d0-8cc2-913b5e8194f1 tempest-TestServerAdvancedOps-514625963 tempest-TestServerAdvancedOps-514625963-project] 10.222.0.25 "GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d" status: 404 len: 111 microversion: 2.1 time: 0.090930 Aug 30 18:44:26.292831 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2568/5255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:26 2022] GET /compute/v2.1/servers/3142e2d8-518a-46e9-b389-1d4abf6b8b9d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:26.308876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:26.314008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:26.340951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.345470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.346462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.349254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.349981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.350678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.574320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:26.595589 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09bfb567-8815-4e51-be1b-53f276863669 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1202 microversion: 2.1 time: 0.291536 Aug 30 18:44:26.596369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2569/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:26 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1202 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:26.738859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:26.760747 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d1848ea-9428-4553-ab5c-f088075fca4d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 1.204823 Aug 30 18:44:26.773935 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2688/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:25 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:26.814959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:26.817846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:26.837108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.840313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.842141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:26.843157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:26.865327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:26.866514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.004735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e", "name": "network-vif-deleted", "tag": "0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:27.035371 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-465652bc-ec13-4d90-bc6c-4049316e649e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action" status: 200 len: 24568 microversion: 2.1 time: 0.221853 Aug 30 18:44:27.041091 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2570/5258] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:26 2022] POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action => generated 24568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:27.043357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.052827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.053531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.115570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] Creating event network-vif-deleted:0cc8d45a-8ac9-4b35-a2cb-cce9dbe6c8fd for instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e on n-h2-854119-10 Aug 30 18:44:27.158533 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-db930a5e-5f2f-4de9-b4fd-d43e4571d8b8 req-0738bb99-ce95-4832-8dc3-23daf31372ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157723 Aug 30 18:44:27.171699 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2689/5259] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 18:44:27.213107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:27.215486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:27.251095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.255522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.256508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.258083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.262296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.272793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.517760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.518534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.519022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.519513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lazy-loading 'fault' on Instance uuid 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:44:27.619801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:27.620781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:27.656930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.659505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.659955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.670983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.671590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.672032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.811664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:27.828391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:27.829861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:27.831132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aec9c079-469d-4cd1-85ae-a0c8c461b599 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 200 len: 1372 microversion: 2.20 time: 0.625752 Aug 30 18:44:27.837976 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2571/5260] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:27 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 1372 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:27.862655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:27.871851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:27.907932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.913355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.919351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:27.930116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:27.931084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:27.935034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.037221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:29.050042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-abd89b67-abf0-4e9c-9669-255fc0384261 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 200 len: 1156 microversion: 2.1 time: 1.434594 Aug 30 18:44:29.050680 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2690/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:27 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 1156 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:29.067880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:29.068510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:29.090408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:29.096189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:29.096189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.096890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:29.097688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:29.099542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.157663 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e HTTP/1.1 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e'} Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:29.159421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:44:29.164172 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:29.171590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:29.182369 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f79974d0-297c-4c0d-b45f-4edc155089c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 404 len: 111 microversion: 2.20 time: 0.130446 Aug 30 18:44:29.187749 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2691/5262] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:29 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:44:29.201258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec", "tag": "9176092e-9f9c-40f1-86c1-a9a52a1e10ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:29.259868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:29.260381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:29.260824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:29.309797 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] Creating event network-changed:9176092e-9f9c-40f1-86c1-a9a52a1e10ba for instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec on n-h2-854119-10 Aug 30 18:44:29.323175 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ab104124-212a-4e78-8fa6-f6855c4b5225 req-b02e2a93-f3bd-43ed-94e5-0fe3c58c7710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133615 Aug 30 18:44:29.331468 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2692/5263] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:29.337417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22675c0e-6051-482e-8d09-3c569a7d45fe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '.version_select at 0x7f4e5af87a60>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:29.391944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22675c0e-6051-482e-8d09-3c569a7d45fe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217432439" status: 204 len: 0 microversion: 2.20 time: 0.058143 Aug 30 18:44:29.392848 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2693/5264] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 18:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217432439 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:44:30.027000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:30.040013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-397b15f9-fa7c-4740-8259-210b8f8899a8 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 2.196308 Aug 30 18:44:30.049994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2572/5265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:27 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:30.079374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:30.080488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:30.098170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:30.104661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:30.105441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:30.106439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:30.107038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:30.107598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:30.140787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 HTTP/1.1 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5'} Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:30.146197 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:30.151729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:30.153154 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8fb565af-8c5c-49ee-bfeb-14eaced6b093 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 404 len: 111 microversion: 2.1 time: 0.081260 Aug 30 18:44:30.158883 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2694/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:30 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:31.066627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:31.067415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:31.090672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:31.091209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:31.091741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:31.092569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:31.093054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:31.093510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:31.197345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:32.291165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:32.327602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c21397f-5b86-4569-99d4-3afe9f485b59 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 1.263201 Aug 30 18:44:32.333638 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2573/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:31 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:32.356566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70a4243c-df15-4947-99ff-fc2d388a1926 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: .version_select at 0x7f4e569a63a0>, body: {"keypair": {"name": "tempest-keypair-821701059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtFJ7ifcw+SRPO9AGvZnvZdWz4THWHlaeCboFGI9DVhVN7xqXU++06+0dpZCe5U9OwvKDI/fAgTV2ufSXsE/IkxbWW9pAlbs33TG3Dxfy3HKbN9kN+pKlJH8o2I0Nyd3g=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:32.386682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:32.389437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:32.434275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-70a4243c-df15-4947-99ff-fc2d388a1926 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for project 2522b169d5b64fee93202209eff67c97. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:32.452450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-70a4243c-df15-4947-99ff-fc2d388a1926 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for user 219c93f311cb4768a65b9aedaf63e2a2 and project 2522b169d5b64fee93202209eff67c97. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:32.554666 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70a4243c-df15-4947-99ff-fc2d388a1926 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.203150 Aug 30 18:44:32.559675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2695/5268] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:44:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 211 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 18:44:33.364794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:33.366623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:33.390231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:33.393538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:33.396335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:33.399059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:33.400088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:33.405283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:33.714165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:33.729047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f6948c6-044a-4794-8037-1861c7e8ac55 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.366786 Aug 30 18:44:33.729047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2574/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:33 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:34.747760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:34.748393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:34.783769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:34.784380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:34.784835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:34.785588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:34.786043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:34.799755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:35.244158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:35.258007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f55c2f52-8e9b-4913-90d2-f966151dbec9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.513607 Aug 30 18:44:35.259056 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2696/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:34 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:36.284046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:36.286232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:36.314045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:36.315350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:36.317600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:36.323702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:36.324807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:36.325765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:36.670713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:36.700331 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fecc230-81c1-4f7d-8eba-2b3d2211468b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.419696 Aug 30 18:44:36.704521 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2575/5271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:36 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:37.346872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-831297828", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef985d86-0ffd-4a51-95e8-4bca74e6cc2c"}], "security_groups": [{"name": "tempest-securitygroup--755296252"}], "key_name": "tempest-keypair-821701059", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:37.363267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:37.506064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] validate_networks() for [('ef985d86-0ffd-4a51-95e8-4bca74e6cc2c', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:44:37.741552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:37.742184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:37.759425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.760263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.760952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:37.762129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:37.762808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:37.763416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.079820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:38.095602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c84ff79-5ec7-440a-8db5-9caac50909fa tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.358157 Aug 30 18:44:38.098626 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2576/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:37 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:38.116269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:38.116927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:38.144702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.148046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.148767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.149726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.150399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.151008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.296679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:44:38.297401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:44:38.298072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:44:38.299519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:44:38.300123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:44:38.314672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.315356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.315892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.317180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.319001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.321005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.384599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for project 2522b169d5b64fee93202209eff67c97. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:38.416231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Getting quotas for user 219c93f311cb4768a65b9aedaf63e2a2 and project 2522b169d5b64fee93202209eff67c97. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:38.468105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:44:38.471401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:44:38.614427 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ebfb7cf6-472d-40be-a194-8755e4715453 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1836 microversion: 2.1 time: 0.514489 Aug 30 18:44:38.631489 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2577/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:38 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1836 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:38.639120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:38.640119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:38.654573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.656178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.657502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.659698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:38.660531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:38.661287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:38.699640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8e615dd-1d3c-4b01-8101-6db3f6251c80 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.356839 Aug 30 18:44:38.702915 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2697/5274] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:44:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:44:38.739303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:38.739940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:39.057231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.072140 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fc5d1837-a53a-42e2-9650-501356388417 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1683 microversion: 2.1 time: 0.435621 Aug 30 18:44:39.075276 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2578/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:38 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1683 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:39.124893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:39.125593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:39.148295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.149309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.150002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.151125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.153496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.154187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.525927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.553559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.562517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.566638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-005b953c-84eb-4ee8-b905-7ec5a6d70514 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1280 microversion: 2.20 time: 0.856125 Aug 30 18:44:39.576113 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2698/5276] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:38 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1280 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:44:39.584363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.593100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:39.597497 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-845d20ba-2031-43f2-874c-48cd4e836815 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.475055 Aug 30 18:44:39.598178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2579/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:39 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:39.612372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:39.640698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.641642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.642274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.645614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.646262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.647669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.736823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b18ecd8f-5886-420b-a290-e5c25efbde6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action" status: 200 len: 32646 microversion: 2.1 time: 0.158411 Aug 30 18:44:39.738398 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2699/5278] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:39 2022] POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action => generated 32646 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:39.885618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:39.886796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:39.896553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.897427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.898050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.899534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:39.900548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:39.901329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:39.982331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '523c3297189f4e788a1d23890c6c5113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4057a05ea88142f9aae86361659691ed', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:39.984535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] flavor_id is None. Assuming migration. {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:44:39.986935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:44:40.585939 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e13ec8bc-697a-4bd0-845d-82cdfe1a2b37 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action" status: 202 len: 0 microversion: 2.1 time: 0.705147 Aug 30 18:44:40.587099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2580/5279] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:44:39 2022] POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:44:40.611315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:40.612015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:40.629441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:40.633543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:40.649298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:40.649820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:40.650233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:40.652408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:40.653860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:40.654317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:40.655007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:40.655629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:40.656238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:40.670780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:40.671544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:40.672235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:40.917887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:40.943657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:40.946987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:40.948301 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abc90aa0-a74a-4413-8a8d-210505275b3f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1332 microversion: 2.20 time: 0.334703 Aug 30 18:44:40.948855 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2581/5280] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:40 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1332 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:40.982911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:40.983543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:40.994807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:41.000940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:41.002929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:41.004857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:41.005772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:41.008069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:41.041808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:41.059682 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-de8160f3-fca2-4f89-a56e-c0adfac30f55 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1692 microversion: 2.1 time: 0.467204 Aug 30 18:44:41.063758 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2700/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:40 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1692 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:41.699338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:41.713916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68a77027-0041-46e1-b9e4-3c1ac2349062 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.733656 Aug 30 18:44:41.730554 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2582/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:40 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:41.980653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:41.982332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:42.010680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.013535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.014927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.017438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.022127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.025386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.089493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:42.090094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:42.119675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.123790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.133960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.134819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.135316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.135894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.171438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:42.185531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:42.188679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:42.190379 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-892f2a92-3a2b-44b1-84c8-05d447ec91f9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1338 microversion: 2.20 time: 0.214870 Aug 30 18:44:42.191600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2701/5283] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:41 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:42.664587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:42.684522 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e8eaf80-914a-4bd0-87ce-c541b64e0b84 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1692 microversion: 2.1 time: 0.597049 Aug 30 18:44:42.687258 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2583/5284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:42 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1692 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:42.752009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:42.752663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:42.779275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.780357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.781376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.784959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.786048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.788020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.835895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:42.836460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:42.859326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:42.867587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.871028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.888128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.893805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:42.901637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:42.902665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:42.963392 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 HTTP/1.1 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fc2b8fff-5160-414d-9053-52a57659aa89'} Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:42.968940 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:42.973469 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:42.979084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:42.983131 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46a21150-4079-4643-aaa6-00bd1da65bf3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 404 len: 111 microversion: 2.1 time: 0.155742 Aug 30 18:44:42.984052 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2584/5285] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:44:42 2022] DELETE /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:44:43.000047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:43.003110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: fc2b8fff-5160-414d-9053-52a57659aa89] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:43.021513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.022656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.023358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.027192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.028271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.028955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.066548 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 HTTP/1.1 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fc2b8fff-5160-414d-9053-52a57659aa89'} Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:43.072127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. Aug 30 18:44:43.077083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:44:43.080431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance fc2b8fff-5160-414d-9053-52a57659aa89 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:43.082372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7345713b-87da-4f86-8fd3-5d19b34ecc1d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89" status: 404 len: 111 microversion: 2.1 time: 0.093247 Aug 30 18:44:43.087930 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2585/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:42 2022] GET /compute/v2.1/servers/fc2b8fff-5160-414d-9053-52a57659aa89 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:43.217541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:43.218745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:43.255614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.257498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.259492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.266784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.267717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.268567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.465425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:43.477338 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b2aa2ba8-4705-45d5-88e3-befd3c98bf81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 0.744211 Aug 30 18:44:43.481685 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2702/5287] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:42 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:43.696429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:43.708448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:43.709353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:43.717245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:43.718384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:43.727047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.727569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.728019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.731108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:43.731809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:43.736171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:43.739161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5533947-657f-41b6-8938-c8b46b1260f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1338 microversion: 2.20 time: 0.527220 Aug 30 18:44:43.749553 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2586/5288] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:43 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1338 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:44.230123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:44.254279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edea11d2-d45d-497e-bdea-ccec435d2c1f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1692 microversion: 2.1 time: 0.548642 Aug 30 18:44:44.254279 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2703/5289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:43 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1692 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:44.503100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:44.504389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:44.523501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.536519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.540048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.545035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.552194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.552945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.645429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:44.646194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:44.681297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.703256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.704018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.705054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.705718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.706451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.745837 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 HTTP/1.1 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5'} Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:44.747777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:44.753409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab986791-09a7-4acf-a43a-a22673f684e0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 404 len: 111 microversion: 2.1 time: 0.108252 Aug 30 18:44:44.756431 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2704/5290] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:44:44 2022] DELETE /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:44:44.787875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:44.790858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:44.805935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.806894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.807936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.809428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.810159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.810951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.840932 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 HTTP/1.1 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5'} Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:44:44.843179 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4e2e2dc-ed8f-4fd4-b89a-d7553fc96fe4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5" status: 404 len: 111 microversion: 2.1 time: 0.072931 Aug 30 18:44:44.851936 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2705/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:44 2022] GET /compute/v2.1/servers/a4e65c23-c8a1-4161-a7ea-1f400bc3f4a5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:44:44.876444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:44.877138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:44.890293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.890807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.891239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:44.891945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:44.892391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:44.895732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:45.003218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:45.488414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:45.508077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:45.515867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:45.519067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64f92022-f294-47fb-b46a-21588f36e196 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.672236 Aug 30 18:44:45.521386 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2706/5292] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:44 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:45.529794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-291a3699-b003-44e8-ba00-da3bff6005cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: .version_select at 0x7f4e55a80e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2094816941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQe1dhraOyXinVv42T5yEI9IG+5kIBq8RoJRsBCtfQ1p44MZSh1eXaao+TMApJb1URaVaFREUltWigB2epUiSeUsKdxWHngj4FARErh8QaOws2ZPjP96In9R7yCRVsK8A=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:45.599310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-291a3699-b003-44e8-ba00-da3bff6005cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:44:45.622692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-291a3699-b003-44e8-ba00-da3bff6005cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:44:45.682754 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-291a3699-b003-44e8-ba00-da3bff6005cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.160017 Aug 30 18:44:45.684495 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2707/5293] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:44:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:45.692015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:45.693453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:45.710587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:45.711491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:45.712142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:45.715790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:45.716587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:45.717273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:45.837995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:45.854923 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b97e5bc3-c8b2-4594-81d3-d666a6540245 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1305 microversion: 2.1 time: 1.356829 Aug 30 18:44:45.855719 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2587/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:44 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1305 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:46.369489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:46.381724 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed68586b-3bd1-4668-8004-33ce168b6546 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1692 microversion: 2.1 time: 0.695940 Aug 30 18:44:46.382337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2708/5295] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:45 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1692 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:46.549838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:46.550836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:46.566226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:46.568077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:46.570107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:46.571134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:46.572260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:46.589635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:46.884560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:46.886084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:46.897015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:46.897820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:46.898447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:46.899573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:46.900290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:46.902058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:47.324109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:47.338077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1cc4e7cf-0766-42a9-a98d-a66d740dda9d tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.460395 Aug 30 18:44:47.340420 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2709/5296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:46 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:47.412737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:47.413932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:47.423054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:47.424605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:47.425431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:47.426648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:47.427583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:47.428973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:47.525699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:47.541193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:47.544795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:47.546460 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b80e77a3-ec55-4c24-90bf-110b4f4583bd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 1.001077 Aug 30 18:44:47.564138 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2588/5297] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:46 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:47.679913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:47.696305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e775b125-766d-4c3d-b58f-7db4f4e29ee3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.290057 Aug 30 18:44:47.710374 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2710/5298] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:47 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:48.155751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:48.179938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.181222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.184263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.218889 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] Creating event network-changed:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:44:48.231349 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d04d852e-96c4-4919-b50e-3ab416c09484 req-290d7f47-5d95-4e6f-b57f-915974e0be6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081461 Aug 30 18:44:48.231932 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2589/5299] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:48.362470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:48.363181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:48.369153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:48.378713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.379701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.380311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.395068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.395866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.396474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.576897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:48.577625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:48.590624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.594298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.601061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.602660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.606045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.608315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.680411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:48.801350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:48.814892 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1969b439-2bf2-4c98-8c36-91de0a94b079 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.456481 Aug 30 18:44:48.832826 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2711/5300] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:48 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:48.850762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:48.858779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:48.875431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.880036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.880499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:48.882219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:48.884110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:48.887305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:49.200950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:49.219698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:49.221201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:49.222450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53a2f967-b98f-4cb9-ae81-f4c1e5488960 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.652039 Aug 30 18:44:49.222983 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2590/5301] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:48 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:44:49.397953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:49.412905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7b33a35-2066-44c2-95e4-ffb00aad6d9b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.594267 Aug 30 18:44:49.414717 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2712/5302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:48 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:49.843379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:49.844493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:49.864734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:49.868452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:49.868452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:49.871033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:49.871767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:49.876612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.246516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:50.247133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:50.258969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.259345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.259788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.263377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.263862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.264289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.305194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:50.321002 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-395e4ff4-e0eb-44d9-ad31-4b85778b8dbe tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.483418 Aug 30 18:44:50.323074 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2591/5303] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:49 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:50.439274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:50.439866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:50.451753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.455034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.455761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.457368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:50.460837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:50.461417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:50.687796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:50.699147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:50.700589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:50.701756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1baecf16-3a7c-4047-90a9-c62e0e429709 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.460200 Aug 30 18:44:50.714788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2713/5304] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:50 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:51.030794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.046325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2284d209-bdc1-4939-a975-ff5f03b61395 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.612126 Aug 30 18:44:51.049942 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2592/5305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:50 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:51.351678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:51.357714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:51.370172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.371441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.371886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.376664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.377418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.384044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.608494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.627088 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b9003a6-fa8d-4030-a982-e77212849219 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.285716 Aug 30 18:44:51.642179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2714/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:51 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:51.724611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:51.725189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:51.740971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.741489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.741959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.742729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:51.743201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:51.743643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:51.977841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.988176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.989624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:51.991046 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18b32e16-d237-4cda-893a-b65cc7fdf312 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.270372 Aug 30 18:44:51.993900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2593/5307] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:51 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:52.079715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:52.080902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:52.089062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.090020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:52.090814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:52.092481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.093173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:52.093843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:52.421575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:52.430832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d6cc552d-ba6d-4bef-a6d6-a6923d2146f3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.360315 Aug 30 18:44:52.431859 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2715/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:52 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:52.649678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:52.650306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:52.668254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.668889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:52.669329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:52.669959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:52.670590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:52.670932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:52.897039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:52.908716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-649d2d3c-3970-4c9b-a6db-4d10ac4e4a25 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.263206 Aug 30 18:44:52.910073 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2594/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:52 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:53.016338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:53.016970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:53.023769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.024371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.024664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.025576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.026384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.027126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.330644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:53.340948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:53.348187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:53.349375 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d32a11e0-1d90-46f4-ba2f-b5c8d4bdd74d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.337113 Aug 30 18:44:53.354523 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2716/5310] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:53 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:44:53.459006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:53.459921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:53.483845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.484661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.485273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.486254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.489276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.490384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.673868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:53.686917 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a04b3221-ca8c-44dc-8aac-d726f3c78634 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.232598 Aug 30 18:44:53.688138 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2595/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:53 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:53.936443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:53.937065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:53.949405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.950281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.951224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:53.952197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:53.955481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:53.956265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.302199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.313526 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af5bc661-bf17-4000-9e51-75ea856575cf tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.381948 Aug 30 18:44:54.314712 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2717/5312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:53 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:54.372926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:54.373793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:54.385415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.390030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.390711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.391814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.392643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.393230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.678644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.692906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.698370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.700161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84c0104b-756a-4732-b75a-3a24d8d9db18 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.331415 Aug 30 18:44:54.701321 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2596/5313] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:54 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:54.709029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:54.709650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:54.718376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.719086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.720021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.721149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:54.721780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:54.722586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:54.904668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:54.914076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a5aff8b-023b-4aae-811d-ee824fc36600 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.209350 Aug 30 18:44:54.914759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2718/5314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:54 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:55.313209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "name": "network-vif-plugged", "status": "completed", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:55.337660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.338921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.339292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:55.340281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:55.340967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.352786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.355691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.356803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.359064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.360680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.361263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.369719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] Creating event network-vif-plugged:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:44:55.379073 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0440429b-ccec-4c63-a0fe-62356b3b7fa7 req-83e05a76-f96e-4485-ae5f-aebfcf112364 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070444 Aug 30 18:44:55.384130 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2597/5315] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:55.639417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=16 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:44:55.727723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:55.729643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:55.745377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.747929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.749639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:55.751328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:55.753627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:55.756256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:56.003587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.013736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.015629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.017034 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3755f181-4c3f-4ada-bbf4-86f0e795f8bc tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1405 microversion: 2.20 time: 0.296360 Aug 30 18:44:56.018115 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2598/5316] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:55 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:56.034357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:56.035251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:56.042430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:56.043556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:56.044748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:56.045675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:56.046320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:56.047023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:56.208958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.220690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2dac4bf-e294-4ef6-8624-7c207228a43b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.886562 Aug 30 18:44:56.221905 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2719/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:55 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:56.258216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:56.285181 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1062eab-6d63-48fd-a8c7-39739bf121da tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.265559 Aug 30 18:44:56.294920 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2599/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:56 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:57.040128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:57.041024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:57.050846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.051336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.051766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.052481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.052922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.053339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.246148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:57.247610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:57.261568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.262612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.264336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.266309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.269978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.273736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.364133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.384356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.385985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.395457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-807c291f-5968-4de3-88be-e5742c64f7a5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1596 microversion: 2.20 time: 0.359007 Aug 30 18:44:57.415941 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2720/5319] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:44:57 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1596 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:44:57.429230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:57.429939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:57.446053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.446821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.447339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.448372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.449539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.450059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.497888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.509222 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6dc6134f-bb6f-4fbd-bac2-3b01fbc8b909 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.270283 Aug 30 18:44:57.509222 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2600/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:57 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:57.528796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:57.528796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:57.552216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.553721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.554179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.556526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.557010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.557508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.748118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:57.758636 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8cc7d4f-9fd8-417c-b0d5-5928eabe8346 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1697 microversion: 2.1 time: 0.340248 Aug 30 18:44:57.768765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2721/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:57 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1697 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:57.775203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec", "name": "network-vif-plugged", "status": "completed", "tag": "9176092e-9f9c-40f1-86c1-a9a52a1e10ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:44:57.822454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:57.823175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:57.823710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:57.846497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] Creating event network-vif-plugged:9176092e-9f9c-40f1-86c1-a9a52a1e10ba for instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec on n-h2-854119-10 Aug 30 18:44:57.862097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b69053a3-2dcb-4c75-8dc1-0990247c0b0e req-315a0e4a-eb49-4ab1-8f4b-24b51fdb6b28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091343 Aug 30 18:44:57.863292 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2722/5322] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:44:58.042486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18bc620f-5678-45ac-a3e3-7998b895c1b8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.523238 Aug 30 18:44:58.043701 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2601/5323] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 18:44:57 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-interface => generated 284 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:44:58.532722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:58.534184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:58.554252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.554938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.555628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.556666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.559702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.560804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.799689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:58.800493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:58.818232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.830090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.831413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.833358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:58.835786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:58.840436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:58.878250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:58.894550 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f987bb9-44ba-444b-b2ef-76d99a4fa848 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1293 microversion: 2.1 time: 0.361372 Aug 30 18:44:58.902031 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2723/5324] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:58 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:44:59.326725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:44:59.344839 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f916082e-822d-4c0a-84c9-e57539fc3ba5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1696 microversion: 2.1 time: 0.552950 Aug 30 18:44:59.345782 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2602/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:58 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1696 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:44:59.939065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:44:59.940053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:44:59.948912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:59.950138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:59.950578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:44:59.951329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:44:59.951872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:44:59.952433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.369799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:00.370397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:00.381319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.383751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.386475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.387535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.388112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.388613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.475060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:00.482493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:00.489577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e533ef14-0541-473e-aaa9-567df286ed36 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1482 microversion: 2.1 time: 0.555502 Aug 30 18:45:00.491178 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2724/5326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:44:59 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1482 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:00.498715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "name": "network-vif-unplugged", "status": "completed", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:00.527808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.529418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.530532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.571671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Creating event network-vif-unplugged:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h2-854119-10 Aug 30 18:45:00.587452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] Instance 5ebb88df-830f-4243-913f-4de14e31b112 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:45:00.630671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4a523633-380d-46a5-8457-db8c98d413f6 req-b86512b7-b683-4c53-8ae9-0e786989f378 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134065 Aug 30 18:45:00.631763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2725/5327] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:00.656050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:00.657471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:00.678995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.698261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.699954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.701243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:00.706626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:00.715350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:00.867981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:00.878047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e778b44-be33-40ac-8eaa-a08d3dfe39a4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1696 microversion: 2.1 time: 0.511719 Aug 30 18:45:00.896161 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2603/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:00 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1696 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:01.461144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd153c41-0c95-46c0-8fc8-128b4676f89c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.827636 Aug 30 18:45:01.462458 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2726/5329] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:45:00 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec/os-interface => generated 284 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:01.900880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:01.902441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:01.917160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:01.919016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:01.919480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:01.920402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:01.920877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:01.921387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:02.326381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:02.335311 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb125c06-e66d-4f8d-a76e-e7d65b92b591 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1696 microversion: 2.1 time: 0.439369 Aug 30 18:45:02.336949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2604/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:01 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1696 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:02.746420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}, {"name": "network-changed", "server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:02.769085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:02.769582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:02.770012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:02.809640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Creating event network-changed:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:45:02.810166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Creating event network-changed:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h2-854119-10 Aug 30 18:45:02.831470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] Instance 5ebb88df-830f-4243-913f-4de14e31b112 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:45:02.874298 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-31df0a27-fef6-4639-b934-cdd5149d92a2 req-e381bb77-c408-44e0-9fb4-2ce67c19a2ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.133330 Aug 30 18:45:02.877383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2727/5331] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:03.357751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:03.359095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:03.383618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:03.387890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:03.392650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:03.400062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:03.400849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:03.406717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:03.898792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:03.910925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-43980f03-1535-4c51-a897-534484c60c07 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1696 microversion: 2.1 time: 0.557605 Aug 30 18:45:03.914300 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2605/5332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:03 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1696 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:04.937203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:04.938461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:04.951397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:04.953447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:04.954882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:04.959330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:04.959813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:04.960256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:05.201013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:05.201755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:05.217332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:05.222982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:05.225520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:05.226475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:05.230559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:05.236049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:05.523273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:05.536545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f425dca-8692-4a21-a4d3-eeeb0f006710 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1694 microversion: 2.1 time: 0.605438 Aug 30 18:45:05.541723 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2728/5333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:04 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1694 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:05.566111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec", "tag": "9176092e-9f9c-40f1-86c1-a9a52a1e10ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:05.592343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:05.593307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:05.594037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:05.635784 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] Creating event network-changed:9176092e-9f9c-40f1-86c1-a9a52a1e10ba for instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec on n-h2-854119-10 Aug 30 18:45:05.647166 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e1d20881-ed5f-499c-99e1-1f4ac4771534 req-7551d03d-09f0-4906-a75e-07ee2f5cd1c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098950 Aug 30 18:45:05.648615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2729/5334] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:06.000890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:06.021481 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95efbb39-f68a-40d3-b025-0833a2c87012 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1482 microversion: 2.1 time: 0.824374 Aug 30 18:45:06.022459 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2606/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:05 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1482 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:06.566898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:06.568477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:06.584898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:06.587968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:06.590715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:06.591970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:06.595945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:06.604216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:06.947129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:06.960508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0787fd57-0f79-443f-bb32-09f413606534 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1691 microversion: 2.1 time: 0.400123 Aug 30 18:45:06.966107 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2730/5336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:06 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1691 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:06.985924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:06.986664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:06.996556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:06.997081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:06.997536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:07.002514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:07.002890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:07.003336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:07.048469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:07.102917 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55654d79-1c35-4ad8-963e-e3210df49567 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action" status: 204 len: 0 microversion: 2.1 time: 0.119590 Aug 30 18:45:07.107576 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2607/5337] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:06 2022] POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:45:07.113743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:07.114938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:07.129698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:07.130905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:07.132395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:07.133489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:07.134393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:07.135407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:07.772391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:07.783131 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-72a9cee5-b6b6-41f6-b652-b1b402f8ae6e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1691 microversion: 2.1 time: 0.673756 Aug 30 18:45:07.798889 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2731/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:07 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1691 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:08.593442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "name": "network-vif-plugged", "status": "completed", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:08.620286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:08.621233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:08.636438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:08.689109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Creating event network-vif-plugged:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h2-854119-10 Aug 30 18:45:08.700444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] Instance 5ebb88df-830f-4243-913f-4de14e31b112 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:45:08.717644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2c380cc1-3d22-46ce-b5d3-ca33beecc266 req-381c6526-cc5e-42ab-8adb-877c4d2fd051 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152568 Aug 30 18:45:08.719193 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2608/5339] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:08.816486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:08.823970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:08.834574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:08.876003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:08.876981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:08.877747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:08.879114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:08.880350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:08.884011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:09.302452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:09.326694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-130b0586-f980-44de-bfac-7b075cc00d10 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1691 microversion: 2.1 time: 0.523054 Aug 30 18:45:09.341863 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2732/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:08 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1691 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:10.378287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:10.380123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:10.400699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:10.402138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:10.406077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:10.408466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:10.414799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:10.419442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:10.732558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:10.742517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ef77b84-0db1-436f-a086-e19f56c7efc9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1683 microversion: 2.1 time: 0.380379 Aug 30 18:45:10.755996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2609/5341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:10 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1683 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:25.323338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-221151045", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2094816941", "security_groups": [{"name": "tempest-secgroup-smoke-1314100298"}], "block_device_mapping_v2": [{"uuid": "808891ce-c377-453c-948b-816e40d7afc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:25.336432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:25.337291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=38 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:25.560539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:45:26.891019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:45:26.892534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:45:26.893643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:45:26.894057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:45:26.894509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:45:26.917866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:26.918414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:26.918946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:26.922606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:26.925641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:26.927824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:26.979226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:45:26.986592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:45:27.139636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:45:27.142161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='808891ce-c377-453c-948b-816e40d7afc3',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:45:27.430955 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-496d829d-ce1e-4b00-8926-8f5d44223a5f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.111009 Aug 30 18:45:27.433750 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2733/5342] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:45:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:45:27.444219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34ea4b51-25c3-40e8-842e-41af1a1f1d68 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:27.444871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34ea4b51-25c3-40e8-842e-41af1a1f1d68 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:27.448188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=51 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:27.483043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:27.598150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34ea4b51-25c3-40e8-842e-41af1a1f1d68 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:27.613610 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34ea4b51-25c3-40e8-842e-41af1a1f1d68 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1094 microversion: 2.1 time: 0.173100 Aug 30 18:45:27.614672 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2610/5343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:27 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1094 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:28.675567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:28.676925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:28.705952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:28.706565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:28.707066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:28.715530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:28.719181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:28.720281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:28.873766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:28.896565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c637382-2964-4096-9892-3300cdbeabe8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1136 microversion: 2.1 time: 0.261562 Aug 30 18:45:28.897665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2734/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:28 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1136 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:29.932756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:29.934014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:29.979726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:29.980772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:29.981662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:29.983117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:29.996221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:29.996732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:30.180251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:30.208806 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7e6b890-5e84-4e64-bc5b-4697f67ec1e8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1210 microversion: 2.1 time: 0.291146 Aug 30 18:45:30.223022 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2611/5345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:29 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1210 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:31.092888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:31.097520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:31.111310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:31.112818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:31.113694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:31.114716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:31.115915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:31.116651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:31.237871 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-33025a2d-089d-4e61-ad23-e4a6c5747cdb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action" status: 200 len: 24572 microversion: 2.1 time: 0.159560 Aug 30 18:45:31.239266 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2735/5346] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:45:31 2022] POST /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112/action => generated 24572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:45:31.272521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:31.277660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:31.298784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:31.300180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:31.301395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:31.302468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:31.303336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:31.304870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:31.700133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:31.715662 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbde8650-044f-45f1-8a0b-eb9bc098d55f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1210 microversion: 2.1 time: 0.460297 Aug 30 18:45:31.719214 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2612/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:31 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1210 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:32.758666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:32.768940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:32.792962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:32.794483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:32.795640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:32.800651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:32.803431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:32.811754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:33.229879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:33.247966 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebf60b02-5a3e-48c3-9b13-ce869d61b527 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1278 microversion: 2.1 time: 0.500767 Aug 30 18:45:33.252823 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2736/5348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:32 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1278 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:34.310049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:34.311982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:34.330420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:34.332810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:34.333291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:34.335075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:34.335930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:34.336562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:35.227224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:35.230154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:35.252662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:35.253666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:35.254541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:35.255990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:35.257718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:35.258605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:35.311652 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5f06b79f-3b98-40bf-b196-6d1ac3b8d3c8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/ips" status: 200 len: 151 microversion: 2.20 time: 0.682385 Aug 30 18:45:35.313325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2737/5349] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Aug 30 18:45:34 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/ips => generated 151 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:45:35.945742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c5602a-61fd-476b-b6e9-8262afae2bce", "tag": "3f259b26-b76c-4a73-8cac-7770f4c58cb3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:35.999638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:36.011910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:36.019069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:36.062722 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] Creating event network-changed:3f259b26-b76c-4a73-8cac-7770f4c58cb3 for instance 25c5602a-61fd-476b-b6e9-8262afae2bce on n-h1-854119-10 Aug 30 18:45:36.073225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a6435b5c-addc-4c8b-9e96-35b9d35a3ed2 req-4b731bd2-0c98-413d-a775-92bd11003ed8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368551 Aug 30 18:45:36.075071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2738/5350] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:45:36.076761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:36.128819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d2eb9d3-dce7-4b35-8b48-b40070ee46dd tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1278 microversion: 2.1 time: 1.825827 Aug 30 18:45:36.135071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2613/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:34 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1278 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:37.182891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:37.188600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:37.232850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:37.239739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:37.272073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.272581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.273037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.273810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.288329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.291767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.441619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:37.443421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:37.457790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.463767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.467762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.468949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:37.469673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:37.476098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:37.625957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:38.453947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:38.473922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d6ceb2f-8d3d-4bf6-9f85-82dc4a297ece tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1836 microversion: 2.1 time: 1.036122 Aug 30 18:45:38.497056 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2614/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:37 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1836 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:38.497850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ee195e52-2245-444f-8880-e63e3a9632e1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1278 microversion: 2.1 time: 1.317456 Aug 30 18:45:38.498730 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2739/5353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:37 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1278 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:39.519905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:39.521461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:39.543890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:39.544751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:39.545371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:39.546302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:39.546993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:39.548071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:40.672345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:40.673429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:40.695064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:40.695807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:40.696542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:40.699564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:40.700635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:40.703051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:40.765852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lazy-loading 'flavor' on Instance uuid b5bf9a06-461f-41f4-8c89-946e3974e232 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:45:40.828113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:40.880443 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d986ed8-84f9-43fe-8876-28e2b9840170 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1278 microversion: 2.1 time: 1.364821 Aug 30 18:45:40.884516 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2615/5354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:39 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1278 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:41.352936 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27d4b176-5955-4a4a-bd37-19a5dbd0a9a8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/action" status: 202 len: 0 microversion: 2.20 time: 0.686335 Aug 30 18:45:41.362177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:41.363256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:41.368089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2740/5355] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:45:40 2022] POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:45:41.375136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:41.375664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:41.376128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:41.376883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:41.377362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:41.377838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:41.928577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:41.931905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:42.006813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:42.023763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:42.024773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:42.026550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:42.029212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:42.031203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:42.273858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:42.284821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:42.296454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:42.298440 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98a722aa-b502-4762-82cc-4d268ee232a0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.940026 Aug 30 18:45:42.299237 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2616/5356] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:41 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:42.508940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:42.518686 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-613c3511-a693-407f-b9db-72cb1a9b666c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1278 microversion: 2.1 time: 0.600940 Aug 30 18:45:42.533973 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2741/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:41 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1278 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:42.857250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:42.857790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:42.874576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:42.875214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:42.875974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:42.876762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:42.877244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:42.877694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:42.880050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:42.920949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:42.929601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:42.930499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:42.950889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:45:43.000452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] Creating event network-changed:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h2-854119-10 Aug 30 18:45:43.031666 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-00809158-6de6-4ec9-9888-d54cb54e23ad req-fb898a7a-56f6-4b64-8ec4-5bb9166f4302 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149461 Aug 30 18:45:43.039863 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2742/5358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:45:43.091408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.117819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.122836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Searching by: {'deleted': False, 'project_id': '39cd889057a24e0abb0f3ebf950cecef'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:45:43.148793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de602241-f374-42c1-b061-09989a234f66 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 204 len: 0 microversion: 2.1 time: 0.294310 Aug 30 18:45:43.149292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.151461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.162417 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2617/5359] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:45:42 2022] DELETE /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:45:43.164669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.169907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.170507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.171039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.192980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.200505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:43.248093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.251305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.255305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.256546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.257055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.265564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.336703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:45:43.434566 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd58eeab-4759-4673-8cf0-30dab008d3ac tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.357402 Aug 30 18:45:43.435835 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2743/5360] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:45:43 2022] GET /compute/v2.1/servers => generated 344 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:45:43.441506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.456843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:43.482112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.482467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.483941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.485086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.485580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.486021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.816507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.819563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.829387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.831422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.832765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11e9ffa9-fe1a-47b2-8993-52c939610b26 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.395617 Aug 30 18:45:43.834943 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2744/5361] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:43 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:43.836623 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a7b00ef0-e436-4244-b642-c2111fac61ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1689 microversion: 2.1 time: 0.667565 Aug 30 18:45:43.839351 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2618/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:43 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1689 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:43.856003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.860306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:43.862066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:43.862432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:43.863332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Searching by: {'deleted': False, 'project_id': '39cd889057a24e0abb0f3ebf950cecef'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:45:43.873979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.877377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.878036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.881915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.882934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.884247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.892796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.893482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.894042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.896383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:43.897125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:43.897612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:43.947669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:45:44.056320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:44.068450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.068941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.069387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.241981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b9d8f7a-1615-436e-af69-8ede6f538e97 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.405648 Aug 30 18:45:44.242545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2745/5363] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:45:43 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:44.269463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90f1f359-d802-48b7-98be-909f60dada13 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:44.285807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90f1f359-d802-48b7-98be-909f60dada13 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021220 Aug 30 18:45:44.291192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2746/5364] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:45:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:45:44.312367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:44.328547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd339051-2a31-4a50-8378-a2c96484098a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.487456 Aug 30 18:45:44.331953 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2619/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:43 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:44.732165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:44.734048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:44.770276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.773250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.780440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.781556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.782219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.782920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.853773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:45:44.884319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:44.892660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:44.914872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.915880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.916468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:44.919835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:44.920352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:44.920816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.235356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ec77c7b-c408-495f-9078-274e33460b89 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 204 len: 0 microversion: 2.1 time: 0.516000 Aug 30 18:45:45.237669 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2747/5366] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:45:44 2022] DELETE /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:45:45.253878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:45.256672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:45.310264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.314075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.315651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.317670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.318708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.337200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.406568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:45.534101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:45.545762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:45.562432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:45.565622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec020765-e822-40ff-88be-7496198e8d93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.705492 Aug 30 18:45:45.574869 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2620/5367] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:44 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:45.587717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:45.588735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:45.606226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.607099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.607739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:45.608697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:45.609354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:45.609969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.601028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:46.621460 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:45:46.621735 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 18:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec (ip 10.222.0.25) !!! Aug 30 18:45:46.637688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3927575-4782-452e-9736-0ed0c1a43431 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1606 microversion: 2.1 time: 1.060839 Aug 30 18:45:46.638698 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2621/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:45 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1606 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:46.653697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:46.660546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:46.689662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.691813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.692766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.697245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.701529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.703051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.898966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:46.913996 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-464f7e4f-0062-4023-b4ac-870fa0cfe9dd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 200 len: 1689 microversion: 2.1 time: 1.672206 Aug 30 18:45:46.916846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2748/5369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:45 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 1689 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:46.926117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:46.929470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:46.939262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.939962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.940576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:46.941690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:46.942311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:46.942915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:47.342381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:47.354879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:47.356491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:47.357752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8160271-3fa6-4a87-994a-a15d2e3ef1f3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.439738 Aug 30 18:45:47.362734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2749/5370] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:46 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:47.374078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebb88df-830f-4243-913f-4de14e31b112", "name": "network-vif-deleted", "tag": "d57c8a63-4f85-4a6b-b129-d8769d4c1055"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:47.381269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:47.402504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:47.403003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:47.403439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:47.407482 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24174646-5d02-4cf5-8643-5c0366c3e6fb tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.765443 Aug 30 18:45:47.409909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2622/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:46 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:47.432149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] Creating event network-vif-deleted:d57c8a63-4f85-4a6b-b129-d8769d4c1055 for instance 5ebb88df-830f-4243-913f-4de14e31b112 on n-h2-854119-10 Aug 30 18:45:47.444500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-218abc05-d24e-4e9c-a6ad-043302941f44 req-8c9033ef-aa26-4617-9de8-51f40897526b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080071 Aug 30 18:45:47.445797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2750/5372] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:47.667640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:47.674065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:47.695929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:47.702002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:47.703511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:47.704328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:47.705044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:47.705752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:47.941670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:47.943153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 5ebb88df-830f-4243-913f-4de14e31b112] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:47.959215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:47.959947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:47.960485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:47.963847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:47.964584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:47.965111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:48.006814 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] HTTP exception thrown: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Request method failure captured: Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 HTTP/1.1 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlo7eNdRA01I3W-MRgZkZv3teqriXS0Hi03L2b3Msm7JwKQE_nTf0o0CIFGNoHKhO-f1Qeq5DCjIw2QdxrbgWqsz9K_tWdWzAPtJTz3cfJ2WdlEJ1wYuXnR75h2o08zt8sWrNJOWUulBICPHel7lMev8oF9R_pmo7g9Yw9YtFUA69KU Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bf8da5657e864953b48bf5307f363139"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bf8da5657e864953b48bf5307f363139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 087be4b9803348b5ac503a1576c890c2 Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5ebb88df-830f-4243-913f-4de14e31b112'} Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:45:48.009438 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. Aug 30 18:45:48.013941 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:45:48.017737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Returning 404 to user: Instance 5ebb88df-830f-4243-913f-4de14e31b112 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:45:48.019122 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3367b5b5-806d-47c7-9581-0aa266ef250c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112" status: 404 len: 111 microversion: 2.1 time: 0.082362 Aug 30 18:45:48.020468 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2751/5373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:47 2022] GET /compute/v2.1/servers/5ebb88df-830f-4243-913f-4de14e31b112 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:45:48.266268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:48.286065 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76ef7074-5426-4f86-9e09-a028dae9643c tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1606 microversion: 2.1 time: 0.629295 Aug 30 18:45:48.287249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2623/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:47 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1606 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:48.383817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:48.385033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:48.398374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:48.399076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:48.399736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:48.400683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:48.401355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:48.401954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:48.437168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:48.438447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:48.448879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:48.449676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:48.455029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:48.456097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:48.456751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:48.457353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:48.794260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:48.830166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6b1c9112-26ab-4756-94bd-81cce0f4e83c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.396908 Aug 30 18:45:48.833758 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2624/5375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:48 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:49.007832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:49.063770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:49.065706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:49.068563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9c2222d-bb41-4ad9-b818-648f5499171d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.689475 Aug 30 18:45:49.071011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2752/5376] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:48 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:49.310041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:49.311213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:49.329106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:49.330008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:49.330498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:49.334177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:49.335801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:49.336592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:49.523798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:49.540226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:49.567417 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-390622aa-55eb-4232-825c-b92d418c056a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1539 microversion: 2.1 time: 0.262433 Aug 30 18:45:49.571493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2625/5377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:49 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1539 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:49.838968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec", "name": "network-vif-deleted", "tag": "9176092e-9f9c-40f1-86c1-a9a52a1e10ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:49.854614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:49.855247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:49.870044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:49.871757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:49.872380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:49.873300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:49.873999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:49.877873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:49.881876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:49.882402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:49.884253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:49.922209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] Creating event network-vif-deleted:9176092e-9f9c-40f1-86c1-a9a52a1e10ba for instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec on n-h2-854119-10 Aug 30 18:45:49.943500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2ba29f48-006e-45e0-8fef-7d22ac7e6c62 req-1e9af1b4-586b-4708-be97-254ebbe4b052 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110457 Aug 30 18:45:49.945925 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2753/5378] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:50.095704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:50.097175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:50.104117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:50.105507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:50.106181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:50.106817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:50.107712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:50.108544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:50.109376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:50.117731 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-125d1bfd-ed1b-4787-868d-c780f2f02ea3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.267651 Aug 30 18:45:50.121891 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2626/5379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:49 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:50.487952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:50.519928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:50.521848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:50.530148 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b9478cb-5627-44c1-9c68-2a4e54b79bde tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.440363 Aug 30 18:45:50.533314 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2754/5380] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:50 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:50.592692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:50.593341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:50.604030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:50.607215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:50.610023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:50.611092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:50.613066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:50.613723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:50.785879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:50.799930 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d626b8e-f0f4-46a8-8ad3-2a4d33c59a81 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.211055 Aug 30 18:45:50.824684 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2627/5381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:50 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:51.140550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:51.141856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:51.162613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.167812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.168522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:51.169470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.175359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.176320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:51.517161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:51.528708 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f2ec729-6c0c-4fc9-be50-6d31c2491ca2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.393411 Aug 30 18:45:51.543096 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2755/5382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:51 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:51.561037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:51.561670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:51.575733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.576240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.576694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:51.582616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.583351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.583872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:51.835977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:51.837188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:51.850691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.851234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.851714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:51.862284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:51.863546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:51.863975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:52.087090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:52.118894 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73848d56-10b0-4fc1-a4c0-7290e1987a07 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.286906 Aug 30 18:45:52.134376 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2756/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:51 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:52.215464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:52.231780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:52.236462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:52.239102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-981c660c-8f8f-4a8e-8090-930a54772ff7 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.682346 Aug 30 18:45:52.258432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2628/5384] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:51 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:52.553679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:52.554456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:52.577056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:52.577619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:52.578071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:52.578856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:52.585923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:52.586438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:53.149099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:53.150497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:53.177450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:53.186561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:53.187734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:53.188979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:53.190871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:53.192283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:53.203925 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a97794aa-710b-430f-8476-91309a51f1c2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.650014 Aug 30 18:45:53.204688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2757/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:52 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:53.205277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:53.269593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:53.270219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:53.284725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:53.288411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:53.289179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:53.291964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:53.295122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:53.297579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:53.841430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:53.855661 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-172f45ea-2f7a-4985-a561-7587b5de728b tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.710852 Aug 30 18:45:53.880999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2629/5386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:53 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:45:53.892979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:54.055341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:54.232234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:54.233737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:54.245884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:54.247821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:54.261562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:54.263152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:54.265775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:54.266650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:54.886467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:54.919388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:54.945374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:54.947452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6fa35cda-105b-44b1-9e56-60269b272c6f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1742 microversion: 2.20 time: 1.681875 Aug 30 18:45:54.952869 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2758/5387] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:53 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1742 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:54.983775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:54.986562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:54.991789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:54.998697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:54.999865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:55.000563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:55.001487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:55.011540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:55.013554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:55.034702 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9afa7198-747d-4cef-9bcb-cd856e987579 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.806979 Aug 30 18:45:55.047063 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2630/5388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:54 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:55.724504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:55.752063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afcc642a-8c25-4708-8c24-bca8a79c80ee tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.795360 Aug 30 18:45:55.768019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2759/5389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:54 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:56.006260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:56.015194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:56.054010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.063954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:56.067475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:56.069371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.075000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.085203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:56.085946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.090943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.093998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.127202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.130707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.135600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.139645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.203321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.204239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.491537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:56.506104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:56.508392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:56.510092 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9d84388-cf04-4d63-a264-22a94ce35386 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.521809 Aug 30 18:45:56.512137 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2631/5390] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:55 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:56.720797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c5602a-61fd-476b-b6e9-8262afae2bce", "name": "network-vif-plugged", "status": "completed", "tag": "3f259b26-b76c-4a73-8cac-7770f4c58cb3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:56.757890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.762617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.763534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.809119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] Creating event network-vif-plugged:3f259b26-b76c-4a73-8cac-7770f4c58cb3 for instance 25c5602a-61fd-476b-b6e9-8262afae2bce on n-h1-854119-10 Aug 30 18:45:56.826560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-14dc00e3-16da-4383-b0f0-12d8296f1345 req-75a99169-1ad5-4884-9380-756ecd762104 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310852 Aug 30 18:45:56.827528 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2632/5391] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:56.864712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:56.892055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:56.915308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.916632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.917678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:56.919034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:56.919825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:56.920471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:57.191519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:57.207488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:57.209063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-301eaa35-42f0-4433-a33b-5cc288fbf4d0 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 1.152543 Aug 30 18:45:57.223803 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2760/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:56 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:57.249324 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6dc38ce1-d072-4350-bf70-a6dbbd16a98a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.416165 Aug 30 18:45:57.250775 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2633/5393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:56 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:57.540223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:57.541347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:57.557844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:57.559492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:57.561905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:57.564128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:57.571524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:57.572638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:58.247772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:58.249103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:58.274863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:45:58.300383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:58.301263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:58.302084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:58.303844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:58.304634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:58.305320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:58.851459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:58.882854 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44c5eccd-26b5-4ca3-a073-d50736f63250 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1266 microversion: 2.1 time: 0.655485 Aug 30 18:45:58.892156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2634/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:58 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1266 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:58.914531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:58.915265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:58.922997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:58.923521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:58.923980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:58.924738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:58.925267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:58.925718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:58.967993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:58.983288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:58.987583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:58.990219 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-578ffdbb-a992-4d92-8e9a-17443c0b0b7d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.455626 Aug 30 18:45:59.004277 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2761/5395] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:45:57 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:45:59.028018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "name": "network-vif-plugged", "status": "completed", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:45:59.071872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:59.072659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:59.075650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:59.097076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:45:59.098571 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7bcc4b9-a0d4-4928-aaf9-d89682b7c7d9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.190309 Aug 30 18:45:59.116719 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2635/5396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:58 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:45:59.166603 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] Creating event network-vif-plugged:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:45:59.184796 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0a49e3c6-6426-4e6f-9c7f-e5f9f4c9837b req-96630825-c771-49ea-8e73-bef6aa52cd52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178349 Aug 30 18:45:59.186518 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2762/5397] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:45:59.893137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f0f431a-5143-4bdc-b3ce-d6cd02606dbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '.version_select at 0x7f4e569365e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:59.916647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:45:59.917384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:45:59.934162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:59.934677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:59.935775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:59.936541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:45:59.937001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:45:59.937414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:45:59.990659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f0f431a-5143-4bdc-b3ce-d6cd02606dbe tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-937799425" status: 202 len: 0 microversion: 2.1 time: 0.100851 Aug 30 18:46:00.007611 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2636/5398] 10.222.0.25 () {58 vars in 1281 bytes} [Tue Aug 30 18:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-937799425 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:46:00.071322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:00.073866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:00.089428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.095050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.098046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:00.100548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.107140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.107909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:00.363886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:00.374077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07f91035-3476-43cd-bd1f-c886f986c75c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1453 microversion: 2.1 time: 0.464424 Aug 30 18:46:00.374706 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2763/5399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:45:59 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1453 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:00.396917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-596dafee-0f48-48d1-a24f-9d39a36f19f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: .version_select at 0x7f4e55a7dd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-731009202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtytZZvwdyOwluKhVqpNI4QyqotzUQce4XmE9z7d4YseJGwTjd8gF58ElxeCbIUFGRgYg24VwA3Z/9HXdxvr3LCPkwOTjAjDoSysersQZ10I0zhYaGGlhan3tTv910ZBQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:00.436421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-596dafee-0f48-48d1-a24f-9d39a36f19f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:00.444747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-596dafee-0f48-48d1-a24f-9d39a36f19f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:00.508512 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-596dafee-0f48-48d1-a24f-9d39a36f19f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.123164 Aug 30 18:46:00.509539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2764/5400] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:46:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:00.541766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:00.543142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:00.560589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.561515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.563580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:00.564738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.567011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.569837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:00.822874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:00.839887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:00.848409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:00.853202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1e907486-d0b4-4ed7-8d5a-857f7d51e088 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.806149 Aug 30 18:46:00.856932 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2637/5401] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:00 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:00.874226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:00.877444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:00.887208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:00.896685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2654c283-6ce2-4617-ae6a-b3e2596c58f1 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.369453 Aug 30 18:46:00.901826 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2765/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:00 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:00.908002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.908824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.909002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:00.928530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:00.929450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:00.930215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:01.564491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:01.594524 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4777b4fe-b320-4458-8b74-79baffe2a239 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1453 microversion: 2.1 time: 0.735380 Aug 30 18:46:01.595451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2638/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:00 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1453 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:01.886402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:01.887038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:01.910616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:01.911200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:01.911646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:01.912393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:01.922032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:01.924294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:01.926838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:01.928003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:01.969413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:01.980994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:01.981662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:01.982577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:01.993241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:01.993975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:02.229602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9c53c452c4d3ea1e6650deb9d2ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cd889057a24e0abb0f3ebf950cecef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:02.253187 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66a67a4e-5178-42b1-b94b-30fce82684b4 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 200 len: 1253 microversion: 2.1 time: 0.331771 Aug 30 18:46:02.254482 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2639/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:01 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 1253 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:02.614444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:02.646820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:02.669731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:02.683475 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4821b0fb-c1b3-4bb1-a2e4-5acea4d21f24 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.799084 Aug 30 18:46:02.684746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2766/5405] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:01 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:03.275755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:03.277138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] [instance: 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:03.291379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:03.296386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:03.297163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:03.298711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:03.304960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:03.306435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:03.354270 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] HTTP exception thrown: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Request method failure captured: Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec HTTP/1.1 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlpOQwLUicYBs7ORhneajpqf4aCbg2w69EIqsps65fxb0ZjjEhVh9Edhep6TtslczCq9Dv4swmvknrHDaaao9nFL0o1p3LiVgo-l3WMdVkTPpX2Qd7jr1otFOb2SpSN6eQQPpOyAQ1uswmIINVtjPrlREE19AcgOYfw9qpOCekgtmIk Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 39cd889057a24e0abb0f3ebf950cecef Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestBootFromVolume-1820052258 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39cd889057a24e0abb0f3ebf950cecef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39cd889057a24e0abb0f3ebf950cecef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39cd889057a24e0abb0f3ebf950cecef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39cd889057a24e0abb0f3ebf950cecef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestBootFromVolume-1820052258 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 39cd889057a24e0abb0f3ebf950cecef Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1820052258 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestBootFromVolume-1820052258-project Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 4dd9c53c452c4d3ea1e6650deb9d2ee8 Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestBootFromVolume-1820052258-project Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec'} Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:46:03.359452 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. Aug 30 18:46:03.363808 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:46:03.366012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Returning 404 to user: Instance 1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:46:03.368666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0afe712d-b2ba-4c22-87bb-1cb41f10067a tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec" status: 404 len: 111 microversion: 2.1 time: 0.097452 Aug 30 18:46:03.378553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17068c7e-4834-4642-8f94-829cc0eca9c9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] Calling method '.version_select at 0x7f4e55b18430>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:03.386749 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2640/5406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:03 2022] GET /compute/v2.1/servers/1ca76ea6-70b3-44ce-8b82-dc2d9a1a86ec => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:46:03.416965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17068c7e-4834-4642-8f94-829cc0eca9c9 tempest-ServersTestBootFromVolume-1820052258 tempest-ServersTestBootFromVolume-1820052258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2121712846" status: 202 len: 0 microversion: 2.1 time: 0.042793 Aug 30 18:46:03.418283 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2767/5407] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2121712846 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:46:03.712726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:03.713790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:03.729891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:03.732169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:03.734153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:03.739739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:03.740691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:03.744739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:04.169110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:04.186013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:04.200742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:04.204592 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a534bde-090f-432e-ade9-000713058e4c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.496353 Aug 30 18:46:04.210314 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2641/5408] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:03 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:05.262270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:05.264244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:05.314075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:05.315156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:05.315597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:05.316550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:05.317171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:05.326280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:06.009812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:06.022922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:06.024777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:06.026165 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9ab7031-4362-4ff3-8098-46847e1abf05 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.785612 Aug 30 18:46:06.039923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2768/5409] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:05 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:07.063227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:07.066714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:07.140469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:07.145161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:07.145777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:07.149240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:07.149993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:07.153089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:07.916328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:07.934337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:07.946271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:07.963065 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f71cfc3-4895-4693-aa92-d3dd1f49bfd2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.901811 Aug 30 18:46:07.964466 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2642/5410] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:07 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:09.042193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:09.043420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:09.078542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:09.079981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:09.079981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:09.080410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:09.080885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:09.105083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:10.208339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:10.218579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:10.227138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:10.231994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:10.239275 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17a35006-0a76-4f0a-8e5c-9292d2f50eac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.203970 Aug 30 18:46:10.240707 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2769/5411] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:09 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:11.264509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:11.265980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:11.283659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:11.295380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:11.296150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:11.297331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:11.298412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:11.302886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:11.961014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:11.961014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:11.961014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:11.961014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4b6edc9-e907-4f47-b92d-4ccbcae66c5b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.683503 Aug 30 18:46:11.993444 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2643/5412] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:11 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:12.999220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:13.000541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:13.014483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:13.023654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:13.028253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:13.029085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:13.033362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:13.035030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:13.037094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:13.954920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:13.981961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:13.984193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:13.985657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92c4f2b4-f8a7-4839-bafa-995d654426b1 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 0.994673 Aug 30 18:46:13.986777 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2770/5413] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:12 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:14.139465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c5602a-61fd-476b-b6e9-8262afae2bce", "tag": "3f259b26-b76c-4a73-8cac-7770f4c58cb3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:14.182362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:14.185549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:14.194925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:14.240652 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] Creating event network-changed:3f259b26-b76c-4a73-8cac-7770f4c58cb3 for instance 25c5602a-61fd-476b-b6e9-8262afae2bce on n-h1-854119-10 Aug 30 18:46:14.263446 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-19eb35bc-2172-4ce2-a5cf-ffff913071b0 req-6ca7f498-be25-4109-81af-4c2c39b9ae10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128721 Aug 30 18:46:14.276002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2644/5414] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:15.012382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:15.013185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:15.027711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:15.028213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:15.028653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:15.031639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:15.033959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:15.034427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:16.104389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:16.130668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:16.141885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:16.151490 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d36bdb28-5184-483e-b4ed-bed2810c035e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.143433 Aug 30 18:46:16.177954 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2771/5415] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:15 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:17.187160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:17.187896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:17.202933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:17.206803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:17.207714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:17.208845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:17.216262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:17.216864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:17.348823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:18.256172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:18.283770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:18.286283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:18.289662 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a1a26b1-628e-4414-88f6-a77dd01086ba tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.108484 Aug 30 18:46:18.292437 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2645/5416] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:17 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:19.325568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:19.326336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:19.340859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:19.347210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:19.347689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:19.348464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:19.353776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:19.365103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:20.562318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:20.580067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:20.583181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:20.592002 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-661e91b8-f9e4-4f54-bf68-858da0fa489e tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.270593 Aug 30 18:46:20.600885 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2772/5417] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:19 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:21.626634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:21.627942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:21.663781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:21.665023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:21.667066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:21.669106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:21.675402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:21.679154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:22.932255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:22.941290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:22.950006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:22.953381 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd2ffaea-eed6-40a2-9e15-9acde0587d65 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.330698 Aug 30 18:46:22.957469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2646/5418] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:21 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:23.987032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:23.987835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:23.998774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:24.005869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:24.006748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:24.007820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:24.009333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:24.011645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:25.528777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:25.547088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:25.550676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:25.562592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1c744b2-a8ac-4ba5-ab86-16717a3aaaf8 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.575357 Aug 30 18:46:25.563702 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2773/5419] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:23 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:26.594456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:26.596068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:26.622254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:26.634053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:26.638450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:26.639292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:26.642256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:26.642780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:27.359646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1146317685", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "fb3bdc06-c57b-4db9-976c-0b72f7e974f2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-731009202", "security_groups": [{"name": "tempest-secgroup-smoke-702530326"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:27.387253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:27.588829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] validate_networks() for [('fb3bdc06-c57b-4db9-976c-0b72f7e974f2', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:46:27.767527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:27.794394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:27.807335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:27.821865 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff00bec8-3af9-44e5-bfd8-2662f14b7764 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1737 microversion: 2.20 time: 1.218809 Aug 30 18:46:27.823230 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2647/5420] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:26 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1737 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:28.844503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:46:28.846946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:46:28.854261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:46:28.857722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:46:28.859721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:46:28.860680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:28.864927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:28.889170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:28.902912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:28.903787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:28.913722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:28.916424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:28.917313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:28.923082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:28.947290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:28.948419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:28.949243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:28.961308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:28.962125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:28.962911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:29.068166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:29.096598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:29.162223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:46:29.168659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:46:29.383587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:29.400652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:29.409880 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0b5e8d4b-e712-4be7-9a4f-9c086269dbfd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.055261 Aug 30 18:46:29.412626 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2774/5421] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:46:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:46:29.425832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:29.427331 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a14d521-e08d-465c-9c4c-cb9127778c9b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1719 microversion: 2.20 time: 0.574624 Aug 30 18:46:29.437762 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2648/5422] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:28 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1719 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:46:29.447609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2923fb9a-9ee3-4cc5-a677-8ac0310a606c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:29.453111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2923fb9a-9ee3-4cc5-a677-8ac0310a606c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:29.580037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2923fb9a-9ee3-4cc5-a677-8ac0310a606c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:29.598748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2923fb9a-9ee3-4cc5-a677-8ac0310a606c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1266 microversion: 2.1 time: 0.177197 Aug 30 18:46:29.601653 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2775/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:29 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:30.467083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:30.467744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:30.489068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:30.489646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:30.490171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:30.490949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:30.491426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:30.491931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:30.625969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3223c6ce-2507-4b91-bdee-3d8c9fd8a832 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:30.627592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3223c6ce-2507-4b91-bdee-3d8c9fd8a832 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:31.058142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3223c6ce-2507-4b91-bdee-3d8c9fd8a832 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:31.070450 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3223c6ce-2507-4b91-bdee-3d8c9fd8a832 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1266 microversion: 2.1 time: 0.447276 Aug 30 18:46:31.077482 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2776/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:30 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:31.108852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:31.136510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:31.143095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:31.146152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4522913-8aaa-494d-8561-831455b2be01 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1719 microversion: 2.20 time: 0.682972 Aug 30 18:46:31.148205 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2649/5425] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:30 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1719 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:32.111316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:32.112217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:32.142356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:32.142872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:32.144809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:32.151938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:32.152780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:32.153254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:32.180826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:32.181613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:32.216196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:32.216692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:32.217156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:32.217997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:32.218708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:32.218970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:32.803725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:32.860976 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8f9fb5d6-494b-4d5b-af9a-7f2a06095535 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1326 microversion: 2.1 time: 0.756444 Aug 30 18:46:32.901506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2777/5426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:32 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1326 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:32.943338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "name": "network-vif-unplugged", "status": "completed", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:32.997319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:32.998576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.000003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.032183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.compute.server_external_events [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] Unable to find a host for instance b5bf9a06-461f-41f4-8c89-946e3974e232. Dropping event network-vif-unplugged {{(pid=122589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 18:46:33.036743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-54039018-3b74-4bec-ac60-440d784a9c45 req-16bf2c9b-aa38-403d-9cee-5cca8d8046bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.132507 Aug 30 18:46:33.039144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2778/5427] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 137 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 18:46:33.639022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:33.692545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:33.710410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:33.719254 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9b56474-3a06-4ad1-a13f-53601dea4e50 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1662 microversion: 2.20 time: 1.540962 Aug 30 18:46:33.723600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2650/5428] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:32 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1662 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:33.753957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc0d4f3d-5680-4ac2-b05b-3214a956687b"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:33.775645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:33.798814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.799332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.799792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.800560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.801031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.801459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.890479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:33.892193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:33.915053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.915997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.916641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:33.917603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:33.918309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:33.918984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:34.319352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:34.359608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a77054e-2ca7-4d5f-9f90-3b7536714899 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1324 microversion: 2.1 time: 0.472971 Aug 30 18:46:34.379477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2651/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:33 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:34.809385 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66760658-d1df-4682-a091-5ef66a26c2f5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.060672 Aug 30 18:46:34.810068 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2779/5430] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Aug 30 18:46:33 2022] POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments => generated 188 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:46:35.111522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:35.112090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:35.126130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.127173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.127173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.127870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.128335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.128777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.388915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:35.389999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:35.406587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.408322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.410400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.411378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.416582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.417622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.799387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ab7ca90-e76e-49f9-87df-59469483dfbd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments/cc0d4f3d-5680-4ac2-b05b-3214a956687b" status: 202 len: 0 microversion: 2.20 time: 0.692076 Aug 30 18:46:35.800231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2652/5431] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Aug 30 18:46:35 2022] DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments/cc0d4f3d-5680-4ac2-b05b-3214a956687b => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:46:35.927979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:35.931189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:35.964477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.973561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.974183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:35.975079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:35.975814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:35.977384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:36.079593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122590) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 18:46:36.252287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dac7ffaf-7333-4562-bf84-4305d9ffde99 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/action" status: 202 len: 0 microversion: 2.20 time: 0.328095 Aug 30 18:46:36.253015 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2653/5432] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 18:46:35 2022] POST /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:46:36.285498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:36.292601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:36.336141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:36.337278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:36.337730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:36.338533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:36.339011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:36.339457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:36.649973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:36.668133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ec0f2c0-4b86-432c-82e3-7347d8bf3768 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 1.283800 Aug 30 18:46:36.671971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2780/5433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:35 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:37.094477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:37.120446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:37.122400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:37.128003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1b3d818-db81-46c4-abb6-dac4e8871a8b tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1670 microversion: 2.20 time: 0.862375 Aug 30 18:46:37.130096 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2654/5434] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:36 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1670 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:37.696022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:37.696633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:37.709344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:37.715008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:37.723164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:37.724231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:37.724879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:37.725558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:38.158494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:38.159129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:38.168954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:38.175259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:38.178658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:38.179824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:38.180534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:38.181201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:38.642170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:38.651527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:38.664975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:38.666775 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75dd864c-fb9d-4902-bdd0-062aa1eb03f2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1670 microversion: 2.20 time: 0.512734 Aug 30 18:46:38.668015 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2655/5435] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:38 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:38.728937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:38.740217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d792c30-f85d-4dfe-802b-d0efe5c018ed tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 1.048004 Aug 30 18:46:38.749963 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2781/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:37 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:39.445446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:39.471510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.487525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.488077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.531602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] Creating event network-changed:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:46:39.550264 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6f7ec86e-2652-4788-a210-3fe4c05b95ab req-42aa6dd2-333f-46d6-b911-65f00b986d7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104940 Aug 30 18:46:39.555426 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2656/5437] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:39.692100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:39.693021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:39.713835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:39.726968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.731227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.732404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.739645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.743712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.745498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.779723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:39.781689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:39.799308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.806228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.807321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:39.812083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:39.812870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:39.814206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:40.289345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:40.306126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:40.309209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:40.312803 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5bdc7b6e-8133-4599-afa0-be2a07cc17e9 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1672 microversion: 2.20 time: 0.622645 Aug 30 18:46:40.345887 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2782/5438] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:39 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1672 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:40.377079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:40.421162 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c8e77fb-cfe0-42d2-951d-15d979ab2a65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.643282 Aug 30 18:46:40.442980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2657/5439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:39 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:41.342248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:41.343980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:41.362542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:41.366204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:41.371119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:41.371953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:41.374182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:41.374948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:41.377801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:41.451483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:41.452962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:41.476767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:41.477577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:41.478615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:41.480766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:41.482526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:41.483959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:42.082255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:42.097353 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1f579615-a232-4d79-a8c4-97682571393b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.653612 Aug 30 18:46:42.098016 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2658/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:41 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:42.421869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:42.441222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:42.448406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:42.453638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbb82634-1a9c-4d6c-8052-8d01e001946d tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 1.116341 Aug 30 18:46:42.461665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2783/5441] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:41 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:43.124237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:43.124953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:43.138217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.140760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.142581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.147169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.151076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.152106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.189341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:43.488762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:43.490561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:43.491858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:43.500523 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-19032fbc-acc7-4573-b06a-827f4988ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.381661 Aug 30 18:46:43.510380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2659/5442] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:43 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:43.521869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.522944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.525514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.526413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:43.526859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:43.527290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:43.563046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:44.188263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:44.218754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:44.226709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:44.233222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4f2e2ba8-fe12-4b12-8cbc-dd4fb01b1598 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.744622 Aug 30 18:46:44.236028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2784/5443] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:43 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:46:44.527288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:44.528567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:44.543928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:44.545594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:44.549677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:44.564462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:44.565194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:44.566688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:44.929814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:44.942850 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a149401-1ea0-467c-bc2c-47983233f6e3 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.419252 Aug 30 18:46:44.947956 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2660/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:44 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:45.259275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:45.260640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:45.282784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.284140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.284967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.286017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.288921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.292158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.932281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:45.941793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:45.949295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:45.967771 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60db535c-7276-4538-afb3-f6e1b62e8ecd tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.698373 Aug 30 18:46:45.970479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:45.971784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:45.982174 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2785/5445] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:45 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:45.984431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.987137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.988789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:45.991975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:45.993667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:45.994472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:46.483160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:46.493316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-babf2d8c-2bd1-4f29-95ec-e02e16eab05b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.528280 Aug 30 18:46:46.502555 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2661/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:45 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:46.994685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:46.995298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:47.017181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:47.027800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:47.029235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:47.036891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:47.039585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:47.040404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:47.448200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:47.472125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:47.474288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:47.477701 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70e14e89-0178-4e2d-9fc0-2fe353fa69f0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.486970 Aug 30 18:46:47.482042 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2786/5447] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:46 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:47.515241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:47.515917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:47.539362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:47.539969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:47.544302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:47.546739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:47.551572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:47.552588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:48.016315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:48.028793 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dc9b7de8-4089-48e5-83a7-c05df48a167f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.517870 Aug 30 18:46:48.035152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2662/5448] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:47 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:48.509983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:48.510808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:48.530825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:48.531781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:48.535411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:48.544153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:48.544992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:48.545629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:48.946381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1198ed91-0453-4665-b341-e3208ddcc775 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Action: 'create', calling method: .version_select at 0x7f4e55a80af0>, body: {"keypair": {"name": "tempest-keypair-1530973798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlVCPnxxpCwZAwU1zGxTfw1VwSH+kJP+fHwGbFJo2KjhzbumitNq5Fvari/6IzwmcS8g7zEv76W4VlA4UBdRlZiVza3S+pIKRoWHF+awXiORrnL3mjOlW1U0TbdKUwLww=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:48.990147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1198ed91-0453-4665-b341-e3208ddcc775 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:48.994051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:48.997237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1198ed91-0453-4665-b341-e3208ddcc775 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for user 0a2b26d31f7140a5b39ee22eeab4f8ae and project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:49.008052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:49.015168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:49.025485 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-facadc42-7012-4f25-bf39-3c42a8820244 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.520457 Aug 30 18:46:49.035581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2663/5449] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:48 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:46:49.061974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:49.063170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:49.076979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:49.078024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:49.081612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:49.082824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:49.084499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:49.085283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:49.105249 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1198ed91-0453-4665-b341-e3208ddcc775 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.822924 Aug 30 18:46:49.105879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2787/5450] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:46:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:46:49.563830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-659723174", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:49.650118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:49.663414 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d1dba06-7f9d-4e2a-8d99-e8ee1bc5523b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.605366 Aug 30 18:46:49.671509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:46:49.678741 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2664/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:49 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:50.016071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:46:50.018273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:46:50.020021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:46:50.021158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:46:50.023891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:46:50.041022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.041948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.042645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.044563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.045611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.046742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.062095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:50.063420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:50.075892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.076404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.077580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Getting quotas for project 89f77802a75845079149ae1ee3200c0b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:50.078672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.082425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.084056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.085875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.086393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Getting quotas for user 92185edcee894b4db5bab592b07039e4 and project 89f77802a75845079149ae1ee3200c0b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:50.111952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:46:50.114822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:46:50.277053 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2223158-651a-49ca-936f-66461277dc33 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717314 Aug 30 18:46:50.282741 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2788/5452] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:46:50.312235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d41a31c0-ea1b-4187-ad75-dea1fffc9dd1 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:50.313165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d41a31c0-ea1b-4187-ad75-dea1fffc9dd1 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:50.502837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d41a31c0-ea1b-4187-ad75-dea1fffc9dd1 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:50.536324 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d41a31c0-ea1b-4187-ad75-dea1fffc9dd1 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1214 microversion: 2.1 time: 0.237070 Aug 30 18:46:50.537193 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2789/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:50 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:50.583309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:50.595840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:50.597446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:50.610603 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8bd4ad5-b6da-48db-a2c9-e3b21452404f tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.544155 Aug 30 18:46:50.617741 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2665/5454] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:50 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:50.692004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:50.692634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:50.728625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-plugged", "status": "completed", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:50.733955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.740636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.741332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.744957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.745735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.746361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.754998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:50.755548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:50.756074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:50.781613 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] Creating event network-vif-plugged:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:46:50.796407 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-05ac1062-6e14-4408-8d36-ac853a08fb2a req-dfb46153-a648-490d-8f7e-c3e29f43639c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072019 Aug 30 18:46:50.797770 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2666/5455] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:46:51.566856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:51.568423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:51.592051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:51.603812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:51.608231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:51.610268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:51.611312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d88a9a51-a33b-47e0-9407-d4614a7f8fba tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.919319 Aug 30 18:46:51.614115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:51.616373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2790/5456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:50 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:51.617322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:51.618733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:51.644862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:51.645862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:51.667526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:51.682290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:51.688161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:51.689424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:51.690145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:51.691020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:51.851539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:51.878170 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e18edb3-83a5-4be2-9dc1-b4633489bd50 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1210 microversion: 2.1 time: 0.316978 Aug 30 18:46:51.880963 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2667/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:51 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1210 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:52.177826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:52.202662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:52.205291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:52.216033 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b30a5af1-cb51-4cba-9071-1c8882c941e0 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.576090 Aug 30 18:46:52.217151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2791/5458] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:51 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:46:52.637548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:52.638936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:52.659194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:52.660955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:52.662750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:52.674018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:52.675796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:52.677842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:52.903849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:52.904835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:52.928899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:52.931077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:52.944424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:52.945782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:52.947415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:52.948405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:53.245496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:53.264461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74afcf3b-2874-49c5-8997-6ff0385bba58 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1391 microversion: 2.1 time: 0.631193 Aug 30 18:46:53.266755 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2668/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:52 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1391 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:53.290262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:53.290939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:53.313178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:53.318970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:53.324699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:53.340325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:53.341500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:53.342241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:53.640266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:53.661032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c1c3f28-7a58-4661-9eda-768a1d13023f tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1266 microversion: 2.1 time: 0.763656 Aug 30 18:46:53.673151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2792/5460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:52 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1266 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:54.286604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:54.288615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:54.322421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:54.323177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:54.323654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:54.337033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:54.341701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:54.346798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:55.241436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:55.251291 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-054717b7-4011-4b5e-af2b-e8954204a872 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1563 microversion: 2.1 time: 0.969939 Aug 30 18:46:55.252232 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2793/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:54 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1563 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:55.258665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:55.259672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:55.267656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:55.268508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:55.269176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:55.270401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:55.271064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:55.271741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:55.620772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:55.639069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:55.647815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:55.658071 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9163577e-1c2a-4213-929d-57f1b4eb21db tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 2.389875 Aug 30 18:46:55.658938 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2669/5462] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:53 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:55.670158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:55.670989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:55.680959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:55.682738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:55.683530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:55.696417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:55.697188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:55.697805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:56.069922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:56.083398 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0656df3d-7d3a-4393-9802-51d8f92e4122 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1563 microversion: 2.1 time: 0.420473 Aug 30 18:46:56.084696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2670/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:55 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1563 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:56.097387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-778435122", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2f776eaf-2eb5-425e-a2ba-1c0fd4545a6a"}], "security_groups": [{"name": "tempest-securitygroup--1876981145"}], "key_name": "tempest-keypair-1530973798", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:46:56.180373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:56.201426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3c10ffd4-88bb-442b-90e9-ddd6f099c962 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1272 microversion: 2.1 time: 0.938915 Aug 30 18:46:56.205455 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2794/5464] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:55 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1272 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:56.691802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:56.691802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:56.699584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:56.700100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:56.700552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:56.701288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:56.701743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:56.702223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:56.733374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] validate_networks() for [('2f776eaf-2eb5-425e-a2ba-1c0fd4545a6a', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:46:58.031426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:58.046442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:58.050593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:58.057991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6905f937-974a-40cb-863a-5a0f782f9261 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 1.372891 Aug 30 18:46:58.075397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2795/5465] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:56 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:46:58.075397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:58.075397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:58.087528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:58.093223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:58.094923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:58.096091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:58.101012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:58.103960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:58.105350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:58.244306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:58.257658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-164a56d7-04fd-4994-b915-8461a937ff7e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1272 microversion: 2.1 time: 0.196951 Aug 30 18:46:58.258722 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2796/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:58 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:58.525166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:58.535377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for user 0a2b26d31f7140a5b39ee22eeab4f8ae and project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: dict_keys(['metadata_items']) {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:58.566419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:46:58.566860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:46:58.567349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:46:58.567796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:46:58.568421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:46:58.580470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:58.580974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:58.581420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:58.582413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:58.583068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:58.583689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:58.620446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:46:58.627415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Getting quotas for user 0a2b26d31f7140a5b39ee22eeab4f8ae and project f371ab32a0dc4c5ebf6cbe9a790e0995. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:46:58.648467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:46:58.654672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:46:58.739845 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6911823-89e5-42f0-8e1b-d711cc43f3a7 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.653205 Aug 30 18:46:58.751854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f098f730-f170-4652-b9e6-4fd1f0d0dc71 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:58.752735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f098f730-f170-4652-b9e6-4fd1f0d0dc71 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:58.781799 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2671/5467] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:46:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 2696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:46:58.894167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f098f730-f170-4652-b9e6-4fd1f0d0dc71 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:58.903139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f098f730-f170-4652-b9e6-4fd1f0d0dc71 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1277 microversion: 2.1 time: 0.155195 Aug 30 18:46:58.904032 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2797/5468] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:58 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:46:59.087839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:59.088644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:59.093928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:46:59.098747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.099836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.100919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:59.101984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.110770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.111572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:59.284105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:59.285381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:59.301114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.301624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.305399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:59.306271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.306801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.307247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:59.551248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:59.560745 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b368d94-dfc5-4a0c-a028-ec4c5eacdb43 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.281233 Aug 30 18:46:59.562037 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2798/5469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:59 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:46:59.804457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:59.816688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:59.821441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:46:59.823694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3f240b6c-64a5-4114-a869-c37d803e9afe tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.743292 Aug 30 18:46:59.847491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2672/5470] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:46:59 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:46:59.929102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:46:59.930484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:46:59.940414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.941220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.941852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:46:59.942643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:46:59.943147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:46:59.943541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:00.049447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:00.065674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2ef5865-d306-4c19-a1de-751b08a4bb7f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1329 microversion: 2.1 time: 0.144319 Aug 30 18:47:00.066953 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2799/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:46:59 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:00.586125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:00.587003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:00.593865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:00.594706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:00.595170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:00.595943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:00.596425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:00.596881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:00.854536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:00.856340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:00.859820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:00.875907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:00.876940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:00.878620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:00.879638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:00.880368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:00.881014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:01.122555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:01.136017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:01.143944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:01.145195 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4e772aa-a7fd-4f61-bb8a-8ba523d8fc5c tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.295799 Aug 30 18:47:01.146048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2800/5472] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:00 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:01.154955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:01.155562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:01.169476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:01.170308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:01.170924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:01.171820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:01.172783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:01.173375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:01.240807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:01.254888 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa04f0a8-7f43-4554-b401-9f849082179a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.673186 Aug 30 18:47:01.271076 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2673/5473] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:00 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:01.281103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:01.290949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4867746-3e9e-4593-bae0-6ff849ed9544 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1335 microversion: 2.1 time: 0.143337 Aug 30 18:47:01.292158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2801/5474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:01 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1335 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:01.356935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5d8af4-df0b-453f-8ce1-6de9c33be4b4", "tag": "0f7e9e52-4317-4701-a80e-1f17f514cfed"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:01.377371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:01.378252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:01.379103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:01.405551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] Creating event network-changed:0f7e9e52-4317-4701-a80e-1f17f514cfed for instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 on n-h1-854119-10 Aug 30 18:47:01.420831 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1c387912-2b39-41c6-9d08-985d4fa2cb41 req-9ea316fa-6e5b-4d19-9789-beaaabc75d04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065238 Aug 30 18:47:01.426434 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2674/5475] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:01.897203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:01.899285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:01.909344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:01.916482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:01.917428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:01.919513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:01.920266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:01.922687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.169639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:02.170826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:02.187930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.188758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.189377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.194155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.195206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.196035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.392944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:02.409471 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb501b5c-ca41-4351-be59-7700521963eb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1563 microversion: 2.1 time: 0.515219 Aug 30 18:47:02.412296 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2802/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:01 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1563 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:02.426760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:02.427772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:02.447552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.449440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.451208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.452435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.456772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.457835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.542775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:02.576751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:02.580655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:02.588911 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c97bb870-cdaf-44c1-ba75-2b8d47f8a21a tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.417379 Aug 30 18:47:02.592990 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2675/5477] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:02 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:47:02.606362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:02.609140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:02.624082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.625459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.626156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.627219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:02.628032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:02.628667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:02.852846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:02.877551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53ad2c3f-a95c-4ba9-abb6-5d87ba1f5529 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.281620 Aug 30 18:47:02.878337 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2676/5478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:02 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:03.002850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:03.015610 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-10d64ad1-fcf0-4295-8c46-650adc5e9281 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.601678 Aug 30 18:47:03.035790 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2803/5479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:02 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:03.589839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:03.620577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:03.621340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:03.627769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:03.628288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:03.629020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:03.629785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:03.630710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:03.631031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:03.632122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:03.632284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:03.633198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:03.664287 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] Creating event network-changed:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:47:03.668486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:03.682153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b00cf6c8-ff44-4bad-b288-50abc2bc2ce1 req-07083e97-824c-48cb-9a94-f9d0a64700e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097222 Aug 30 18:47:03.684451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2677/5480] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:03.900045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:03.900809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:03.907552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:03.908250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:03.908700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:03.909390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:03.910074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:03.911458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:04.226585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:04.230649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:04.239275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-03c5a0f1-7f17-415d-916c-26a8c92697f2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.344236 Aug 30 18:47:04.260792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2678/5481] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:03 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:04.267009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:04.269826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:04.277666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:04.278309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:04.278897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:04.279728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:04.280258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:04.280758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:04.562440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:04.576303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:04.579343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:04.582381 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6e78a0f-96ba-4236-bb86-b0e452bfa653 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.965466 Aug 30 18:47:04.583859 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2804/5482] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:03 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:04.594365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "name": "network-vif-plugged", "status": "completed", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:04.606758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:04.607659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:04.608444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:04.639077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] Creating event network-vif-plugged:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:47:04.646070 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bbd009cc-3745-4916-be0a-4d388622e8f8 req-b5618e78-a16b-49e6-973a-811287bcac6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060571 Aug 30 18:47:04.652030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2805/5483] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:04.692727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e9ac12-eea6-465a-89e4-9863dd4b7fdd", "tag": "0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:04.707604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:04.708664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:04.710134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:04.724681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:04.743261 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] Creating event network-changed:0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0 for instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd on n-h2-854119-10 Aug 30 18:47:04.749086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8162aac4-1ea9-491b-bd06-57f26c1c6ece req-5dc6838d-8da8-4176-b376-06adce1e94d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064143 Aug 30 18:47:04.750748 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2806/5484] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:04.766209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2bc9e73f-9a9f-484a-aac6-be725be4266e tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.500456 Aug 30 18:47:04.767940 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2679/5485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:04 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:05.264200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:05.284262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:05.310786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.311440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.312640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.314147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.314660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.315103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.609436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:05.610141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:05.623068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.623903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.624536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.625286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.625768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.629512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.728070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:05.740069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd36d3cf-5397-4371-9549-bddacb34a8a3 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.482874 Aug 30 18:47:05.741079 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2807/5486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:05 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:05.789233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:05.789850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:05.806610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:05.931820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:05.945281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:05.946950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:05.949483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e1460f6f-b536-460b-b554-aa2fb075ec93 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.344860 Aug 30 18:47:05.951485 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2680/5487] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:05 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:47:06.202583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:06.217266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a5f588e-2741-43d8-9003-033ba1cadb2a tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.431959 Aug 30 18:47:06.220959 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2808/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:05 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:06.761767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:06.765576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:06.782314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.785361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.787563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:06.788803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.794279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.797849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:06.976081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:06.976707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:06.989637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.990153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.990766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:06.991697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:06.992328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:06.995264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:07.113871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:07.126953 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d188a4c-1187-4656-8e4d-5f15b6cb2992 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.369439 Aug 30 18:47:07.140579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2681/5489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:06 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:07.241327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:07.242026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:07.265578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:07.266495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:07.267352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:07.268639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:07.269359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:07.270038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:07.468250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:07.477769 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b4b1ea42-fb74-4659-b5d2-3190837c2d12 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.240946 Aug 30 18:47:07.479099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2682/5490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:07 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:07.608654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:07.621912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:07.624034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:07.625229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-659a7269-efe1-45a3-b754-46dcd254d9cf tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1728 microversion: 2.20 time: 0.654593 Aug 30 18:47:07.641192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2809/5491] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:06 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1728 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:08.151516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:08.154068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:08.165394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.167318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.167789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.168801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.169487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.169932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.366120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:08.376056 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a9422c2-bb4e-45e4-aa31-3b98ebc5053a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.231082 Aug 30 18:47:08.379378 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2683/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:08 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:08.381238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5d8af4-df0b-453f-8ce1-6de9c33be4b4", "name": "network-vif-plugged", "status": "completed", "tag": "0f7e9e52-4317-4701-a80e-1f17f514cfed"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:08.407670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.408380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.408994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.423313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] Creating event network-vif-plugged:0f7e9e52-4317-4701-a80e-1f17f514cfed for instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 on n-h1-854119-10 Aug 30 18:47:08.430482 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e885cbab-70a8-465b-8cc3-b54e8f633aed req-fefceb08-5c80-416d-8be9-0548a643a5b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053882 Aug 30 18:47:08.432494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2810/5493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:47:08.501566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:08.502201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:08.510969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.511753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.512373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.513355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.514007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.514678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.609806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:08.639838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:08.658066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:08.659581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:08.671503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.673121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.674178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.675216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:08.676120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:08.681301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:08.741056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:08.751699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4589f913-4846-404e-851f-a639249209e9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1314 microversion: 2.1 time: 0.254245 Aug 30 18:47:08.752896 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2684/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:08 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:08.907215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:09.018034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:09.044422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:09.048322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:09.053631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bfbf7aae-f8f9-4bcb-a794-cce07419e6d5 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1715 microversion: 2.20 time: 0.407670 Aug 30 18:47:09.054802 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2811/5495] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:08 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1715 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:09.406662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:09.408797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:09.426656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:09.427492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:09.428557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:09.431067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:09.431903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:09.432540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:09.780076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:09.781046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:09.790388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:09.791026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:09.791462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:09.819720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:09.820852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:09.823716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:10.046202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:10.059404 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c30027fb-24a9-4717-9f5f-b35237115dd2 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.662964 Aug 30 18:47:10.060660 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2685/5496] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:09 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:10.070287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:10.080620 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04b57f2e-f947-4351-80f4-d841540e140c tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1464 microversion: 2.1 time: 0.310730 Aug 30 18:47:10.085096 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2812/5497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:09 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:10.140319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:10.141323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:10.154610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:10.156897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:10.157643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:10.158929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:10.160047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:10.162533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:10.214571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:47:10.324948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ed2a10c-4359-436b-8903-4990b34c9099 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 204 len: 0 microversion: 2.1 time: 0.190361 Aug 30 18:47:10.326165 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2686/5498] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:47:10 2022] DELETE /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:47:10.337126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:10.338068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:10.348081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:10.348889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:10.349513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:10.365428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:10.366318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:10.367445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:10.686091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:10.717356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ccf29cf-1738-475f-b388-1fba56b5a378 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1470 microversion: 2.1 time: 0.386521 Aug 30 18:47:10.720337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2813/5499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:10 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:11.082034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:11.082996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:11.090329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:11.091269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:11.091943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:11.092877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:11.093545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:11.094186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:11.421128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:11.432385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4edb4cce-d2ce-42f3-a233-b4b89a05a6b1 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.354656 Aug 30 18:47:11.435246 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2687/5500] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:11 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:11.606065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e9ac12-eea6-465a-89e4-9863dd4b7fdd", "name": "network-vif-plugged", "status": "completed", "tag": "0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:11.627961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:11.629427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:11.630110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:11.693202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] Creating event network-vif-plugged:0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0 for instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd on n-h2-854119-10 Aug 30 18:47:11.703188 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3848dace-aab7-4cfa-ae72-4b0cb154b464 req-ae0f8b26-2f2f-4642-abbf-494b2303d865 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101318 Aug 30 18:47:11.705281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2814/5501] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:11.741855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:11.742838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:11.749482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:11.750486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:11.751163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:11.752097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:11.752767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:11.753562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:12.182307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:12.196488 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67eea1b8-aa39-4b30-ad53-0263349a3bc9 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1470 microversion: 2.1 time: 0.458678 Aug 30 18:47:12.201632 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2688/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:11 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:12.458480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:12.466984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:12.485666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:12.488187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:12.488710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:12.489639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:12.490182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:12.492625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:12.886418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:12.897500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c2d66735-2db7-475e-9c45-9ffa60c43cea tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1403 microversion: 2.1 time: 0.443843 Aug 30 18:47:12.904484 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2815/5503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:12 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1403 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:13.227138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:13.230423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:13.233519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5d8af4-df0b-453f-8ce1-6de9c33be4b4", "name": "network-vif-deleted", "tag": "0f7e9e52-4317-4701-a80e-1f17f514cfed"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:13.247835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:13.248254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:13.248690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:13.249103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:13.250062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:13.251163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:13.252512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:13.253665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:13.254802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:13.283367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] Creating event network-vif-deleted:0f7e9e52-4317-4701-a80e-1f17f514cfed for instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 on n-h1-854119-10 Aug 30 18:47:13.306161 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fa183b86-5184-4e68-8eac-3c8e9739549b req-e9ad0cb4-75b1-4b11-9603-e164580628f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077885 Aug 30 18:47:13.307426 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2816/5504] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:47:13.426199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92185edcee894b4db5bab592b07039e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f77802a75845079149ae1ee3200c0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:13.443724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bbdd8ca9-0304-4a3c-9279-49b685a3128b tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 200 len: 1299 microversion: 2.1 time: 0.221501 Aug 30 18:47:13.456080 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2689/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:13 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:13.929698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:13.930299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:13.974104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:13.976319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:13.976853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:13.977662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:13.987893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:13.988478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:14.430077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:14.439044 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13e60876-376f-4ce2-b05b-9e464d528641 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1590 microversion: 2.1 time: 0.523328 Aug 30 18:47:14.448591 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2817/5506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:13 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1590 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:14.461484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:14.467489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:14.468106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] [instance: cb5d8af4-df0b-453f-8ce1-6de9c33be4b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:14.469108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:14.489913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:14.490444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:14.492831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:14.493252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:14.493680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:14.494421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:14.494870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:14.495455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:14.501317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:14.502168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:14.502691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:14.503142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:14.558248 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] HTTP exception thrown: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Request method failure captured: Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 HTTP/1.1 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlsUhG8YzEiQDAk0Yld2c5Ku3BishcB2Kiw-QGDbWAgM0KgDj21bAvtjXO8MxyBlDXekB50CPR2-cpPFKHsD-c_MGU9ch7kQQBabF1nKkZHRFZqr0vwXIdLClfwkR_LXR_EzzX79Z912-8am4PIgg9qmcYXR93nVVJqbaq23ATaJTqI Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 89f77802a75845079149ae1ee3200c0b Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesNegativeTest-314894211 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89f77802a75845079149ae1ee3200c0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89f77802a75845079149ae1ee3200c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89f77802a75845079149ae1ee3200c0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89f77802a75845079149ae1ee3200c0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesNegativeTest-314894211 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 89f77802a75845079149ae1ee3200c0b Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesNegativeTest-314894211 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesNegativeTest-314894211-project Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 92185edcee894b4db5bab592b07039e4 Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesNegativeTest-314894211-project Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'cb5d8af4-df0b-453f-8ce1-6de9c33be4b4'} Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:14.561270 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. Aug 30 18:47:14.566742 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:14.568873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] Returning 404 to user: Instance cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:14.571076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cac4f3f3-9d5e-4f07-aa65-441ff1f65c39 tempest-VolumesNegativeTest-314894211 tempest-VolumesNegativeTest-314894211-project] 10.222.0.25 "GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4" status: 404 len: 111 microversion: 2.1 time: 0.107159 Aug 30 18:47:14.578064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2818/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:14 2022] GET /compute/v2.1/servers/cb5d8af4-df0b-453f-8ce1-6de9c33be4b4 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:47:14.650036 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0d9fed4-544b-482d-91b4-fb54cde5edcc tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192877 Aug 30 18:47:14.651137 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2690/5508] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:47:14 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:17.620531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:17.621738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:17.633638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.643217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.643972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.644981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.645671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.646331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.658750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e9ac12-eea6-465a-89e4-9863dd4b7fdd", "tag": "0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:17.690808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:17.691306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:17.691808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:17.720950 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] Creating event network-changed:0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0 for instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd on n-h2-854119-10 Aug 30 18:47:17.738868 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c61f85c6-6274-49de-8d49-34fc4302124d req-cfb9167a-30ea-43ea-bb06-c590d477e71c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086501 Aug 30 18:47:17.739801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2691/5509] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:18.287739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:18.300602 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c23632ae-9304-4d9d-adcd-56582989ee78 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1590 microversion: 2.1 time: 0.684910 Aug 30 18:47:18.320931 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2819/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:17 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1590 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:19.519168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:19.521584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:19.539512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:19.544632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:19.545103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:19.545873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:19.546355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:19.546800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:19.675981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67fbbb7e-b462-416c-8708-5ec3e7532d5d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action" status: 200 len: 24573 microversion: 2.1 time: 0.161299 Aug 30 18:47:19.676866 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2692/5511] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:19 2022] POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action => generated 24573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:47:30.642008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:30.644046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:30.648849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=49 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:30.650043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=69 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:30.657336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:30.658299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:30.659073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:30.660148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:30.660869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:30.661526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:30.862782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a4d3346-8ab2-4fd9-b7bb-76dfefad9fb0 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1835 microversion: 2.1 time: 0.224831 Aug 30 18:47:30.863875 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2820/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:30 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1835 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:30.885580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:30.886299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:30.895456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:30.896093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:30.898210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:30.899002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:30.899641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:30.900559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:30.901369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:30.902274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:31.114633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:31.137989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-488ab9fa-1f6c-4fac-87b9-10411c01e5b0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1682 microversion: 2.1 time: 0.256492 Aug 30 18:47:31.138802 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2693/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:30 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:31.295489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:31.299427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:31.321459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:31.322258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:31.322743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:31.323485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:31.323948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:31.324386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:31.450285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26e736ac-5f2b-415b-bba9-4f4a21525190 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action" status: 200 len: 32648 microversion: 2.1 time: 0.172284 Aug 30 18:47:31.458745 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2821/5514] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:31 2022] POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action => generated 32648 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:47:31.629334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:31.630319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:31.651063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:31.652937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:31.654077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:31.656941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:31.658704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:31.660290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:31.715883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '523c3297189f4e788a1d23890c6c5113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4057a05ea88142f9aae86361659691ed', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:31.716616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] flavor_id is None. Assuming migration. {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 18:47:31.717166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 18:47:31.976195 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2bd15cb-d38c-48ae-a57d-696f1f438d14 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action" status: 202 len: 0 microversion: 2.1 time: 0.351450 Aug 30 18:47:31.980137 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2694/5515] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:31 2022] POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:47:31.995810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:31.996632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:32.041110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:32.041693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:32.042137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:32.043432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:32.043904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:32.049923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:32.710024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:32.754993 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7f04c37-8936-43e1-9a7c-c2d0bea88133 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1691 microversion: 2.1 time: 0.754078 Aug 30 18:47:32.755783 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2822/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:31 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1691 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:33.785226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:33.785863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:33.826045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:33.840957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:33.841440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:33.849777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:33.850514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:33.850990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:34.277965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:34.296304 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1ca0602-daea-461c-84e6-b7c78a506fec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1691 microversion: 2.1 time: 0.517225 Aug 30 18:47:34.302427 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2695/5517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:33 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1691 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:35.323709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:35.324344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:35.354308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:35.354867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:35.355306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:35.356872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:35.357354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:35.357786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:36.495811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:36.500850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27fdcf93-dde5-45ac-89c1-1f0f41925fab tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1691 microversion: 2.1 time: 1.180226 Aug 30 18:47:36.503045 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2823/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:35 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1691 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:37.529008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:37.529671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:37.554900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:37.555408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:37.555920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:37.556715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:37.557186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:37.557627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:37.938791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:37.947410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b25cba12-1daf-492e-b731-fb30e15e4e90 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.423311 Aug 30 18:47:37.947979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2696/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:37 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:38.162427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:38.164923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:38.173582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.174396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.175190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.176419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.177083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.177895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.216827 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-30974b07-5fe3-4f51-8290-2ee754f52913 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059135 Aug 30 18:47:38.217657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2824/5520] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 18:47:38 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:38.295674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:38.297232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:38.306513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.307488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.308130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.309345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.309984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.310760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.345213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:47:38.491961 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b99f74e4-d310-4293-8ef1-19e6d4c30664 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 204 len: 0 microversion: 2.20 time: 0.200041 Aug 30 18:47:38.492579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2697/5521] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:47:38 2022] DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:47:38.503127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:38.504072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:38.512323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.513261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.513919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.514922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.515448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.515949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.725202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:38.736285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:38.738277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:38.740018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-732362df-6c0c-4598-b5f6-88dc17600be3 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.242564 Aug 30 18:47:38.755701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2825/5522] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:38 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:38.976336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:38.977819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:38.985436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.986030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.986795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:38.987534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:38.988010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:38.988484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:39.278293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:39.287722 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5963d654-8ab5-47cd-8784-90539d8e724f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.315796 Aug 30 18:47:39.292043 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2698/5523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:38 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:39.765432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:39.766367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:39.778764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:39.786327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:39.786953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:39.787999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:39.788641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:39.789258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:40.003825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:40.021659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:40.023717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:40.025113 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4740997a-799a-426c-ba56-f10f55e92b78 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1721 microversion: 2.20 time: 0.263713 Aug 30 18:47:40.039996 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2826/5524] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:39 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:40.313491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:40.315203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:40.328383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:40.331433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:40.333387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:40.334881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:40.337015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:40.338840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:40.563942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:40.580256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c277004e-627b-47a1-ac5a-26b1e44973cf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.271385 Aug 30 18:47:40.592066 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2699/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:40 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:41.050800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:41.052114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:41.071926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:41.072525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:41.073028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:41.073805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:41.074319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:41.074813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:41.169283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:41.182204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:41.184635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:41.186978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bdc0152b-134f-4a18-8857-ba2e7d7a1646 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1654 microversion: 2.20 time: 0.140427 Aug 30 18:47:41.188410 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2827/5526] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:41 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:41.446088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bf9a06-461f-41f4-8c89-946e3974e232", "name": "network-vif-deleted", "tag": "15fa9965-c9a9-4edd-abed-3c338d318c80"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:41.475820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:41.476462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:41.486365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:41.528800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] Creating event network-vif-deleted:15fa9965-c9a9-4edd-abed-3c338d318c80 for instance b5bf9a06-461f-41f4-8c89-946e3974e232 on n-h1-854119-10 Aug 30 18:47:41.547221 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f46cbd87-68d6-454a-b7d6-d1fbf83ec083 req-b78cc3d0-44d7-4915-a453-a062f7c28b6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104926 Aug 30 18:47:41.552006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2700/5527] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:41.609239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:41.610179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:41.640746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:41.647838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:41.648646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:41.651251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:41.651970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:41.652589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:41.973434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:41.992623 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fe8b72b4-3bab-4493-80d4-bf0e778908ec tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.384093 Aug 30 18:47:41.993310 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2828/5528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:41 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:42.226982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:42.228097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:42.237896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:42.243010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:42.243935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:42.246628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:42.247418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:42.248115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:42.325507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:42.330087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:42.331026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:42.331743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lazy-loading 'fault' on Instance uuid b5bf9a06-461f-41f4-8c89-946e3974e232 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:47:42.403542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:42.419660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:42.422332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '219c93f311cb4768a65b9aedaf63e2a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2522b169d5b64fee93202209eff67c97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:42.423738 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a6c35f6-80fe-4d82-ae6a-e5edf7166bb4 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 200 len: 1370 microversion: 2.20 time: 0.202269 Aug 30 18:47:42.426740 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2701/5529] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:42 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:47:43.029957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:43.032311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:43.047317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:43.052290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:43.064481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:43.065489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:43.072115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:43.072830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:43.457693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:43.463572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:43.488868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:43.494649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:43.495626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:43.499993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:43.502923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:43.509193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:43.510033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:43.530114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-87c2789e-463e-49f5-a60f-b77a9d7febbb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.504318 Aug 30 18:47:43.537292 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:43.542185 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2829/5530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:43 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 HTTP/1.1 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b5bf9a06-461f-41f4-8c89-946e3974e232'} Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:43.542582 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:43.548069 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:43.551228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:43.552838 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cf99179a-1cc1-43c5-bbf7-b9bb079660ff tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 404 len: 111 microversion: 2.20 time: 0.106196 Aug 30 18:47:43.559483 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2702/5531] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:43 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:47:43.563955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edd7e2e9-f559-48c6-a7b5-9bf60cb60448 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '.version_select at 0x7f4e55bffee0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:43.605591 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edd7e2e9-f559-48c6-a7b5-9bf60cb60448 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821701059" status: 204 len: 0 microversion: 2.20 time: 0.046352 Aug 30 18:47:43.607071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2830/5532] 10.222.0.25 () {60 vars in 1259 bytes} [Tue Aug 30 18:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821701059 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:47:44.552802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:44.554404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:44.565180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:44.565991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:44.566765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:44.567830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:44.568862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:44.569562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:45.212951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:45.236612 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abbb48dc-beac-462d-865e-70b03911fce9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.688458 Aug 30 18:47:45.246746 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2703/5533] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:44 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:46.267547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:46.268285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:46.287660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:46.296714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:46.297529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:46.298288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:46.298781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:46.299210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:46.547295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:46.559775 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4a78ab37-73ec-44fc-b8f8-bde1ffadb0bf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.297372 Aug 30 18:47:46.560639 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2831/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:46 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:47.584298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:47.584904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:47.605921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:47.606716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:47.607576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:47.608518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:47.609171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:47.609785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:47.822657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:47.839325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1901c53-290d-491d-a189-208dd8efb7cc tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.259472 Aug 30 18:47:47.840249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2704/5535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:47 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:48.677061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:48.677669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:48.691535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.692031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.692465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.693217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.693773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.694162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.726810 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 HTTP/1.1 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b5bf9a06-461f-41f4-8c89-946e3974e232'} Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:48.730984 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.735622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.740035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:48.742905 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-67aa2c97-bdcf-46ef-9b0a-fc4da79c24d2 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 404 len: 111 microversion: 2.20 time: 0.069826 Aug 30 18:47:48.744009 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2832/5536] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:47:48 2022] DELETE /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:47:48.752512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:48.753126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: b5bf9a06-461f-41f4-8c89-946e3974e232] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:48.760771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.761303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.772762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.773265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.773754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.774194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.792050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 HTTP/1.1 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'b5bf9a06-461f-41f4-8c89-946e3974e232'} Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.793766 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. Aug 30 18:47:48.798663 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:48.800805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance b5bf9a06-461f-41f4-8c89-946e3974e232 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:48.801635 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-547debe6-f96d-4590-a812-96f8b18aed34 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232" status: 404 len: 111 microversion: 2.20 time: 0.053382 Aug 30 18:47:48.802302 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2705/5537] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:48 2022] GET /compute/v2.1/servers/b5bf9a06-461f-41f4-8c89-946e3974e232 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:47:48.878707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:48.880829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:48.891302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.891942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.908723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:48.912130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:48.912764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:48.913215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:49.318815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:49.350981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-308fe6ef-7ca6-4b42-a016-30f5616921e0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1696 microversion: 2.1 time: 0.491473 Aug 30 18:47:49.366286 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2833/5538] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:48 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1696 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:50.373633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:50.375151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:50.392147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:50.393077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:50.393814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:50.396513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:50.397795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:50.401075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:50.758259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:50.769450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4adbaf7c-95cb-4d38-b280-b9d487ccc50e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1695 microversion: 2.1 time: 0.399963 Aug 30 18:47:50.786376 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2706/5539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:50 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1695 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:51.173914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:51.194036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:51.206706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:51.207306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:51.260217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Creating event network-vif-unplugged:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h1-854119-10 Aug 30 18:47:51.274568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] Instance b5c8e272-6e31-420d-9b63-20330a366f06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:47:51.306864 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-25c32151-1365-42fe-888e-5b89a9a73c10 req-2b989e25-9cf1-4868-a5a6-e4f339920850 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136833 Aug 30 18:47:51.312736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2834/5540] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:51.801295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:51.802248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:51.819616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:51.820278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:51.822022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:51.823117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:51.826812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:51.827741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:52.368379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:52.377019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:52.390051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8dbfd417-997c-4ff0-ba36-342c6f3936f9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1695 microversion: 2.1 time: 0.592095 Aug 30 18:47:52.396491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2707/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:51 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1695 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:47:53.420820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:53.427768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:53.456114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.460471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.463410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.464499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.467177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.469174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.538357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:53.558690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.559184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.567259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.595940 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Creating event network-changed:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h1-854119-10 Aug 30 18:47:53.624271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] Instance b5c8e272-6e31-420d-9b63-20330a366f06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:47:53.659017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4bf5dead-a437-4c6b-9b8b-b8557512a80b req-4f5080a0-b4fa-473c-8280-d41e54244aa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124749 Aug 30 18:47:53.661015 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2708/5542] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:53.684368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:53.690866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:53.692055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Searching by: {'deleted': False, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:47:53.703540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.704300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.706083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.706929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.713086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.713703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.782011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:47:53.820757 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4bcf93f7-ae43-4f7e-91fa-0a5bb67c7ef8 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.157399 Aug 30 18:47:53.821727 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2709/5543] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:47:53 2022] GET /compute/v2.1/servers => generated 339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:53.839172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:53.847279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:53.849213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Searching by: {'deleted': False, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:47:53.860257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.860916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.861219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.862166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:53.862921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:53.863544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:53.898848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:47:53.979989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:53.992585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:54.003144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:54.003896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:54.091222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:54.109362 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-10727762-0566-4481-af7a-042b3d5020f6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1693 microversion: 2.1 time: 0.688800 Aug 30 18:47:54.110310 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2835/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:53 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1693 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:54.575558 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f63c3dd-04c9-481b-9257-70d5619d598d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.743495 Aug 30 18:47:54.578755 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2710/5545] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 18:47:53 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:54.619965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-918157ff-c8e5-4d52-99f4-147e9d62994c tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:54.639862 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-918157ff-c8e5-4d52-99f4-147e9d62994c tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019063 Aug 30 18:47:54.640932 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2836/5546] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:47:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:54.961083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:54.962133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:54.971884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:54.973505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:54.975679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:54.976680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:54.978158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:54.979463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.082739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:47:55.135207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:55.136025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:55.149098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.151322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.152028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.154139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.155918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.156567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.283758 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-023167be-aa64-4f03-918f-0d6ccb14e1af tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 204 len: 0 microversion: 2.1 time: 0.327587 Aug 30 18:47:55.287016 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2711/5547] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:47:54 2022] DELETE /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:47:55.300230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:55.301338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:55.320805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.324871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.325547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.327998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.329307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.330971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.440027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:55.464988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4968ec25-edd1-467e-a8da-99be50ee79ce tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1690 microversion: 2.1 time: 0.335701 Aug 30 18:47:55.483857 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2837/5548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:55 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1690 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:55.490640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:55.491636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:55.499503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.500180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.500798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.501672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.502283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.503905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.676053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:55.688018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e75a63c-eb44-442b-85b0-3fa7a87d385f tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1715 microversion: 2.1 time: 0.395112 Aug 30 18:47:55.690388 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2712/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:55 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1715 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:55.740145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:47:55.863636 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5552892d-2ef9-407d-ba05-88b4c2baba86 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action" status: 202 len: 0 microversion: 2.1 time: 0.377086 Aug 30 18:47:55.866705 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2838/5550] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:47:55 2022] POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:47:55.879684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:55.880798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:55.888754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.889929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.890833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:55.893740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:55.895158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:55.896094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.233506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:56.248049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2be526b9-2d62-4711-860c-48cc662ced9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.369866 Aug 30 18:47:56.248049 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2713/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:55 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:56.712899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:56.714053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:56.750193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.750949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.751431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.762634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.763157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.763945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.791501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:56.792050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:56.803003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.808350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.809192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.810129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.810802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.814570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.844379 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e HTTP/1.1 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e'} Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:56.850711 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.856148 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.857940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:56.860140 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ce6dc382-30d7-45c0-92c4-872b23f9a2ac tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 404 len: 111 microversion: 2.20 time: 0.074030 Aug 30 18:47:56.864570 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2714/5552] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:47:56 2022] DELETE /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:47:56.885202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:56.887642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] [instance: 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:56.902883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.915749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.916225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.917009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:56.922225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:56.922718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:56.953334 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] HTTP exception thrown: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Request method failure captured: Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e HTTP/1.1 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlmEHJ6d5NG_KQH_HItOoUhZoB6oWTe3IW8j3hJhCCqsrZg76HPidbLz3voMrRMrS3GfukoPH8Tx5I9dtG2DG6BiqE2dAg6gZmsp5_HZh0STfm97ggoP6thymHtqMBmehJWDtlqVCrZI5ycHhmOb9d44pJayXNKAPliUYdhwwURoH1Y Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2522b169d5b64fee93202209eff67c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2522b169d5b64fee93202209eff67c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2522b169d5b64fee93202209eff67c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 2522b169d5b64fee93202209eff67c97 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110423496 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 219c93f311cb4768a65b9aedaf63e2a2 Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110423496-project Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e'} Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.955263 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] Returning 404 to user: Instance 5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:47:56.961412 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49de576e-a61b-4809-8003-9e1f2ee98989 tempest-AttachVolumeShelveTestJSON-1110423496 tempest-AttachVolumeShelveTestJSON-1110423496-project] 10.222.0.25 "GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e" status: 404 len: 111 microversion: 2.20 time: 0.091242 Aug 30 18:47:56.963455 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2715/5553] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:47:56 2022] GET /compute/v2.1/servers/5a24d5ce-e450-4bc9-b4eb-0a2d209e8a5e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:47:57.270378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:57.271202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:57.287356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:57.290603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:57.298984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:57.302362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:57.302916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:57.303374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:57.454514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:57.470234 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6724a118-ac3c-48bc-b458-7deaa9bed74d tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1715 microversion: 2.1 time: 0.760927 Aug 30 18:47:57.471892 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2839/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:56 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1715 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:57.690506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:57.699640 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0bc6facd-29d6-4a2b-a098-69fabf070e04 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.434294 Aug 30 18:47:57.717986 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2716/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:57 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:58.494129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:58.495790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:58.527715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.528492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.529064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.529938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.530616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.531152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.672834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-plugged", "status": "completed", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:47:58.723152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.723997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.724652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.789666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Creating event network-vif-plugged:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h1-854119-10 Aug 30 18:47:58.811842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] Instance b5c8e272-6e31-420d-9b63-20330a366f06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:47:58.830094 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e8f3d91f-810e-4e4c-ad63-fd859eebacbf req-c403c7f2-9136-4b27-bd21-4d3765c6bb4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161777 Aug 30 18:47:58.831443 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2717/5556] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:47:58.841999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:58.847230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:58.868146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.868800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.869377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.870210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:58.870807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:58.871350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:58.887730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:58.898845 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c6317ce-41ec-48fe-9264-69c44c7a4a1a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1715 microversion: 2.1 time: 0.409827 Aug 30 18:47:58.900668 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2840/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:58 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1715 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:59.131768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:47:59.159046 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9008bde0-5ed3-48d3-b9b9-2cf01ed0e51f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.324716 Aug 30 18:47:59.161148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2718/5558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:58 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:47:59.921436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:47:59.923050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:47:59.931065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.931828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.932457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:47:59.933492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:47:59.934173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:47:59.934821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:00.170963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:00.183126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:00.183810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:00.193327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:00.204749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d8f8f8a-d600-4de6-91d9-9847079b5664 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1647 microversion: 2.1 time: 0.286300 Aug 30 18:48:00.205241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:00.205788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:00.206693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:00.207222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:00.207732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:00.209461 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2841/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:47:59 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1647 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:00.590177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:00.599318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-723e2d6f-dabc-447f-8bf6-f6b42b2a6df7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.422052 Aug 30 18:48:00.599925 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2719/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:00 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:00.707191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e9ac12-eea6-465a-89e4-9863dd4b7fdd", "name": "network-vif-deleted", "tag": "0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:00.716928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:00.734043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:00.741230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:00.741774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:00.790624 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] Creating event network-vif-deleted:0dc27c13-8827-4dd1-abc2-e56bf3b0a6d0 for instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd on n-h2-854119-10 Aug 30 18:48:00.808304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c3858850-50fd-4f02-bf30-8d890e21114c req-dc0cabf2-01b2-4fad-a609-b6f571dfffae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108968 Aug 30 18:48:00.810574 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2842/5561] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:01.143282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:01.200580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:01.203849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.204772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.207058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.242419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:01.244915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:01.251132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Creating event network-vif-unplugged:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:48:01.276121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] Instance b5c8e272-6e31-420d-9b63-20330a366f06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:48:01.292884 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ebd3c914-7cd3-4047-8770-7018301443ca req-25f8df39-6aff-4905-8777-a73f88546df8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157257 Aug 30 18:48:01.294419 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2720/5562] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:01.301245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.303537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.304014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.304775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.305236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.305728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.393837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.407170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.408283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.408572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lazy-loading 'fault' on Instance uuid a6e9ac12-eea6-465a-89e4-9863dd4b7fdd {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:48:01.621200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:01.621913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:01.644487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.664818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2b26d31f7140a5b39ee22eeab4f8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f371ab32a0dc4c5ebf6cbe9a790e0995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:01.674740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-061b3d67-9579-402d-820c-971aafdf4dec tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 200 len: 1367 microversion: 2.1 time: 0.448779 Aug 30 18:48:01.675326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.677266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:01.689688 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2843/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:01 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:01.690734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:01.692970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:01.694840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.186668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:02.200129 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abf22a68-a1a7-429a-b4d3-4cc8e146fa0a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.581742 Aug 30 18:48:02.201322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2721/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:01 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:02.573264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:02.573841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:02.591398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.591949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.592395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.593413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.594078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.594835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.658698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:48:02.716016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:02.717167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] [instance: a6e9ac12-eea6-465a-89e4-9863dd4b7fdd] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:02.728893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.732662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.734445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.744080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.745378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.746412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.783456 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] HTTP exception thrown: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Request method failure captured: Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd HTTP/1.1 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlsXvTVNAQ2dS9E297IxnMGwPYdlif8ZNTNmiyreDXokf4gozmrVAbEamJL6ulXsZ-1OS8fUQp-cj3pEai3MyF7o2IGXI4qutVoR9t7SQhylnLk6SQngjSJJU4YEJtAaQP-f0Rzx3Uswt-zqfe-2POPoGlOFdzoRUd8Y57wbdYvYdt0 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f371ab32a0dc4c5ebf6cbe9a790e0995 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersTestManualDisk-912924365 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f371ab32a0dc4c5ebf6cbe9a790e0995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f371ab32a0dc4c5ebf6cbe9a790e0995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f371ab32a0dc4c5ebf6cbe9a790e0995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f371ab32a0dc4c5ebf6cbe9a790e0995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersTestManualDisk-912924365 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f371ab32a0dc4c5ebf6cbe9a790e0995 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersTestManualDisk-912924365 Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersTestManualDisk-912924365-project Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 0a2b26d31f7140a5b39ee22eeab4f8ae Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersTestManualDisk-912924365-project Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'a6e9ac12-eea6-465a-89e4-9863dd4b7fdd'} Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:02.788337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Returning 404 to user: Instance a6e9ac12-eea6-465a-89e4-9863dd4b7fdd could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:48:02.794326 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bda3cf62-7845-4038-b7e7-c7d9d00e9f6a tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd" status: 404 len: 111 microversion: 2.1 time: 0.083901 Aug 30 18:48:02.795840 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2722/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:02 2022] GET /compute/v2.1/servers/a6e9ac12-eea6-465a-89e4-9863dd4b7fdd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:48:02.804261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d1681e4-384c-43cf-bf19-cb126d7bbf20 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] Calling method '.version_select at 0x7f4e56e7de50>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:02.862274 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d1681e4-384c-43cf-bf19-cb126d7bbf20 tempest-ServersTestManualDisk-912924365 tempest-ServersTestManualDisk-912924365-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530973798" status: 202 len: 0 microversion: 2.1 time: 0.060737 Aug 30 18:48:02.868741 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2723/5566] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 18:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530973798 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:48:02.910815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e6d11e6-827a-47be-84c4-0e87595b179a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 204 len: 0 microversion: 2.1 time: 0.942979 Aug 30 18:48:02.913116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2844/5567] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:48:01 2022] DELETE /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:48:02.924041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:02.924192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:02.939466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.941506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.942906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:02.945903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:02.946483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:02.948388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:03.221768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:03.222508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:03.237248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:03.237735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:03.244613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:03.245715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:03.246409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:03.247011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:03.549012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:03.557778 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b299512-a02e-4f17-b5d0-aa2f06fd125e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1576 microversion: 2.1 time: 0.640342 Aug 30 18:48:03.558392 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2724/5568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:02 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1576 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:03.575472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:03.613333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:03.613834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:03.614338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:03.665712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Creating event network-changed:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:48:03.680570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] Instance b5c8e272-6e31-420d-9b63-20330a366f06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 18:48:03.711459 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-39f16e9a-6af9-4445-8561-df8baec7a329 req-e1f3bce7-5769-4823-af5e-78847e7bc775 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147907 Aug 30 18:48:03.712000 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2725/5569] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:03.929522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:03.941095 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-735450ac-640d-44c8-a9c2-e4f6a3812e98 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.723602 Aug 30 18:48:03.943959 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2845/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:03 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:04.583956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:04.584677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:04.587719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:04.590978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:04.613603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:04.614516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:04.615228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:04.619276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:04.619938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:04.621966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:04.669383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:04.969693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:04.970288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:04.978530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:04.979250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:04.979884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:04.980829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:04.981761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:04.982374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:05.408119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:05.421557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b9b4bab-30be-4af4-946d-9a99fc42ed75 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1689 microversion: 2.1 time: 0.452855 Aug 30 18:48:05.439285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2846/5571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:04 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1689 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:05.926393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:05.936939 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa10fb72-de99-4fe5-bcbd-701e7e756a87 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1576 microversion: 2.1 time: 1.357465 Aug 30 18:48:05.946687 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2726/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:04 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1576 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:06.445194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:06.445807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:06.452652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:06.453144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:06.453583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:06.454300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:06.454780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:06.455205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:06.960218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:06.961551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:06.974274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:06.979727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:06.980519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:06.982478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:06.986770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:06.987249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:07.629488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:07.646029 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-279f1452-798c-481e-a343-48d44812f60b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1682 microversion: 2.1 time: 1.203140 Aug 30 18:48:07.659403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2847/5573] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:06 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1682 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:08.502764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:08.515444 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1cc79616-12dd-4237-8429-935467c5f0bf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1576 microversion: 2.1 time: 1.559942 Aug 30 18:48:08.523262 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2727/5574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:06 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1576 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:09.320527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c5602a-61fd-476b-b6e9-8262afae2bce", "name": "network-vif-deleted", "tag": "3f259b26-b76c-4a73-8cac-7770f4c58cb3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:09.379529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:09.380041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:09.384836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:09.440581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] Creating event network-vif-deleted:3f259b26-b76c-4a73-8cac-7770f4c58cb3 for instance 25c5602a-61fd-476b-b6e9-8262afae2bce on n-h1-854119-10 Aug 30 18:48:09.465280 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-56c621b0-78a7-475a-b912-869b02ff9ab8 req-d16f7e9b-0491-4834-a1c9-3dd924ba8aea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150127 Aug 30 18:48:09.468952 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2848/5575] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:09.546506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:09.552966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:09.575610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:09.576532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:09.577249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:09.578534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:09.579223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:09.579891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:09.680146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:09.693248 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9fa98bdf-734c-4ab8-b030-99724f1acb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.152147 Aug 30 18:48:09.710255 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2728/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:09 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:10.718906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:10.719667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:10.749462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:10.752008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:10.754496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:10.760767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:10.762968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:10.763772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:10.985062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:11.002926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78d67abd-1f8c-4f15-a183-e26f5e5ad39c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.281926 Aug 30 18:48:11.007125 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2849/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:10 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:11.358299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-plugged", "status": "completed", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:11.383340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:11.387305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:11.388100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:11.421608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] Creating event network-vif-plugged:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:48:11.431692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6d4094e6-c6a0-4fd9-83be-3874d39c42a7 req-cbc099ae-101f-40eb-aef2-54a74e3ef5a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078715 Aug 30 18:48:11.433206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2729/5578] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:12.026654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:12.036626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:12.067898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:12.075071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:12.077171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:12.080694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:12.082172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:12.084953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:12.312434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:12.344792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddb8b387-3b1e-4087-a3f3-4d5ccba4d2e6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.323865 Aug 30 18:48:12.345773 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2850/5579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:12 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:13.374405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:13.375018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:13.391591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:13.392835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:13.393540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:13.394712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:13.395826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:13.396620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:13.689140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:13.707156 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2dbfa85d-5f25-461a-b2f1-878693398a2c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.336416 Aug 30 18:48:13.708654 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2730/5580] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:13 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:14.730558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:14.731822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:14.743339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:14.745896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:14.746535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:14.748275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:14.751227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:14.751815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:14.911239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:14.932581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b0f45226-16f3-411f-8b5c-d588b0063c5a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.207251 Aug 30 18:48:14.962859 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2851/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:14 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:15.987403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:15.988796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:16.002307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:16.004339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:16.005088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:16.008148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:16.010918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:16.011621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:16.226028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:16.240566 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dfb759ef-d7ab-455a-8bbf-64c3e19bc795 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.256888 Aug 30 18:48:16.244980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2731/5582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:15 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:17.273744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:17.274421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:17.313800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:17.314310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:17.314780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:17.315513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:17.315973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:17.316403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:17.494644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:17.510671 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58a58129-63f3-4ea3-a71c-99e414435aff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.241224 Aug 30 18:48:17.521344 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2852/5583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:17 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:18.565839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:18.567043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:18.579845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:18.582782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:18.585447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:18.586454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:18.587587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:18.590451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:18.707020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:18.717928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d549be72-6c3c-45ee-b4f1-599ac18efb4b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.156944 Aug 30 18:48:18.722722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2732/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:18 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:19.745447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:19.746861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:19.760896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:19.763917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:19.764617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:19.765800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:19.768058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:19.768752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:20.245831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:20.278015 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4b997bd-67c1-4976-a199-624bf8c2d89e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1225 microversion: 2.1 time: 0.534700 Aug 30 18:48:20.279316 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2853/5585] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:19 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1225 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:21.305084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:21.305939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:21.317689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:21.318484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:21.327332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:21.328302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:21.328899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:21.329603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:21.392423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:21.395156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:21.398880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:21.399669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lazy-loading 'fault' on Instance uuid 25c5602a-61fd-476b-b6e9-8262afae2bce {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:48:21.495815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:21.507857 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49190432-66cf-49b8-9cea-1d2def761d9a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 200 len: 1230 microversion: 2.1 time: 0.206672 Aug 30 18:48:21.508824 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2733/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:21 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 1230 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:22.530891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:22.531515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:22.545686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:22.555158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:22.555614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:22.556377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:22.556836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:22.557266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:22.560496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:22.607893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce HTTP/1.1 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '25c5602a-61fd-476b-b6e9-8262afae2bce'} Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:22.609578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29ed3f33-4e72-4cfa-8ed3-25d296f25e38 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 404 len: 111 microversion: 2.1 time: 0.085816 Aug 30 18:48:22.616282 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2854/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:22 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:48:23.059140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-851063067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2094816941", "security_groups": [{"name": "tempest-secgroup-smoke-1314100298"}], "block_device_mapping_v2": [{"uuid": "808891ce-c377-453c-948b-816e40d7afc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:23.606368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:48:25.243856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:48:25.251618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:48:25.252381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:48:25.253010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:48:25.253856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:48:25.277565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:25.282544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:25.283446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:25.285399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:25.288513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:25.289257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:25.359885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:48:25.368521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:48:25.473013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:48:25.475438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='808891ce-c377-453c-948b-816e40d7afc3',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:48:25.776375 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34d713e1-7f8c-4eb5-bb2f-4bfbf027ba7a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.721426 Aug 30 18:48:25.785298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2734/5588] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:48:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:48:25.795446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6be52e69-d7ec-40c2-b0e2-e020ff90c362 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:25.796172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6be52e69-d7ec-40c2-b0e2-e020ff90c362 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:26.005978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6be52e69-d7ec-40c2-b0e2-e020ff90c362 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:26.014966 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6be52e69-d7ec-40c2-b0e2-e020ff90c362 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1094 microversion: 2.1 time: 0.226857 Aug 30 18:48:26.021822 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2855/5589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:25 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1094 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:26.348777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de18c1e3-12aa-47e1-b390-6ee5c079c566 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: .version_select at 0x7f4e56c05670>, body: {"keypair": {"name": "tempest-keypair-697893927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdqdk4IUZOiS5VZ14NPJixWMzgJ/J81hlcSaS/rib4P0F6sQSt5pMNwYw7PJFVs+5QXzIm99llZ9BLYZ/EUqZpHFgXWpJk09rqWMAwu5N0bnw/txctDNxR4xdz/ndx/Eg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:26.414650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-de18c1e3-12aa-47e1-b390-6ee5c079c566 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for project e2a9d975528d4fc5a070323842500908. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:48:26.441242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-de18c1e3-12aa-47e1-b390-6ee5c079c566 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for user 504f1d4d8eb44acb8a1cf28fad277c0d and project e2a9d975528d4fc5a070323842500908. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:48:26.528872 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de18c1e3-12aa-47e1-b390-6ee5c079c566 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.547925 Aug 30 18:48:26.535659 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2735/5590] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:48:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:27.044730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:27.045347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:27.096143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:27.097310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:27.098008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:27.099050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:27.099727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:27.100603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:27.369893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:27.379405 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1804e7cf-771e-4e40-8b4d-cfd0abd45773 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1144 microversion: 2.1 time: 0.341537 Aug 30 18:48:27.396457 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2856/5591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:27 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1144 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:28.419811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:28.421217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:28.439230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:28.439744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:28.440195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:28.440930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:28.441401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:28.441840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:28.584947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:28.594674 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7979b608-9206-4d03-afa7-cc4a3384d448 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1210 microversion: 2.1 time: 0.182314 Aug 30 18:48:28.595060 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2736/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:28 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:29.618421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:29.619236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:29.652576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:29.653171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:29.653630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:29.656979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:29.657468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:29.664036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:30.166975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:30.176609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b81bbd0-f53d-4e57-911c-3d9c276e34df tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1210 microversion: 2.1 time: 0.564211 Aug 30 18:48:30.187217 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2857/5593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:29 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1210 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:30.462966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:30.467003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:30.499511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:30.500367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:30.501028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:30.502447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:30.508893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:30.509649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:30.659971 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5db597e-21f7-47c5-9ff7-50969ae86637 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action" status: 200 len: 63146 microversion: 2.1 time: 0.450307 Aug 30 18:48:30.661506 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2737/5594] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:48:30 2022] POST /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06/action => generated 63146 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:48:31.214795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:31.216002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:31.227502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:31.228312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:31.228919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:31.229887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:31.230542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:31.231207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:32.610879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f695b42-5e5d-4e45-a3c6-d270d607b8f6", "tag": "74e409c3-1d7b-41b2-baf9-1ffcebc833ea"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:32.662304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:32.667818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:32.671212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:32.673758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:32.784664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] Creating event network-changed:74e409c3-1d7b-41b2-baf9-1ffcebc833ea for instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 on n-h1-854119-10 Aug 30 18:48:32.836153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e8c47b13-d743-4417-b4b7-a0b8fbbc8092 req-536d84a1-fc75-41eb-8c84-30467f5a3503 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208434 Aug 30 18:48:32.837053 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2738/5595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:48:32.840362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:32.856913 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5170c008-3005-43d2-8a54-e4321004b24e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 1.646752 Aug 30 18:48:32.860081 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2858/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:31 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:33.884954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:33.885801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:33.912179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:33.912692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:33.913139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:33.913865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:33.914327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:33.914786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:34.318931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:34.344110 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a1b23269-e41a-4a3c-b7e3-7dac87c2802b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 0.462663 Aug 30 18:48:34.344744 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2739/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:33 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:35.366308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:35.368122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:35.392583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:35.402776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:35.406095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:35.409205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:35.410328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:35.412748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:35.415758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:36.014558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:36.077996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1716598907", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ae283a4-2e24-4d7a-af5c-43a1c3f20002"}], "security_groups": [{"name": "tempest-securitygroup--688801416"}], "key_name": "tempest-keypair-697893927", "user_data": "}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:36.117305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:36.304948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] validate_networks() for [('8ae283a4-2e24-4d7a-af5c-43a1c3f20002', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:48:36.459478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:36.849036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:36.881411 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ae3c43a-b33d-4ab2-9e54-0b91eaadeae3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 1.513082 Aug 30 18:48:36.902564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2859/5598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:35 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:37.180798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:48:37.181337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:48:37.181711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:48:37.182130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:48:37.182575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:48:37.206864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.207483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.208027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.211163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.211684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.212135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.248274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=65 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:37.285044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:37.286194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:37.288655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for project e2a9d975528d4fc5a070323842500908. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:48:37.298991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.299897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.302021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.303700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.307554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.307824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for user 504f1d4d8eb44acb8a1cf28fad277c0d and project e2a9d975528d4fc5a070323842500908. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:48:37.309939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.372484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:48:37.386227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:48:37.528632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d133fd10-7050-4217-88dc-79147e353a7a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.455829 Aug 30 18:48:37.535750 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2740/5599] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:48:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:48:37.542180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8fab2b9e-9558-40a2-8c41-436094b03796 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:37.543093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8fab2b9e-9558-40a2-8c41-436094b03796 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:37.724966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8fab2b9e-9558-40a2-8c41-436094b03796 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:37.735094 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8fab2b9e-9558-40a2-8c41-436094b03796 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1237 microversion: 2.1 time: 0.194635 Aug 30 18:48:37.747545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-183f1bc7-e8f6-4179-b571-f10a0c18334e tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1835 microversion: 2.1 time: 0.724393 Aug 30 18:48:37.748159 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2860/5600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:37 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1835 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:37.751955 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2741/5601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:37 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1237 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:37.903817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:37.905140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:37.929529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.935235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.938405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.941887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:37.943905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:37.945021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:37.987600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-707427343", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "da290d88-c153-430c-9113-da6af8831549"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:38.229373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] validate_networks() for [('da290d88-c153-430c-9113-da6af8831549', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:48:38.941365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:38.951569 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-297fe2a8-3261-492a-81ba-ee4ba03ce464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 1.052083 Aug 30 18:48:38.961778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2742/5602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:37 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:38.967115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:38.982818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:39.016342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:39.022378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:39.026568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:39.029901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:39.032566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:39.034705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:39.264979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:48:39.266162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:48:39.266955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:48:39.267552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:48:39.268264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:48:39.287203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:39.294019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:39.294577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:39.295023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:39.295820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:39.299997 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57579d4a-b636-4408-91ec-e3ae478a336c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1233 microversion: 2.1 time: 0.336708 Aug 30 18:48:39.305493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2743/5603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:38 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1233 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:39.309007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:39.309792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:39.370992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Getting quotas for project 0606559258564ba8a78ecc37582d3e21. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:48:39.386617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Getting quotas for user ee3b9fee027b4d6ab0b533afd8ef5364 and project 0606559258564ba8a78ecc37582d3e21. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:48:39.436119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:48:39.443580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:48:39.558156 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4aea3db-edc2-4a73-8ec7-d3537936f53d tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734435 Aug 30 18:48:39.559223 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2861/5604] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:48:39.570386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-891f2343-a28b-44f4-b40f-b074cbca8142 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:39.570919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-891f2343-a28b-44f4-b40f-b074cbca8142 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:39.861627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-891f2343-a28b-44f4-b40f-b074cbca8142 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:39.869999 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-891f2343-a28b-44f4-b40f-b074cbca8142 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1216 microversion: 2.1 time: 0.304202 Aug 30 18:48:39.888117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2744/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:39 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:39.979601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:39.980209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:39.999790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.000283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.000780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:40.001490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.001938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.002371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:40.332083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:40.335734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:40.358381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.363893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.364746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:40.365853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.367357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.369465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:40.507608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:40.518629 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1e344a1-588a-49f0-9ff6-cd27f357eda4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 0.542965 Aug 30 18:48:40.523051 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2862/5606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:39 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:40.657894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:40.667190 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f90e2227-93d8-45c0-98ca-c00c69ea5c7f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1297 microversion: 2.1 time: 0.338960 Aug 30 18:48:40.671274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2745/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:40 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1297 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:40.896100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:40.899203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:40.913697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.917589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.918371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:40.927486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:40.932327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:40.933183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:41.114162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:41.173777 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b671bdee-8606-45be-8994-f8c0aa038f78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1220 microversion: 2.1 time: 0.281549 Aug 30 18:48:41.202738 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2863/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:40 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1220 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:41.498955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:41.499516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:41.528493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:41.529308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:41.529948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:41.530962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:41.531636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:41.532270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:41.551997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:41.553603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:41.570261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:41.582927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:41.586892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:41.587865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:41.588514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:41.589127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:41.633396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:48:42.002305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d65f480f-22c5-4cd4-b555-5b5330892624 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 204 len: 0 microversion: 2.1 time: 0.510858 Aug 30 18:48:42.008242 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2746/5609] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:48:41 2022] DELETE /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:48:42.022459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:42.045496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.047157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.048979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.091783 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] Creating event network-changed:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:48:42.110048 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f21c9185-a14e-4c89-a6fa-e450040246ff req-aa577e59-b7a0-4520-92ba-c1ac61cc762c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099810 Aug 30 18:48:42.114742 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2747/5610] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:42.127032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:42.128251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:42.168083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.170193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.170869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.176576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.181089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.185529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.225319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:42.238137 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b124f1b-3605-4852-adad-2b2473ce8c57 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 0.691080 Aug 30 18:48:42.255030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2864/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:41 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:42.268354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:42.272570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:42.297153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.299742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.300477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.302094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.303320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.304363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.667440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:42.682559 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-646b23a6-98f5-48de-b3b7-3d3d45db771d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1688 microversion: 2.1 time: 0.422950 Aug 30 18:48:42.691380 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2865/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:42 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1688 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:42.701970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:42.705017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:42.722994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.723970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.724668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.725618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:42.726881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:42.727560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:42.878565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:42.888290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b98d93de-2857-494c-9a0b-2566f7c475d4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1274 microversion: 2.1 time: 0.197432 Aug 30 18:48:42.888888 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2866/5613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:42 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:43.132664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:43.148118 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ba04cf7-2994-44e9-9f83-232e97c48841 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1295 microversion: 2.1 time: 1.030748 Aug 30 18:48:43.152069 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2748/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:42 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1295 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:43.268138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:43.268681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:43.276645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:43.290093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:43.290894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:43.317649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:43.319748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:43.320216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:43.713967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:43.714908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:43.754119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:43.762736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:43.763583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:43.765690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:43.771361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:43.773182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:44.198242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:44.214668 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ae410d8-27fb-4db5-af2b-764ba0871dd8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1278 microversion: 2.1 time: 0.954019 Aug 30 18:48:44.216918 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2867/5615] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:43 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1278 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:44.232261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:44.233308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:44.253828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:44.255235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:44.256973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:44.259076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:44.259829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:44.262635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:44.603071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:44.604744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:44.614487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68bc9d44-ea46-4f28-8fd9-5738ca58be88 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1688 microversion: 2.1 time: 0.905225 Aug 30 18:48:44.614665 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bb5e1ac-9335-43cb-aae8-7454353e8226 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1274 microversion: 2.1 time: 0.390402 Aug 30 18:48:44.615103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2749/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:43 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1688 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:44.615256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2868/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:44 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1274 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:44.634771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:44.635416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:44.659594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:44.663377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:44.663862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:44.665217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:44.669710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:44.670257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.242122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:45.243880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:45.263285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.265808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.266800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.271710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.273936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.281970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.317790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:45.338648 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31768325-cb17-4618-ad2e-006daa72bf5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.716353 Aug 30 18:48:45.356077 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2750/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:44 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:45.651637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:45.652461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:45.673458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.675042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.675623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.676651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.679190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.683270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.920596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:45.932143 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a71c3b5c-ba78-4f3f-9369-5a87dd4c88af tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.694722 Aug 30 18:48:45.932752 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2869/5619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:45 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:45.943544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:45.948698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:45.957423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.974908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.975666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:45.976443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:45.976915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:45.977339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.122541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:46.136542 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-747e6bd3-7c10-43d6-91d7-6feb54dd669c tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1274 microversion: 2.1 time: 0.196503 Aug 30 18:48:46.141194 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2870/5620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:45 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:46.164832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8e272-6e31-420d-9b63-20330a366f06", "name": "network-vif-deleted", "tag": "d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:46.175862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:46.176668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:46.177254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.193561 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] Creating event network-vif-deleted:d1d8318f-67b3-4c72-88fa-ff6ac1ba55f9 for instance b5c8e272-6e31-420d-9b63-20330a366f06 on n-h2-854119-10 Aug 30 18:48:46.199087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-62efc964-6cd7-4547-bc60-221164114530 req-c7072d2d-9a10-4089-9371-78392828ea24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038447 Aug 30 18:48:46.200576 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2871/5621] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:48:46.369304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:46.371640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:46.386049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:46.386586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:46.387033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.387732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:46.388192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:46.398957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.645131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:46.655450 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2de40f21-71f5-40e1-8c44-08a170957dcd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.291556 Aug 30 18:48:46.670699 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2872/5622] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:46 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:46.955825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:46.956759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:46.973038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:46.973327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:46.976441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:46.977164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.979456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:46.980618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:46.982965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:46.984139 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c44da7b-d795-47e5-ba95-0200fef2941d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 200 len: 1688 microversion: 2.1 time: 1.348134 Aug 30 18:48:46.988064 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2751/5623] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:45 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 1688 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:47.162496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:47.163489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:47.180845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:47.184003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:47.184867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:47.185650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:47.186125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:47.186598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:47.258306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:47.293216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:47.298219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:47.310312 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd570865-97c4-4d61-9fed-4b7c6eb68c52 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.358311 Aug 30 18:48:47.323898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2873/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:46 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:47.647159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:47.663112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c01d10fc-d626-48df-bed2-f006e27c2ca3 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.505437 Aug 30 18:48:47.663807 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2752/5625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:47 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:47.677527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:47.678141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:47.697496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:47.698148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:47.698556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:47.699283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:47.699742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:47.700164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:47.906792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbda8ea-4642-479d-9f14-522a3cbcdc07", "tag": "98f046a7-986f-4d6d-b8b6-8eba506d78ae"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:47.946554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:47.947159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:47.947852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:47.989018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:47.995928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] Creating event network-changed:98f046a7-986f-4d6d-b8b6-8eba506d78ae for instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 on n-h2-854119-10 Aug 30 18:48:48.003316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3cbd840e-f2f7-45ac-bd34-791811886572 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.329624 Aug 30 18:48:48.004319 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2874/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:47 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:48.011284 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e085a973-67b8-402f-9277-96db45004506 req-366d6ad0-e907-479e-86a3-a210499856e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107927 Aug 30 18:48:48.013290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:48.013928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: b5c8e272-6e31-420d-9b63-20330a366f06] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:48.015366 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2753/5627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:48:48.037134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.038319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.039001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.040019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.040842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.041770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.061844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] HTTP exception thrown: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Request method failure captured: Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 HTTP/1.1 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlo7eNdRA01I3W-MRgZkZv3teqriXS0Hi03L2b3Msm7JwKQE_nTf0o0CIFGNoHKhO-f1Qeq5DCjIw2QdxrbgWqsz9K_tWdWzAPtJTz3cfJ2WdlEJ1wYuXnR75h2o08zt8sWrNJOWUulBICPHel7lMev8oF9R_pmo7g9Yw9YtFUA69KU Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bf8da5657e864953b48bf5307f363139"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bf8da5657e864953b48bf5307f363139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 087be4b9803348b5ac503a1576c890c2 Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b5c8e272-6e31-420d-9b63-20330a366f06'} Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:48.063784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. Aug 30 18:48:48.070016 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:48:48.071686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Returning 404 to user: Instance b5c8e272-6e31-420d-9b63-20330a366f06 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:48:48.072790 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93af4901-a547-436d-948d-2ccf35ed2ae5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06" status: 404 len: 111 microversion: 2.1 time: 0.067605 Aug 30 18:48:48.073537 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2875/5628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:48 2022] GET /compute/v2.1/servers/b5c8e272-6e31-420d-9b63-20330a366f06 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:48:48.331874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:48.343575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:48.365278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.365798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.366252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.380597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.381233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.381694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.686001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:48.687401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:48.694396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.695221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.696042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.697123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:48.697815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:48.698926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:48.871662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:48.886990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d474a2c7-6156-42a9-9261-97e64412189f tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.557986 Aug 30 18:48:48.901492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2754/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:48 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:49.028030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:49.028768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:49.041154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:49.042076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:49.046972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:49.051343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:49.061618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:49.063545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-868632b9-2c8d-4fb6-aec8-7252b91cda7b tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.383390 Aug 30 18:48:49.064899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:49.066915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:49.069121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2876/5630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:48 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:49.339998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:49.366384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c729ee7-a308-47c2-9993-27c1773ba599 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.341144 Aug 30 18:48:49.367233 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2755/5631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:49 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:49.910551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:49.911254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:49.931628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:49.932690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:49.935545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:49.939262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:49.939717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:49.940465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:49.945052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:49.948030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.093889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:50.094568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:50.107816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:50.113392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:50.116737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:50.118691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.120505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:50.123854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:50.124616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.377076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:50.386903 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfff76a9-3bbf-4bf9-b8b1-efa5b68b1999 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.481442 Aug 30 18:48:50.394103 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2877/5632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:49 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:50.410670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3860d108-a78b-4807-91e9-ec46bc5f45f3", "tag": "3b406103-7b69-418f-96de-7a9a4b7bc036"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:50.431132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:50.431606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:50.432227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.467577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] Creating event network-changed:3b406103-7b69-418f-96de-7a9a4b7bc036 for instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 on n-h1-854119-10 Aug 30 18:48:50.480318 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3702c3ce-1e18-4d6d-8bcb-57ca257135d6 req-ae2888cf-ad26-44bb-9257-1a150629954e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084742 Aug 30 18:48:50.481351 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2878/5633] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:50.486902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:50.487599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:50.508130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:50.511976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:50.512642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.513587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:50.514236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:50.515678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:50.811820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:50.821700 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-040f8878-a25d-447f-9e45-7394399bd85e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.733333 Aug 30 18:48:50.831987 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2756/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:50 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:50.855331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:50.872585 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c3fe19b-66c3-4be6-bf86-72778d51dbac tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.390030 Aug 30 18:48:50.873504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2879/5635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:50 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:51.418750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:51.419369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:51.439702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.445156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.459674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:51.460523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.461022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.461492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:51.771818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:51.784322 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1de8fc79-034a-4913-8f1b-608abfa84373 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.371673 Aug 30 18:48:51.786977 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2757/5636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:51 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:51.848875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:51.850222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:51.858689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.859562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.860251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:51.861209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.861914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.862625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:51.896281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:51.897217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:51.909989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.911026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.912523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:51.914064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:51.916394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:51.918965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:52.235005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:52.247844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b85ce329-51a4-46e4-9037-404bf8ba8e50 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.402318 Aug 30 18:48:52.249176 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2880/5637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:51 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:52.516877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:52.527909 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f69cc7f0-6474-4cbb-8463-387e16649482 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.636279 Aug 30 18:48:52.534486 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2758/5638] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:51 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:52.808709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:52.809622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:52.824302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:52.827929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:52.830049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:52.831006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:52.834114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:52.836569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:53.135505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:53.152557 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-033ccaa7-a2c0-4338-be6e-96c6871769d6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.348004 Aug 30 18:48:53.153937 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2881/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:52 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:53.269939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:53.270841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:53.284460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:53.284974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:53.285428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:53.286927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:53.287407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:53.287844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:53.305324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:48:53.560428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:53.561080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:53.574915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:53.575511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:53.576022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:53.580824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:53.581729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:53.582425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:53.841379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:53.857398 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f47eed37-7ecb-40d7-8f79-9d37f85e3daf tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.589835 Aug 30 18:48:53.860024 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2759/5640] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:53 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:54.175275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:54.176505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:54.193456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:54.194701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:54.195462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:54.201338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:54.202238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:54.202976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:54.565723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:54.576637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57388944-9dcb-4c1e-9f7b-bd43fc96f54f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 1.020523 Aug 30 18:48:54.581773 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2882/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:53 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:54.673331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:54.682384 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-570c9a6f-d97a-4977-b798-710f1ca80de4 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.512978 Aug 30 18:48:54.682967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2760/5642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:54 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:54.887235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:54.887854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:54.896664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:54.897162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:54.897602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:54.898312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:54.898798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:54.899224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:55.533708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-430a31fa-1488-4503-892b-7bf7cc5ea510 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '.version_select at 0x7f4e56a3e310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:55.584727 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-430a31fa-1488-4503-892b-7bf7cc5ea510 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-731009202" status: 202 len: 0 microversion: 2.1 time: 0.054745 Aug 30 18:48:55.591325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2761/5643] 10.222.0.25 () {58 vars in 1281 bytes} [Tue Aug 30 18:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-731009202 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:48:55.601504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:55.603519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:55.633694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:55.641642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:55.642467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:55.643438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:55.644093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:55.646997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:55.911631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:55.924310 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50612f2b-538b-4c95-a987-c4b89d7cd51f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.325183 Aug 30 18:48:55.927655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2762/5644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:55 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:55.943244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-315aec5c-999e-4a31-80aa-4e3e0175f875 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: .version_select at 0x7f4e566d6d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1369174717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAygXMW3kgID5ubiB3InZRcutRngpAgJQFkowupZVnuhLskPr3JUYw9TjZqchUqtWk+Q9f09tmfA65pDaVzzHuzAXVcP6k0WMQviQ49q3LAd4EPqvvGJCEvQMPBpX0ff0w=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:55.953422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:55.974847 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fabea93c-4a3d-40be-a27d-b55372c02029 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 1.091240 Aug 30 18:48:55.976617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2883/5645] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:54 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:55.996079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:55.997009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:55.997177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-315aec5c-999e-4a31-80aa-4e3e0175f875 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:48:56.006153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:56.007070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:56.007690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:56.009959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-315aec5c-999e-4a31-80aa-4e3e0175f875 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:48:56.010201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:56.011413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:56.012046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:56.070744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-315aec5c-999e-4a31-80aa-4e3e0175f875 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.141640 Aug 30 18:48:56.073068 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2763/5646] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:48:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:56.087336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbda8ea-4642-479d-9f14-522a3cbcdc07", "name": "network-vif-plugged", "status": "completed", "tag": "98f046a7-986f-4d6d-b8b6-8eba506d78ae"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:56.104197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:56.107731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:56.110798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:56.135127 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] Creating event network-vif-plugged:98f046a7-986f-4d6d-b8b6-8eba506d78ae for instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 on n-h2-854119-10 Aug 30 18:48:56.142283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-aa10f083-4528-447d-8063-a9c86fc26594 req-61d4b6c7-b98d-41c5-903c-e550547f9f2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067071 Aug 30 18:48:56.143010 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2764/5647] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:56.273786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:56.282982 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5ccfd733-6f60-4106-a605-cccd53c1bd15 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.295138 Aug 30 18:48:56.297116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2884/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:55 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:56.948131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:56.949523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:56.986650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:56.988185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:56.989383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:56.991821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:56.992895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:56.994768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:57.000046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:57.001501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:57.022588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:57.024990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:57.025477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:57.026232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:57.026711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:57.032579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:57.261936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:57.275573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eff95194-b9bb-4a45-9eab-951853b5fba8 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1362 microversion: 2.1 time: 0.331553 Aug 30 18:48:57.276184 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2765/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:56 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:57.306691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:57.307732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:57.319557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:57.323777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:57.326933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:57.327635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:57.328592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:57.330308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4849b208-ce51-4ca7-b0f6-2d3145068e12 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.334697 Aug 30 18:48:57.330618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:57.331282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:57.334510 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2885/5650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:56 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:57.679395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:57.695441 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f97e487-9f41-4511-82cb-d71488c65baf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.393753 Aug 30 18:48:57.696225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2766/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:57 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:58.160830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f695b42-5e5d-4e45-a3c6-d270d607b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "74e409c3-1d7b-41b2-baf9-1ffcebc833ea"}, {"server_uuid": "3860d108-a78b-4807-91e9-ec46bc5f45f3", "name": "network-vif-plugged", "status": "completed", "tag": "3b406103-7b69-418f-96de-7a9a4b7bc036"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:48:58.177236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.177735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.178172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.218863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Creating event network-vif-plugged:74e409c3-1d7b-41b2-baf9-1ffcebc833ea for instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 on n-h1-854119-10 Aug 30 18:48:58.219273 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] Creating event network-vif-plugged:3b406103-7b69-418f-96de-7a9a4b7bc036 for instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 on n-h1-854119-10 Aug 30 18:48:58.227354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d9b978db-4b73-41ef-8b2b-b849e92c88f5 req-7d171a85-f654-419a-ad33-69f5da347a2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070131 Aug 30 18:48:58.228151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2886/5652] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:58.298671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:58.299911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:58.309353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.309889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.310448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.311208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.311684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.312133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.360865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:58.361582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:58.380352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.382978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.384163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.385529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.387290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.389140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.586035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:58.597416 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7777b576-3664-42e4-a21e-193abfd0e916 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.247231 Aug 30 18:48:58.602764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2887/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:58 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:58.719754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:58.720704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:58.732349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.733172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.734782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.737852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:58.739189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:58.741563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:58.995831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:59.006158 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e688da99-d322-44a5-b723-896d8afb6133 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.290140 Aug 30 18:48:59.007510 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2888/5654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:58 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:48:59.143168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:48:59.155764 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a0b9002-01ad-4cd6-b422-66602551e6b6 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1548 microversion: 2.1 time: 0.860828 Aug 30 18:48:59.157867 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2767/5655] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:58 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1548 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:48:59.181747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:59.182378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:59.196013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:59.196526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:59.196977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:59.197718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:59.198178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:59.202668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:59.343860 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5153a909-75a2-421a-a629-243a540b939b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166644 Aug 30 18:48:59.345019 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2889/5656] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:48:59 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:48:59.623003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:48:59.623607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:48:59.642087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:59.642620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:59.643079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:48:59.643857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:48:59.644332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:48:59.644770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:00.033580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:00.035851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:00.062451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:00.065800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:00.069943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:00.089340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:00.094565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:00.095548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:00.112698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:00.125664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-054b64a5-3cef-48ec-8fe0-4280acdae247 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1316 microversion: 2.1 time: 0.506351 Aug 30 18:49:00.126989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2768/5657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:48:59 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:00.454698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:00.463276 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-868ae8dd-a05e-492b-9de4-13cba1496885 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1266 microversion: 2.1 time: 0.435166 Aug 30 18:49:00.466928 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2890/5658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:00 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:01.077199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbda8ea-4642-479d-9f14-522a3cbcdc07", "tag": "98f046a7-986f-4d6d-b8b6-8eba506d78ae"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:01.086818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:01.089597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.090085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.090565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.106289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] Creating event network-changed:98f046a7-986f-4d6d-b8b6-8eba506d78ae for instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 on n-h2-854119-10 Aug 30 18:49:01.112968 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fefc8ba7-d9ef-40fa-b95f-1028ba33ec66 req-2b2b346f-b9c9-4b79-95fe-63bdc740d47e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040683 Aug 30 18:49:01.118313 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2769/5659] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:01.146910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:01.147624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:01.159980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.160627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.163147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.164382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.166487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.167125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.445406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:01.467385 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c622db34-f01c-4f4f-886f-5fcfb580ab28 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1504 microversion: 2.1 time: 0.324633 Aug 30 18:49:01.469307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2891/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:01 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:01.487097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:01.487842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:01.493299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:01.494137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:01.502886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.503396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.503841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.504784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.508144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.512022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.513680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.515162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.517531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.517867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.518422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.518959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.602639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:01.618960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:01.625102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b0258a4-c091-45db-8fd6-9e328b63c52a tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/os-instance-actions/req-f4aea3db-edc2-4a73-8ec7-d3537936f53d" status: 200 len: 313 microversion: 2.1 time: 0.136900 Aug 30 18:49:01.627048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2892/5661] 10.222.0.25 () {58 vars in 1419 bytes} [Tue Aug 30 18:49:01 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/os-instance-actions/req-f4aea3db-edc2-4a73-8ec7-d3537936f53d => generated 313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:01.639973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:01.642950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:01.661171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.662196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.662887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.663884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.664842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.665471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.825622 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b761451-cab7-4c49-823b-ca4ca6027b78 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "POST /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/action" status: 202 len: 0 microversion: 2.1 time: 0.189998 Aug 30 18:49:01.834664 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2893/5662] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:49:01 2022] POST /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:49:01.840380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:01.845202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:01.874019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.877613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.878872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:01.879899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:01.896921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:01.898787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:02.416790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:02.433437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60023a42-985b-4088-baae-6424a2945c8e tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1506 microversion: 2.1 time: 0.597088 Aug 30 18:49:02.443726 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2894/5663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:01 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:02.560462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:02.585877 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff863db9-f9d1-44ae-ad91-9ab3f15c53d5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1452 microversion: 2.1 time: 1.103830 Aug 30 18:49:02.589144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2770/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:01 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1452 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:02.611440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:02.612074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:02.633282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:02.634154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:02.634948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:02.635904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:02.638823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:02.641205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:03.090940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:03.124551 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-414d3dd6-887b-4b46-a701-e15f511b5043 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1452 microversion: 2.1 time: 0.517262 Aug 30 18:49:03.128603 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2895/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:02 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1452 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:03.461593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:03.462214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:03.478307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:03.480000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:03.480609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:03.481396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:03.488448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:03.488947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:04.526177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:04.537270 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-daee2f5e-df20-443d-91f8-eb4eb4ee493f tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1506 microversion: 2.1 time: 1.080280 Aug 30 18:49:04.542693 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2771/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:03 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1506 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:05.560617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:05.562218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:05.575285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:05.579726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:05.582719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:05.585752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:05.587048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:05.590250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:05.591882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:06.686640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:06.695198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-700b334c-3095-4804-b299-249b9cf97622 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1504 microversion: 2.1 time: 1.140010 Aug 30 18:49:06.699350 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2896/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:05 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1504 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:06.738164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '.version_select at 0x7f4e57332310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:06.741726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:06.762780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:06.786238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:06.788911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:06.789471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:06.799084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:06.799863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:06.806902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:06.930027 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f00a5d03-a9c0-4668-9c0e-5126589a1f29 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.212238 Aug 30 18:49:06.942952 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2772/5668] 10.222.0.25 () {58 vars in 1296 bytes} [Tue Aug 30 18:49:06 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3/os-instance-actions => generated 611 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:06.961148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:06.962085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:06.978680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:06.979839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:06.980445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:06.981379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:06.984263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:06.985369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:07.067859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:49:07.430926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bf16f7b-7d1f-4294-8aad-18c95df702ff tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 204 len: 0 microversion: 2.1 time: 0.470712 Aug 30 18:49:07.432321 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2897/5669] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:49:06 2022] DELETE /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:49:07.440647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:07.441732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:07.461123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:07.462010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:07.462460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:07.463215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:07.463655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:07.464781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:07.808366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:07.830017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65a7d359-1865-4f65-b298-0ce9be0a9d22 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1510 microversion: 2.1 time: 0.393240 Aug 30 18:49:07.833099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2773/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:07 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:08.126982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f695b42-5e5d-4e45-a3c6-d270d607b8f6", "tag": "74e409c3-1d7b-41b2-baf9-1ffcebc833ea"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:08.148533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:08.151068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:08.151651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:08.176197 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] Creating event network-changed:74e409c3-1d7b-41b2-baf9-1ffcebc833ea for instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 on n-h1-854119-10 Aug 30 18:49:08.194290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d80d337c-a310-4acd-bd3d-aeafbda50010 req-f9eb464a-2659-45f3-8465-69c71e7f2713 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391027 Aug 30 18:49:08.196068 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2898/5671] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:08.854420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:08.855150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:08.876760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1829987321", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5f9ad738-c57a-45b7-bdea-c33a1a270653"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:08.890848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:08.892612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:08.896630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:08.901532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:08.902109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:08.902837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:09.062264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] validate_networks() for [('5f9ad738-c57a-45b7-bdea-c33a1a270653', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:49:10.073476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:10.084068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71872a13-c78a-4f8d-a2a0-5d7d1832e878 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1510 microversion: 2.1 time: 1.234226 Aug 30 18:49:10.087123 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2774/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:08 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1510 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:10.094117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:49:10.094809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:49:10.096228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:49:10.098522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:49:10.099495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:49:10.118502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:10.119536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:10.120526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:10.121915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:10.122795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:10.123810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:10.160600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Getting quotas for project ffbb659f36e04de8ad08a44734f149ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:49:10.176636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Getting quotas for user 45b6df0080f64969b75f52895215b15c and project ffbb659f36e04de8ad08a44734f149ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:49:10.216100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:49:10.224450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:10.398122 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e916a45-bb21-4172-a904-9a95d60e8a6c tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527210 Aug 30 18:49:10.398897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2899/5673] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:49:10.410907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd14de26-f461-47fc-8a99-be9a55e0a9d7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:10.411698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd14de26-f461-47fc-8a99-be9a55e0a9d7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:11.108719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:11.109897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:11.127798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:11.128530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:11.129694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:11.132417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:11.133381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:11.134220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:11.418149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd14de26-f461-47fc-8a99-be9a55e0a9d7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:11.430303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd14de26-f461-47fc-8a99-be9a55e0a9d7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1219 microversion: 2.1 time: 1.024072 Aug 30 18:49:11.431936 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2775/5674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:10 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1219 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:11.452102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:11.466222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ffcd1678-979b-4c72-b37a-bf22c6b1af16 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1510 microversion: 2.1 time: 0.360960 Aug 30 18:49:11.470600 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2900/5675] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:11 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:12.458963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:12.462391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:12.498543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:12.500780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:12.514950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:12.516678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:12.518593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:12.523597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:12.524753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:12.525223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:12.528663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:12.533724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:12.536966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:12.541161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:12.542803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:12.544688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:12.857176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:12.869390 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2a2a1085-c734-43da-bdbb-fbe94e5b2f87 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1468 microversion: 2.1 time: 0.377094 Aug 30 18:49:12.883544 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2901/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:12 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:13.260277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:13.270177 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-084b8e74-15e6-4a6d-8f79-eacd2267bfcd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1279 microversion: 2.1 time: 0.818471 Aug 30 18:49:13.277954 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2776/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:12 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1279 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:13.306983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3860d108-a78b-4807-91e9-ec46bc5f45f3", "name": "network-vif-deleted", "tag": "3b406103-7b69-418f-96de-7a9a4b7bc036"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:13.378683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:13.382925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:13.384003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:13.430457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] Creating event network-vif-deleted:3b406103-7b69-418f-96de-7a9a4b7bc036 for instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 on n-h1-854119-10 Aug 30 18:49:13.453470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-20e9ace7-a659-4a89-91bd-cf6b35daf21c req-da40f379-6ba7-487f-b5f9-b908f17a16f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152444 Aug 30 18:49:13.456651 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2902/5678] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:13.894223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:13.896276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:13.932463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:13.933317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:13.938755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:13.940436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:13.942221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:13.944711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:14.013985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:14.014655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:14.015191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:14.016253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lazy-loading 'fault' on Instance uuid 3860d108-a78b-4807-91e9-ec46bc5f45f3 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:49:14.097370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee3b9fee027b4d6ab0b533afd8ef5364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0606559258564ba8a78ecc37582d3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:14.115014 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a3fbb07-4904-4457-a2fe-a4252aa30276 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 200 len: 1306 microversion: 2.1 time: 0.225218 Aug 30 18:49:14.126711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2777/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:13 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:14.302892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:14.304192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:14.311976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:14.312763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:14.313387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:14.314950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:14.315746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:14.316464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:14.515897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1873980821", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "17b6e49d-2d39-47f3-a09d-0b909620c1dc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1369174717", "security_groups": [{"name": "tempest-secgroup-smoke-1443741994"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:14.543259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:14.553102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19c7213e-cb4a-4161-af3b-642375cefbf4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1277 microversion: 2.1 time: 0.255567 Aug 30 18:49:14.567410 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2903/5680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:14 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:14.833034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] validate_networks() for [('17b6e49d-2d39-47f3-a09d-0b909620c1dc', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:49:15.136623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:15.136976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] [instance: 3860d108-a78b-4807-91e9-ec46bc5f45f3] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:15.149114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.149773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.153835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.154824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.155309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.155745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.187651 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] HTTP exception thrown: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Request method failure captured: Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 HTTP/1.1 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDluFnsSVP1fuvcyIomkQpZoYJjYsiYkyj6uzXknwzU4lAuN6lmjOGUygSfSzyB_EJqlQB9lghh0aEAq7DT2Yp9bYLs-957CZSALhZQvmx5HlQhH4bmKHBNIFGD02DgnLdPBJDwwTI7axrGyePudN-C7LtazAZtNHE7hRsSbeq74B5IY Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 0606559258564ba8a78ecc37582d3e21 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-InstanceActionsTestJSON-1021991539 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0606559258564ba8a78ecc37582d3e21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0606559258564ba8a78ecc37582d3e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0606559258564ba8a78ecc37582d3e21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0606559258564ba8a78ecc37582d3e21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-InstanceActionsTestJSON-1021991539 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 0606559258564ba8a78ecc37582d3e21 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1021991539 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-InstanceActionsTestJSON-1021991539-project Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ee3b9fee027b4d6ab0b533afd8ef5364 Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-InstanceActionsTestJSON-1021991539-project Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '3860d108-a78b-4807-91e9-ec46bc5f45f3'} Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:49:15.191882 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. Aug 30 18:49:15.198013 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:49:15.201886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] Returning 404 to user: Instance 3860d108-a78b-4807-91e9-ec46bc5f45f3 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:49:15.204927 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b5ac052f-eeb9-43ac-96f4-b9c964f667c4 tempest-InstanceActionsTestJSON-1021991539 tempest-InstanceActionsTestJSON-1021991539-project] 10.222.0.25 "GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3" status: 404 len: 111 microversion: 2.1 time: 0.072547 Aug 30 18:49:15.205908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2904/5681] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:15 2022] GET /compute/v2.1/servers/3860d108-a78b-4807-91e9-ec46bc5f45f3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:49:15.577487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:15.578254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:15.589346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.589843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.590283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.591033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.591490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.597466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.782497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:49:15.783990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:49:15.784491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:49:15.784923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:49:15.785455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:49:15.804635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.805512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.806165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.807132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:15.807771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:15.808406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:15.856837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:49:15.869086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:49:15.896627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:49:15.899764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:16.029286 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6581223-6599-4a09-a50d-e0269535c0df tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.517456 Aug 30 18:49:16.042900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2778/5682] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:49:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:49:16.056510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4a2d321-414b-4710-9ece-03e1b0f5cd89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:16.057152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4a2d321-414b-4710-9ece-03e1b0f5cd89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:16.131796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:16.149118 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c0d0de6-1b78-4870-8c8f-dac8e8e08d48 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.576653 Aug 30 18:49:16.172179 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2905/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:15 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:16.267203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c4a2d321-414b-4710-9ece-03e1b0f5cd89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:16.278333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4a2d321-414b-4710-9ece-03e1b0f5cd89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1267 microversion: 2.1 time: 0.234089 Aug 30 18:49:16.287752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2779/5684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:16 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:16.712750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17713ada-c352-4b32-9a82-9a7b628b6a31", "tag": "176551a3-f33c-45b9-be45-99e380266cd7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:16.750642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:16.751326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:16.753343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:16.786601 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] Creating event network-changed:176551a3-f33c-45b9-be45-99e380266cd7 for instance 17713ada-c352-4b32-9a82-9a7b628b6a31 on n-h2-854119-10 Aug 30 18:49:16.856344 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6a6b23ac-c6b1-48dc-a517-032d58632b28 req-d2d2b996-b827-48e0-b6a1-8437a9e94264 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148264 Aug 30 18:49:16.856970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2906/5685] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:17.180382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:17.181083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:17.193046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:17.195459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:17.196928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:17.199143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:17.201570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:17.206065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:17.313283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:17.314604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:17.335365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:17.337897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:17.342890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:17.345991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:17.347072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:17.350373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:17.598225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:17.620877 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b509253e-6019-4922-9bac-76ec0715ab16 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1319 microversion: 2.1 time: 0.312415 Aug 30 18:49:17.623146 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2907/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:17 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:17.683649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:17.697855 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a2828bd5-ff41-4892-a6bf-9417c12b7d1d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.521815 Aug 30 18:49:17.702951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2780/5687] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:17 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:18.645809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:18.646479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:18.659982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:18.660939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:18.664800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:18.665588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:18.666083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:18.671116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:18.732734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:18.733740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:18.764982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:18.765939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:18.769255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:18.771293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:18.774545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:18.775405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:18.835655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:19.119954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:19.129681 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4131922a-57a5-4a89-82c4-309f7e95951a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1325 microversion: 2.1 time: 0.489550 Aug 30 18:49:19.139217 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2908/5688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:18 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:20.155656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:20.156280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:20.160744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:20.168341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:20.168852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:20.177609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:20.178713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:20.179142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:20.179951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:20.201512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:20.720697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:20.740585 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32b3f470-2f76-4dad-82d7-4dfffe118a7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.588693 Aug 30 18:49:20.762631 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2909/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:20 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:20.850396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:20.888873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84629298-491d-4990-8f9e-6aa0f4c62bab tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 2.163386 Aug 30 18:49:20.891071 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2781/5690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:18 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:21.770838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:21.771569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:21.782065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:21.782872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:21.783550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:21.784755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:21.786137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:21.787565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:21.792658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:21.918594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:21.919405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:21.933205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:21.935079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:21.936604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:21.936604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:21.938665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:21.939240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:22.037443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:22.050121 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df87531c-af1a-465e-9174-9b92c6752ac9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.283974 Aug 30 18:49:22.054116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2910/5691] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:21 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:22.354564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:22.365818 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-29e9f4a0-0d50-42d9-aa0b-2060ad8a5e17 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.452835 Aug 30 18:49:22.368189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2782/5692] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:21 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:22.475070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:22.509866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:22.510989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:22.511768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:22.530600 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] Creating event network-changed:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h1-854119-10 Aug 30 18:49:22.536949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-228ef74b-e4a2-4ad9-beef-ff1719ba12b2 req-4495caf9-8319-4df9-86d6-1e3c4b7f7a04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065768 Aug 30 18:49:22.539042 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2911/5693] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:23.074885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:23.076151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:23.085592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:23.086497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:23.087278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:23.088452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:23.089151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:23.089950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:23.322929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:23.333752 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff98b054-fce0-48d8-bf90-b4ca706a7562 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.262208 Aug 30 18:49:23.335014 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2783/5694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:23 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:23.390503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:23.392326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:23.400938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:23.401972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:23.402646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:23.403545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:23.404536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:23.405139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:23.574763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:23.583320 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2a34801-5163-4571-968e-4c483211a2be tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.199841 Aug 30 18:49:23.599050 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2912/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:23 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:24.281869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17713ada-c352-4b32-9a82-9a7b628b6a31", "name": "network-vif-plugged", "status": "completed", "tag": "176551a3-f33c-45b9-be45-99e380266cd7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:24.320460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:24.323241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:24.323897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:24.357772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:24.358915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:24.366456 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] Creating event network-vif-plugged:176551a3-f33c-45b9-be45-99e380266cd7 for instance 17713ada-c352-4b32-9a82-9a7b628b6a31 on n-h2-854119-10 Aug 30 18:49:24.375218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:24.375733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:24.376182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:24.376910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:24.377369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:24.383673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:24.384688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0e37c482-a205-4330-ad8c-79c02869c883 req-0adc317d-7148-4dd4-bfb9-ab53ac7e3709 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104654 Aug 30 18:49:24.389973 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2784/5696] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:24.613850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:24.615725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:24.631130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:24.631792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:24.632341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:24.633544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:24.635076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:24.635736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:24.803202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:24.811721 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-821f7a8f-c7c1-46cc-a0b8-ff413d86f99b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.458184 Aug 30 18:49:24.812664 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2913/5697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:24 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:24.969740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:24.984746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d2ec3a7e-94a9-4c73-80b2-af467ed8e89e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.375412 Aug 30 18:49:24.999329 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2785/5698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:24 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:25.834161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:25.835696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:25.845549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:25.846331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:25.847032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:25.849311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:25.850421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:25.851304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:26.008410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:26.010764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:26.016806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:26.036940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:26.039211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:26.040427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:26.042827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:26.044667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:26.045897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:26.272335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:26.414447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:26.452484 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edb53a66-7b0e-4163-8875-cc676fd18e53 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1319 microversion: 2.1 time: 0.450267 Aug 30 18:49:26.478868 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2786/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:26 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:26.761181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:26.794176 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b97b36de-c822-4174-af87-c21d620e8145 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.955537 Aug 30 18:49:26.799520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2914/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:25 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:27.487258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:27.488582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:27.509699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:27.510633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:27.511277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:27.512496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:27.513167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:27.513806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:27.823640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:27.824322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:27.832746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:27.834100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:27.835369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:27.837977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:27.838679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:27.839282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:28.093244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:28.106395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-205972d3-d33b-418e-9c4d-b4a48bbe73fd tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1509 microversion: 2.1 time: 0.619569 Aug 30 18:49:28.107481 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2787/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:27 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:28.186866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:28.201129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0dcc73f0-5361-4c7a-aaa9-5067b2f01adf tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.381598 Aug 30 18:49:28.217030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2915/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:27 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:29.230862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:29.231686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:29.252582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:29.253456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:29.257564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:29.259259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:29.259949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:29.262002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:29.660088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:29.669727 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a47ad8be-ae5b-461c-8c05-0a07f32655c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.444353 Aug 30 18:49:29.685738 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2788/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:29 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:30.694152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:30.695042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:30.703668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:30.704166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:30.705528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:30.706556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:30.707338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:30.707831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:31.566161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "name": "network-vif-plugged", "status": "completed", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:31.589009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:31.591709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:31.595066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:31.595771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:31.646338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] Creating event network-vif-plugged:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h1-854119-10 Aug 30 18:49:31.677986 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-52a9d8dd-6f90-4de1-bae0-f22ff655835d req-9b9b376a-c15f-4237-ac7a-c21e1637112c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115800 Aug 30 18:49:31.690856 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2789/5704] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:31.746181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:31.787587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-beb157da-d8f9-490e-b7cf-91260af8c1f7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 1.098166 Aug 30 18:49:31.791958 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2916/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:30 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:32.814433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:32.821221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:32.851533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:32.855632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:32.858222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:32.861669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:32.864111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:32.866537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:33.317658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:33.327136 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d9ea31c1-85c6-43a1-93b2-0de107a41e38 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1393 microversion: 2.1 time: 0.517403 Aug 30 18:49:33.327742 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2790/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:32 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1393 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:33.844298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-286308650", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d8ccc1ca-bd6e-4f4b-9c9f-3295224576ea"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:33.973526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] validate_networks() for [('d8ccc1ca-bd6e-4f4b-9c9f-3295224576ea', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:49:34.355910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:34.356641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:34.371501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.372018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.376368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:34.377206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.377762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.378124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:34.627657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:34.647116 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bac19013-e960-41e6-822d-2d22c834cfa9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1564 microversion: 2.1 time: 0.295547 Aug 30 18:49:34.647929 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2791/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:34 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1564 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:34.672111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:34.672748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:34.711551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.712344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.712809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:34.713630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.714144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.715933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:34.899813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:49:34.900322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:49:34.900768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:49:34.901232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:49:34.901648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:49:34.957930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.959991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.960567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:34.961799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:34.962598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:34.963180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:35.021066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Getting quotas for project abf6c1e7a5f34776a5bdf6b3833c971c. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:49:35.057061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Getting quotas for user 338a586c79a94b94a8534fc9f4c653de and project abf6c1e7a5f34776a5bdf6b3833c971c. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:49:35.098139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:35.104326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Going to run 2 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:49:35.125571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 992656ce-9569-4b9d-a910-cff64037c7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:35.125780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68ed5dd5-a951-4324-9c34-8516e9f29e79 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1564 microversion: 2.1 time: 0.440600 Aug 30 18:49:35.125780 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2792/5708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:34 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1564 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:35.175009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=992656ce-9569-4b9d-a910-cff64037c7e2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:35.293483 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27ec562a-12bb-4ac6-b37d-cd14a9f93de6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824625 Aug 30 18:49:35.301177 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2917/5709] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:49:35.307000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:35.317683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:35.321135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Searching by: {'deleted': False, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:49:35.367800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:35.372420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:35.372917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:35.375970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:35.380162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:35.380644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:35.468374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-631fbbdd-82dc-430c-81c1-5e8a80134dc5 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.164390 Aug 30 18:49:35.483025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-daafa89f-1557-4bff-868f-06716473ef1e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:35.484039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-daafa89f-1557-4bff-868f-06716473ef1e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:35.488716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2793/5710] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:49:35 2022] GET /compute/v2.1/servers => generated 675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:35.609659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-daafa89f-1557-4bff-868f-06716473ef1e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:35.619170 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-daafa89f-1557-4bff-868f-06716473ef1e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1219 microversion: 2.1 time: 0.141222 Aug 30 18:49:35.638795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2918/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:35 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:36.142425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:36.142954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:36.159698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:36.160243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:36.160724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:36.168181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:36.169704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:36.172022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:36.297745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1471d9a-641f-4191-a2f4-7b9e10ed1746 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/ips" status: 200 len: 145 microversion: 2.1 time: 0.162295 Aug 30 18:49:36.311962 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2794/5712] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:49:36 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/ips => generated 145 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:36.651382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c52ef218-2eb8-47f5-b9fa-db12a5646ced tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:36.652334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c52ef218-2eb8-47f5-b9fa-db12a5646ced tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:36.702394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:36.857133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c52ef218-2eb8-47f5-b9fa-db12a5646ced tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:36.868079 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c52ef218-2eb8-47f5-b9fa-db12a5646ced tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1219 microversion: 2.1 time: 0.225145 Aug 30 18:49:36.879151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2919/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:36 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1219 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:37.890963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:37.891608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:37.903411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:37.909349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:37.910243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:37.913143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:37.916055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:37.917039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:39.099140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:39.125817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-01b20817-cd96-42f9-99ee-3d975677edf4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1271 microversion: 2.1 time: 1.238525 Aug 30 18:49:39.127342 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2795/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:37 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1271 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:39.917267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "985f3f17-a0fd-4cac-a8d3-f3fd29e8b829"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:39.922668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:39.945681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:39.948202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:39.948861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:39.951708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:39.952358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:39.952958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.153268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:40.154781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:40.198388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:40.200359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:40.201575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.205410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:40.208974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:40.211860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.553437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-01eb3e6a-6776-4984-bbc9-48772a1bff36 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.638862 Aug 30 18:49:40.556331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2920/5715] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:49:39 2022] POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:40.682070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:40.692380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4c889ea-b157-44c9-a572-fad19336de2c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1277 microversion: 2.1 time: 0.547474 Aug 30 18:49:40.696999 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2796/5716] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:40 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1277 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:40.764223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:40.764936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:40.777128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:40.779693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:40.781619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:40.782227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.784832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:40.787024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:40.787932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.809127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:40.809870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:40.810812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:40.830848 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] Creating event network-changed:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h1-854119-10 Aug 30 18:49:40.840243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d897ab27-a930-470b-84ee-480396cf6fa8 req-4e87e29f-95e3-45b1-aab5-3e7d87c49d2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067325 Aug 30 18:49:40.842057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2797/5717] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:41.273059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:41.283527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-504e1bbf-c67a-4161-bacd-c629ae4e0f1c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1564 microversion: 2.1 time: 0.524130 Aug 30 18:49:41.284149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2921/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:40 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1564 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:41.723842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:41.725517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:41.733811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:41.734802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:41.735508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:41.736492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:41.737118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:41.737812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:42.040614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:42.060087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a78d078-f408-4045-a413-8d3397b6016d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1277 microversion: 2.1 time: 0.341535 Aug 30 18:49:42.062651 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2798/5719] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:41 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1277 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:43.084862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:43.088099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:43.158867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:43.159370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:43.159819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:43.161890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:43.162376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:43.162813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:43.435162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:43.463641 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fbdb9604-1f32-49d9-99de-5fbed8789b34 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.384431 Aug 30 18:49:43.471624 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2922/5720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:43 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:44.272458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992656ce-9569-4b9d-a910-cff64037c7e2", "tag": "14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:44.311521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:44.312789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:44.314181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:44.347640 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] Creating event network-changed:14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17 for instance 992656ce-9569-4b9d-a910-cff64037c7e2 on n-h2-854119-10 Aug 30 18:49:44.369067 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-82cc4822-5be8-4a47-9328-64a3cb835d31 req-20462319-e2f5-4f75-ba4b-806ee8cb765a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099710 Aug 30 18:49:44.373910 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2799/5721] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:44.492875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:44.493500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:44.513231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:44.515433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:44.516887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:44.517827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:44.519270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:44.519994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:44.771562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:44.782673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80a2700b-4d35-4f06-8be7-4030a10f585a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.294592 Aug 30 18:49:44.783835 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2923/5722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:44 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:45.803669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:45.811454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:45.812584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:45.827858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:45.828377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:45.828834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:45.829603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:45.835265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:45.835748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:46.442588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a3c13c-f730-4cb7-8c6a-5779bcdc0e49", "tag": "a5133291-762e-4494-a94f-9db1b4dd92b8"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:46.451591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:46.472134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:46.472683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:46.473114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:46.506773 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] Creating event network-changed:a5133291-762e-4494-a94f-9db1b4dd92b8 for instance 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 on n-h1-854119-10 Aug 30 18:49:46.514279 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b7a3035-a127-4465-8b1d-d429fc24c061 req-a048b407-80e5-4078-9423-cf68a6674c5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075170 Aug 30 18:49:46.516149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2924/5723] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:46.677913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:46.692624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a60b930a-c2be-4c79-9209-77c7a38471a1 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.890668 Aug 30 18:49:46.708518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2800/5724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:45 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:47.724078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:47.729838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:47.737666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:47.762327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:47.763099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:47.765164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:47.769413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:47.771280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:47.774094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:48.214224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:48.225994 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ca89382-6201-4817-b92e-961664e3aad4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.511543 Aug 30 18:49:48.227619 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2925/5725] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:47 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:49.256079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:49.257326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:49.267239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:49.268112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:49.268613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:49.269610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:49.270145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:49.270855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:49.273978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:49.489579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:49.500624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbfd2350-1097-4853-842e-003c569f52b6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.250838 Aug 30 18:49:49.510310 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2801/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:49 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:50.152422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992656ce-9569-4b9d-a910-cff64037c7e2", "name": "network-vif-plugged", "status": "completed", "tag": "14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:50.170380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:50.170922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:50.171373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:50.190842 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] Creating event network-vif-plugged:14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17 for instance 992656ce-9569-4b9d-a910-cff64037c7e2 on n-h2-854119-10 Aug 30 18:49:50.197639 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b4caeae1-dab9-4fc2-b0d8-1c141ea0cbb5 req-51998ca0-f3d6-46e8-910d-f01aeed03827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052114 Aug 30 18:49:50.198647 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2926/5727] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:50.536353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:50.537006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:50.548637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:50.549153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:50.549614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:50.550399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:50.550888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:50.551511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:50.816668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:50.827193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4cba6b92-a41b-485b-9670-e47dc030842e tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.299249 Aug 30 18:49:50.840645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2802/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:50 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:51.853983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:51.856593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:51.890661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:51.899203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:51.900070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:51.901401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:51.902131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:51.902901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:51.945029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:49:52.131564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:52.149599 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34bb73b9-8640-4f88-ad89-ac8e4acfcccb tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.300507 Aug 30 18:49:52.153463 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2927/5729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:51 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:53.055161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a3c13c-f730-4cb7-8c6a-5779bcdc0e49", "name": "network-vif-plugged", "status": "completed", "tag": "a5133291-762e-4494-a94f-9db1b4dd92b8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:53.079533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.080423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.081070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.094242 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] Creating event network-vif-plugged:a5133291-762e-4494-a94f-9db1b4dd92b8 for instance 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 on n-h1-854119-10 Aug 30 18:49:53.101402 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-291bea9c-6318-44ec-9a09-27159a35d3fc req-173e2bfb-2f5e-4987-b2ef-21dc378d3555 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054187 Aug 30 18:49:53.102824 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2803/5730] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:49:53.198461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:53.199264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:53.209946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.210606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.211162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.211992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:53.212576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:53.212972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:53.438665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:53.454068 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2a4652e0-14d4-455a-bd29-76e2e56e794d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.284735 Aug 30 18:49:53.462454 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2928/5731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:53 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:54.485766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:54.485766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:54.494015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:54.494798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:54.495918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:54.496696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:54.497220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:54.497942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:54.802640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:54.822526 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-51f55db3-1938-4566-a2c9-7204199e198d tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1319 microversion: 2.1 time: 0.343334 Aug 30 18:49:54.823816 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2804/5732] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:54 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:55.362910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:55.372373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.373833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.374712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.420068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:49:55.485590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-81a4c8a4-8a9d-46f7-9b7b-323d5e9f1c25 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action" status: 202 len: 0 microversion: 2.1 time: 0.127649 Aug 30 18:49:55.490090 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2929/5733] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:49:55 2022] POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:49:55.504804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:55.507653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:55.527147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.527836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.528417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.529699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.530536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.531408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.763991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:55.777298 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cd6d84f6-ab3e-46d8-a73e-1722ab4ca5ee tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.285216 Aug 30 18:49:55.792599 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2805/5734] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:55 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:55.848259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:55.849583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:55.860151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.861106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.862453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:55.864026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:55.864815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:55.865403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.104983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:56.119038 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90396016-2792-48cb-a8c6-579c922df569 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 200 len: 1506 microversion: 2.1 time: 0.277130 Aug 30 18:49:56.120182 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2930/5735] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:55 2022] GET /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:56.142799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:56.144052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 992656ce-9569-4b9d-a910-cff64037c7e2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:56.154854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.156095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.156737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.157880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.158621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.159258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.390163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:56.403561 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-764868f0-378d-44fa-a402-013a60be0a25 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/992656ce-9569-4b9d-a910-cff64037c7e2" status: 200 len: 1506 microversion: 2.1 time: 0.264978 Aug 30 18:49:56.404889 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2806/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:56 2022] GET /compute/v2.1/servers/992656ce-9569-4b9d-a910-cff64037c7e2 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:56.426589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:56.428060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 992656ce-9569-4b9d-a910-cff64037c7e2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:56.437571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.438333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.438967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.439697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.440216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.440629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.491056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 992656ce-9569-4b9d-a910-cff64037c7e2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:49:56.615139 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18ed3408-58f4-42e4-b414-57c2740a6b30 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "DELETE /compute/v2.1/servers/992656ce-9569-4b9d-a910-cff64037c7e2" status: 204 len: 0 microversion: 2.1 time: 0.193810 Aug 30 18:49:56.622950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2931/5737] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:49:56 2022] DELETE /compute/v2.1/servers/992656ce-9569-4b9d-a910-cff64037c7e2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:49:56.628533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:56.629261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:56.637240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.638151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.638855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.640152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.640839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.641485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.677881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:49:56.801313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:56.801612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:56.810369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.810880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.811402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:56.814207 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d5beac7-bcde-400c-b0da-95d165e9be10 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49" status: 204 len: 0 microversion: 2.1 time: 0.189183 Aug 30 18:49:56.814887 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2807/5738] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:49:56 2022] DELETE /compute/v2.1/servers/09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:49:56.822690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:56.822690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:56.822690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:57.034538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-372606750", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d8ccc1ca-bd6e-4f4b-9c9f-3295224576ea"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:57.077667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:57.089943 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89e0244b-462d-4f84-863c-4eaa577884a9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.293979 Aug 30 18:49:57.096921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2932/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:56 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:57.139429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] validate_networks() for [('d8ccc1ca-bd6e-4f4b-9c9f-3295224576ea', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:49:57.696931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:49:57.697543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:49:57.697846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:49:57.698265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:49:57.698721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:49:57.712337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:57.712843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:57.713306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:57.714172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:57.718476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:57.719151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:57.752804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Getting quotas for project abf6c1e7a5f34776a5bdf6b3833c971c. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:49:57.761005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Getting quotas for user 338a586c79a94b94a8534fc9f4c653de and project abf6c1e7a5f34776a5bdf6b3833c971c. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:49:57.783857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Going to run 2 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:49:57.786710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:57.838133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=11df5ee6-505d-477c-97b7-a8be75e41d45,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:49:57.934191 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4e2aa1c-2388-4629-9219-a91b6d2b6de2 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.902384 Aug 30 18:49:57.943529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2808/5740] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:49:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 18:49:57.947815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:57.955143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:57.971266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Searching by: {'deleted': False, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 18:49:58.012392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.013396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.013951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.014832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.015421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.015949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.079889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 18:49:58.118080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:58.120633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:58.148422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.151182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.152347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.153313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c9d8d65-61fd-493e-9cdc-c12202375299 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.209361 Aug 30 18:49:58.154703 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2933/5741] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 18:49:57 2022] GET /compute/v2.1/servers => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:58.168870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:58.169943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:58.170652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:58.185183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0551bf5c-6f77-4c7f-85f6-f2f6216f7ae4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:58.185799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0551bf5c-6f77-4c7f-85f6-f2f6216f7ae4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:58.347888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0551bf5c-6f77-4c7f-85f6-f2f6216f7ae4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:58.351525 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0551bf5c-6f77-4c7f-85f6-f2f6216f7ae4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1217 microversion: 2.1 time: 0.180218 Aug 30 18:49:58.363071 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2934/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:58 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:58.882506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:58.900327 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60c0a0f9-c179-44c9-a625-71f112ffd8d1 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.790461 Aug 30 18:49:58.901253 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2809/5743] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:58 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:49:59.389660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:59.393671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:59.421079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.421595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.422037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.428065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.429442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.429902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.653628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:49:59.664868 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-50977d87-b312-4c06-9a7a-08625bd75985 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1221 microversion: 2.1 time: 0.282231 Aug 30 18:49:59.669469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a3c13c-f730-4cb7-8c6a-5779bcdc0e49", "name": "network-vif-deleted", "tag": "a5133291-762e-4494-a94f-9db1b4dd92b8"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:49:59.698140 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2935/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:59 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:49:59.704331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.705001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.705696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.759734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] Creating event network-vif-deleted:a5133291-762e-4494-a94f-9db1b4dd92b8 for instance 09a3c13c-f730-4cb7-8c6a-5779bcdc0e49 on n-h1-854119-10 Aug 30 18:49:59.770891 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7ba4f33d-bfd2-42fb-ba90-56ac58cc306b req-3d9a392a-db96-4388-9d06-6479af78c028 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105372 Aug 30 18:49:59.774282 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2810/5745] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:49:59.926750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:49:59.927696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:49:59.941599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.944489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.945122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:49:59.946014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:49:59.948390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:49:59.949520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.023678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:00.026805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:00.066921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.075026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.075964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.076971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.077661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.078311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.185559 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d82d66d3-a378-4ab3-bbe7-99d5633a880d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action" status: 200 len: 24563 microversion: 2.1 time: 0.167621 Aug 30 18:50:00.193657 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2811/5746] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:00 2022] POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action => generated 24563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:50:00.327669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:00.336705 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-befeb7ad-0f6b-4f42-af2a-fd0503f9017d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.415632 Aug 30 18:50:00.349381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2936/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:49:59 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:00.695822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:00.697285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:00.707119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.708055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.708737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.709967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:00.710700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:00.711367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:00.812260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:00.834325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a3304ed5-df05-4344-a9f1-6b9f7124c223 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1269 microversion: 2.1 time: 0.142802 Aug 30 18:50:00.836322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2812/5748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:00 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:01.372766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:01.374035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:01.386411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:01.389199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:01.390009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:01.395452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:01.396293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:01.396991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:01.684623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:01.699005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d474f842-75a1-48ad-996a-3d3f2221d501 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.331314 Aug 30 18:50:01.700173 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2937/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:01 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:01.802144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992656ce-9569-4b9d-a910-cff64037c7e2", "name": "network-vif-deleted", "tag": "14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:01.809430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:01.831644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:01.832285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:01.832887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:01.855962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] Creating event network-vif-deleted:14d7ca5a-c5ff-426c-ad76-d4d7a21c4d17 for instance 992656ce-9569-4b9d-a910-cff64037c7e2 on n-h2-854119-10 Aug 30 18:50:01.856225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:01.856840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:01.876548 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f1761e9c-2686-4f40-b0b6-84580f6ce5b3 req-b8480cb5-d7ac-4d6f-8679-aaf9878798b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078817 Aug 30 18:50:01.877419 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2813/5750] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:01.880113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:01.884837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:01.887168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:01.888015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:01.890303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:01.892103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:02.052742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:02.064923 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-166bb1af-578d-47ae-8e9b-9c54f944c0da tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1275 microversion: 2.1 time: 0.212528 Aug 30 18:50:02.075837 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2938/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:01 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:02.723229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:02.724057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:02.747179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:02.747699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:02.748155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:02.748894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:02.749370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:02.749817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:03.130013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:03.134003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:03.180818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:03.182625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:03.183982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:03.187460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:03.189082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:03.190312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:03.566145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:03.587581 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f6a959e0-ae4d-46bd-8420-8457c640ce70 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.869204 Aug 30 18:50:03.588289 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2814/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:02 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:03.649474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:03.662154 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-94030909-420a-42eb-902a-5de0049ee472 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.576615 Aug 30 18:50:03.688852 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2939/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:03 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:04.644968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:04.646582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:04.663933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.667332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.674270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:04.676162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.676990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.679166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:04.704347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:04.711757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:04.739359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.745110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.747994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:04.753235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:04.754624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:04.757055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:05.151117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:05.169221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-960216c0-5d1d-4e2d-be37-67e94772d7ff tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.476110 Aug 30 18:50:05.169818 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2940/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:04 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:05.178940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:05.201294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-126c74cf-b970-4e69-a7da-b85d5ec3ea83 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.553930 Aug 30 18:50:05.204401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2815/5755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:04 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:05.640478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6e55ed-6332-45ad-b0a3-73a44945308c", "tag": "c661da0b-083a-45ec-bc7c-f867a11760e2"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:05.662959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:05.665420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:05.666733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:05.689704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] Creating event network-changed:c661da0b-083a-45ec-bc7c-f867a11760e2 for instance ca6e55ed-6332-45ad-b0a3-73a44945308c on n-h1-854119-10 Aug 30 18:50:05.700133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-185f5da5-d94e-42d7-b7b5-40a6829d616d req-67d7e264-9951-47b0-8b28-b3444144490a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066334 Aug 30 18:50:05.701235 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2941/5756] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:06.201126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:06.202872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:06.213858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.215004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.215663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.216956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.217644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.218321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.235561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:06.244156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:06.259421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.260296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.260877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.261773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.262386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.263217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.316367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:06.502012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:06.514400 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ce990a0-5805-4163-b62b-6cd1b73b9df0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.292274 Aug 30 18:50:06.515712 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2942/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:06 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:06.528284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72749e0b-3056-4577-8e45-4976a910812f", "device": "/dev/sdb"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:06.535466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:06.542710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.543569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.544249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.545204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:06.545932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:06.546610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:06.631573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:06.641018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6bb3daa-8c47-401f-905e-c2003f426182 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.449048 Aug 30 18:50:06.643792 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2816/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:06 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:07.005241 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5c89c78-b632-493f-85af-84b0b4573efe tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "POST /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487750 Aug 30 18:50:07.006898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2943/5759] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:50:06 2022] POST /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:07.541667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:07.543548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:07.563456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:07.569090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:07.570171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.573581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:07.576501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:07.577417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.670110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:07.670849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:07.672959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:07.702551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:07.703626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:07.704301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.706678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:07.707630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:07.708411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.734962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:07.771065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:07.882360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:07.897502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d20122dc-ac22-4da5-aac3-24a31cf22894 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.360185 Aug 30 18:50:07.898519 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2817/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:07 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:07.905067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11df5ee6-505d-477c-97b7-a8be75e41d45", "tag": "7001b6ab-dd6a-49e8-8ea4-5ad93716f226"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:07.919049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:07.920633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:07.921260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:07.969803 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] Creating event network-changed:7001b6ab-dd6a-49e8-8ea4-5ad93716f226 for instance 11df5ee6-505d-477c-97b7-a8be75e41d45 on n-h2-854119-10 Aug 30 18:50:07.984744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9a65488a-258c-45ee-909e-e118e3876984 req-47c5f480-322a-4fda-93bd-d26e391875e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082074 Aug 30 18:50:07.986935 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2818/5761] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:08.023886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:08.027361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:08.039307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df7d9518-a5e2-41a0-a22e-a331d202c1f4 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.374239 Aug 30 18:50:08.040806 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2944/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:07 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:08.928425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:08.930653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:08.943478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:08.946431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:08.947418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:08.948447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:08.949192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:08.957986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:09.065318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:09.066858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:09.074095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:09.077511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:09.078751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:09.079604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:09.081078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:09.083234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:09.084061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:09.309028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:09.329019 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8bfa6045-fb7e-45e5-9a24-7a779f440d1a tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.267512 Aug 30 18:50:09.330332 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2945/5763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:09 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:09.355810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:09.358785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:09.412895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fb0a9a14-276e-4d72-a0bc-89087332acfa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.491972 Aug 30 18:50:09.419568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2819/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:08 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:10.354077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:10.356233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:10.366218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.366835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.367389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.368287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.368806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.369313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.471345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:10.474217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:10.493533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.494293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.494942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.495823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:10.496429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:10.497015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:10.588663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:10.598216 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4ee0aa5-91da-47e5-9646-af33a916906c tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.251199 Aug 30 18:50:10.598998 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2946/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:10 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:10.749612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:10.760204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-889f2ad6-545e-43ba-9f98-e76247db0a55 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.302567 Aug 30 18:50:10.761164 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2820/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:10 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:11.064576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:11.065520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.072133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.072627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.073291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.074389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.075640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.076613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.241663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:11.250510 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1de888e5-4667-444b-822d-c96bac5f6e89 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1682 microversion: 2.1 time: 0.190041 Aug 30 18:50:11.251091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2947/5767] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:11 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:11.351239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:11.353645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.360496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.360976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.361443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.362170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.362656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.363225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.418995 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6844a6e0-947e-47bc-97cd-cef54f8b942f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action" status: 200 len: 32634 microversion: 2.1 time: 0.071511 Aug 30 18:50:11.420092 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2821/5768] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:11 2022] POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action => generated 32634 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:50:11.608970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:11.609578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.617894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.618679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.619310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.620228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.620873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.621504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.624130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:11.624925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.633535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.634140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.634673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.635479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.636008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.636506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.786751 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84ceacac-4dc8-4683-9f3d-bcf0a7e0c538 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1835 microversion: 2.1 time: 0.183520 Aug 30 18:50:11.798700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:11.799436 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2948/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:11 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1835 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:11.805815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:11.806465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.811714 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31dcec58-5142-4227-8435-920811048415 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.192069 Aug 30 18:50:11.814531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.815235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.815670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.816524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.816986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.817530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.820671 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2822/5770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:11 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:11.825903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:11.828217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:11.835000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.835514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.836047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.836796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:11.837266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:11.837707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:11.883545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lazy-loading 'flavor' on Instance uuid c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:50:11.908884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Going to try to live migrate instance to another host {{(pid=122590) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 18:50:12.490730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:12.505863 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a02f6e45-1f99-4933-bff9-75f284e69996 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.705210 Aug 30 18:50:12.506492 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2949/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:11 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:12.511628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11df5ee6-505d-477c-97b7-a8be75e41d45", "name": "network-vif-plugged", "status": "completed", "tag": "7001b6ab-dd6a-49e8-8ea4-5ad93716f226"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:12.528386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:12.528984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:12.529677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:12.560444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] Creating event network-vif-plugged:7001b6ab-dd6a-49e8-8ea4-5ad93716f226 for instance 11df5ee6-505d-477c-97b7-a8be75e41d45 on n-h2-854119-10 Aug 30 18:50:12.566763 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a87c043a-dd13-44a8-bb2f-b0f43590f9c1 req-12794b9b-a3c9-4948-bfd6-8a295a1ae04d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058419 Aug 30 18:50:12.573971 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2950/5772] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:12.848119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:12.848832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:12.863152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:12.864055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:12.864362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:12.873290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:12.874143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:12.875380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:13.116572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:13.127470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9cb87b0a-7a69-4340-9ef4-056399c3f754 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.291926 Aug 30 18:50:13.142254 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2951/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:12 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:13.528827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:13.529878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:13.540610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:13.541461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:13.542102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:13.543077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:13.543751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:13.544384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:13.712354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:13.728570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1be8c45-968f-46ff-bfad-5de390801ef2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.203289 Aug 30 18:50:13.730690 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2952/5774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:13 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:14.149217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:14.149893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:14.157572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.158701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.159322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.160305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.160969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.161572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.317536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:14.328308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-077059b4-1a30-4768-9653-886159cd9e46 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.183280 Aug 30 18:50:14.328902 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2953/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:14 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:14.521699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e7cc933-6cd6-494b-a250-fade08c56cc9 tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action" status: 202 len: 0 microversion: 2.1 time: 2.698159 Aug 30 18:50:14.523028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2823/5776] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:11 2022] POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action => generated 0 bytes in 2702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:50:14.531814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:14.532620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:14.540390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.541248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.541898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.542880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.543560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.544239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.588053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6e55ed-6332-45ad-b0a3-73a44945308c", "name": "network-vif-plugged", "status": "completed", "tag": "c661da0b-083a-45ec-bc7c-f867a11760e2"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:14.613731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.614704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.615443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.637180 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] Creating event network-vif-plugged:c661da0b-083a-45ec-bc7c-f867a11760e2 for instance ca6e55ed-6332-45ad-b0a3-73a44945308c on n-h1-854119-10 Aug 30 18:50:14.645232 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c24a4b5d-7688-47ec-a8e2-7ab50c3631b1 req-83347fb1-e154-4e93-91f3-72d13fa15741 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061291 Aug 30 18:50:14.647170 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2824/5777] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:14.759625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:14.763322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:14.776247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.777092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.777979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.779039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:14.779811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:14.780506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:14.912427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:14.944592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c4e32be-83ea-4370-9821-b8fb074762ee tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.403005 Aug 30 18:50:14.947676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2954/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:14 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:15.271928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:15.281001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb04a4a7-40bd-4b19-9fd6-cd1de6420451 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.529214 Aug 30 18:50:15.283108 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2825/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:14 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:15.349749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:15.351792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:15.360118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.361008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.361549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:15.362410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.363148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.363803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:15.526480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:15.537486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3860bcff-9ebf-4d2f-8dd3-b657b5a419f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1317 microversion: 2.1 time: 0.192005 Aug 30 18:50:15.538573 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2955/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:15 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:15.969297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:15.969912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:15.978236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.979045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.979639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:15.980957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:15.991057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:15.991758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.305691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:16.306689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:16.318583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.320672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.321262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.324185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.325378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.326009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.620339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:16.635738 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9867b5c9-124c-4981-bec4-6fe8cbc2cfbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.334810 Aug 30 18:50:16.637036 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2956/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:16 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:16.643573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:16.644561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:16.654190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.654954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.655602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.656460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.657047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.657603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.881603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:16.891896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b794b81-fc0a-483a-a946-a380d7e97eb7 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 200 len: 1504 microversion: 2.1 time: 0.251890 Aug 30 18:50:16.892903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2957/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:16 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:16.912634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:16.913104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:16.927306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.928314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.939719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.942263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:16.943015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:16.943761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:16.973415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:17.180856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:17.190636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fe7db75-9047-4037-9401-72eaccd79816 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 1.221411 Aug 30 18:50:17.198804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2826/5783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:15 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:17.372661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:17.382873 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8867e8dd-9c6b-4373-9b28-337a7d3e904f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 200 len: 1505 microversion: 2.1 time: 0.474311 Aug 30 18:50:17.383816 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2958/5784] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:16 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:17.411842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:17.412383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:17.419653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.420392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.421022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.421760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.422221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.422916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.455329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:50:17.497683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "name": "network-vif-unplugged", "status": "completed", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:17.508485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.509356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.509962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.528004 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] Creating event network-vif-unplugged:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h1-854119-10 Aug 30 18:50:17.534124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-836b4d31-d9b4-4d3a-82b0-e7026e165405 req-6e63bdcd-ec6e-4548-8c4d-07edba8b26d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040151 Aug 30 18:50:17.535477 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2959/5785] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:17.578453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2263884-3289-4c7c-9f12-9db07fa7ce04 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 204 len: 0 microversion: 2.1 time: 0.171011 Aug 30 18:50:17.579381 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2827/5786] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:50:17 2022] DELETE /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:50:17.589574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:17.590103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:17.597354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.598465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.598912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.599656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.600268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.600841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.629997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:50:17.660412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:17.662402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:17.698160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.700577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.702738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.706140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.708233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.710260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.800828 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c9a3613-d09c-4f68-b906-fe11e3d4a14f tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 204 len: 0 microversion: 2.1 time: 0.215747 Aug 30 18:50:17.801902 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2960/5787] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:50:17 2022] DELETE /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:50:17.812563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:17.813814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:17.822372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.823213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.824073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.825370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:17.826734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:17.827316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:17.981073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:17.993915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d9cf66a-7579-42cb-9e6a-9e3c553d47b3 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.340148 Aug 30 18:50:18.011116 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2828/5788] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:17 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:18.065182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:18.079478 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d5fb669-7b69-47fa-8021-6fd23b0c3828 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 200 len: 1511 microversion: 2.1 time: 0.272304 Aug 30 18:50:18.093908 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2961/5789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:17 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:18.214013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:18.219238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:18.234316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:18.235311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:18.235764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:18.236562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:18.236976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:18.237561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:18.507566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:18.516535 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f4b1b58-a66e-4858-a5d8-09d1957d342d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.309699 Aug 30 18:50:18.527135 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2829/5790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:18 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:19.018856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:19.019784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:19.028089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.028732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.029273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.030114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.030736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.031271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.104166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:19.105233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:19.113994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.113994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.113994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.114892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.115300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.115741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.228976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:19.239561 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b62ac05e-0271-43ce-860a-0dbb8cd6dc6c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.224965 Aug 30 18:50:19.240871 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2962/5791] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:19 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:19.538915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:19.539798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:19.540442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:19.554135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-83201ab6-76cc-48f0-9352-bd52e4475d71 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 200 len: 1511 microversion: 2.1 time: 0.453776 Aug 30 18:50:19.555544 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2830/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:19 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:19.556645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.557150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.559553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.560302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.560765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.561190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.586944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:19.616382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:19.616877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:19.617524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:19.647668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] Creating event network-changed:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h1-854119-10 Aug 30 18:50:19.653395 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-518bb1fb-0333-4385-a483-f31d9971e0a1 req-a6a84f58-dc26-4e66-9676-8bbb47881365 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074687 Aug 30 18:50:19.654511 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2831/5793] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:19.793243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:19.804810 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-322af803-c8d9-44ef-bed6-9acb22e8835a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.269238 Aug 30 18:50:19.820551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2963/5794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:19 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:20.274216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:20.275025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:20.289522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.293427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.294065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.301111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.302386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.303023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.577545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:20.579390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:20.591375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.596202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.598056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.600590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.602551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.603015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.729966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:20.748164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-beabc9d0-e429-4e6c-b8ca-b67868860009 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 200 len: 1469 microversion: 2.1 time: 0.175739 Aug 30 18:50:20.776158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2964/5795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:20 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:20.876378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:20.877025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:20.904791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.906481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.907188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:20.907885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:20.918090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:20.918574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.043728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:21.061012 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be257797-8d19-4910-bde7-1e102bea95cb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1722 microversion: 2.1 time: 0.792830 Aug 30 18:50:21.079118 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2832/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:20 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1722 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:21.152541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:21.186276 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1259727e-8088-44a1-b34f-951359e34585 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.359100 Aug 30 18:50:21.202546 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2965/5797] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:20 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:21.684548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6e55ed-6332-45ad-b0a3-73a44945308c", "name": "network-vif-deleted", "tag": "c661da0b-083a-45ec-bc7c-f867a11760e2"}, {"server_uuid": "11df5ee6-505d-477c-97b7-a8be75e41d45", "name": "network-vif-deleted", "tag": "7001b6ab-dd6a-49e8-8ea4-5ad93716f226"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:21.700968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.704956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.705416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.730697 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Creating event network-vif-deleted:c661da0b-083a-45ec-bc7c-f867a11760e2 for instance ca6e55ed-6332-45ad-b0a3-73a44945308c on n-h1-854119-10 Aug 30 18:50:21.731179 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] Creating event network-vif-deleted:7001b6ab-dd6a-49e8-8ea4-5ad93716f226 for instance 11df5ee6-505d-477c-97b7-a8be75e41d45 on n-h2-854119-10 Aug 30 18:50:21.740496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ce85e98a-aa00-49e1-8e43-0b314cabe5ae req-49c1ac05-afef-4b8a-ab0c-81c515ac0b83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067235 Aug 30 18:50:21.741124 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2833/5798] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:21.772974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:21.774105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:21.783200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.784034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.784637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.785365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.786160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.786903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.837603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:21.838163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:21.838697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:21.839450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lazy-loading 'fault' on Instance uuid 11df5ee6-505d-477c-97b7-a8be75e41d45 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:50:21.900688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a586c79a94b94a8534fc9f4c653de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf6c1e7a5f34776a5bdf6b3833c971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:21.921290 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-779f81f7-9c5a-4cc7-b451-18706b18d4f6 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 200 len: 1307 microversion: 2.1 time: 0.152297 Aug 30 18:50:21.922285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2966/5799] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:21 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:22.098941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.099730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:22.112469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.113098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.113564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.118591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.121823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.125037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.211081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.211287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:22.220321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.223020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.248869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.253429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.254076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.254680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.323129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:22.335108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3019d1e-93e3-4883-92b2-bf2ec361c685 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1699 microversion: 2.1 time: 0.243591 Aug 30 18:50:22.338925 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2834/5800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:22.362018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:22.369175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.369911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.370571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.388089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:22.400918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Going to try to start instance {{(pid=122590) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:50:22.445651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:22.466898 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2b4899ec-3837-419d-b703-2a3968e23c58 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action" status: 202 len: 0 microversion: 2.1 time: 0.109315 Aug 30 18:50:22.471557 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2835/5801] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:22 2022] POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:50:22.473630 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c95addc3-e054-417a-85c9-1883cd893f5a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.267606 Aug 30 18:50:22.479957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.480142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2967/5802] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:22.481181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:22.492734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.494121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.496092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.497303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.498272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.499063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.701406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:22.727553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b518307-ecb0-4ed4-9f98-88e3683e0974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1708 microversion: 2.1 time: 0.253919 Aug 30 18:50:22.728629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2836/5803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1708 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:22.947793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.948912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: 11df5ee6-505d-477c-97b7-a8be75e41d45] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:22.955941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.956508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.957019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.958134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:22.958631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:22.959068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:22.975776 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] HTTP exception thrown: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Request method failure captured: Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 HTTP/1.1 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlu9DTC9TJIH3Lsx64d6TKVmPwSNfUr45b7GFZIRLBlhZtj9oohEEbR_evCb4X8bJHNu-4n5NjyUIuRbZ8HikcjE2D-r8OUgOfU_5_MamQvDh93zBG3mNe0tvvaNMBu52F82m2PFNPlYG5kilTwjYW9UxwQs-lcpgRTR7fAIwJ9Drh8 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: abf6c1e7a5f34776a5bdf6b3833c971c Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: abf6c1e7a5f34776a5bdf6b3833c971c Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-MultipleCreateTestJSON-1604396591-project Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 338a586c79a94b94a8534fc9f4c653de Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-MultipleCreateTestJSON-1604396591-project Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '11df5ee6-505d-477c-97b7-a8be75e41d45'} Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:22.979196 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Returning 404 to user: Instance 11df5ee6-505d-477c-97b7-a8be75e41d45 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:22.986226 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c4c9177-f19e-4fe6-b768-2ec0d0c3b0b0 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45" status: 404 len: 111 microversion: 2.1 time: 0.038388 Aug 30 18:50:22.987342 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2968/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/11df5ee6-505d-477c-97b7-a8be75e41d45 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:50:22.989641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:22.990544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] [instance: ca6e55ed-6332-45ad-b0a3-73a44945308c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:23.013935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.014531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.015037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.016013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.019790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.022428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.052218 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] HTTP exception thrown: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Request method failure captured: Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c HTTP/1.1 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlu9DTC9TJIH3Lsx64d6TKVmPwSNfUr45b7GFZIRLBlhZtj9oohEEbR_evCb4X8bJHNu-4n5NjyUIuRbZ8HikcjE2D-r8OUgOfU_5_MamQvDh93zBG3mNe0tvvaNMBu52F82m2PFNPlYG5kilTwjYW9UxwQs-lcpgRTR7fAIwJ9Drh8 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: abf6c1e7a5f34776a5bdf6b3833c971c Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abf6c1e7a5f34776a5bdf6b3833c971c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: abf6c1e7a5f34776a5bdf6b3833c971c Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1604396591 Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateTestJSON-1604396591-project Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 338a586c79a94b94a8534fc9f4c653de Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateTestJSON-1604396591-project Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ca6e55ed-6332-45ad-b0a3-73a44945308c'} Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:23.054008 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. Aug 30 18:50:23.057884 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:23.059967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] Returning 404 to user: Instance ca6e55ed-6332-45ad-b0a3-73a44945308c could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:23.061152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f615971-aeb1-4820-94c2-21557d333210 tempest-MultipleCreateTestJSON-1604396591 tempest-MultipleCreateTestJSON-1604396591-project] 10.222.0.25 "GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c" status: 404 len: 111 microversion: 2.1 time: 0.075597 Aug 30 18:50:23.061752 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2837/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:22 2022] GET /compute/v2.1/servers/ca6e55ed-6332-45ad-b0a3-73a44945308c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:50:23.508444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:23.509794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:23.523159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.524276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.525173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.528069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.529126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.535753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.751710 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:23.753113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:23.769859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.770081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.781497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:23.782490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:23.783175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:23.783791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:24.080188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:24.091905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:24.098764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1595766e-907f-4e81-9456-5dd5c71692c6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.595580 Aug 30 18:50:24.101367 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2969/5806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:23 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:24.107540 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95d65661-c177-4c70-b17d-2338771e7d3f tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1708 microversion: 2.1 time: 0.359799 Aug 30 18:50:24.110315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2838/5807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:23 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1708 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:25.131428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:25.133065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:25.145256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:25.145846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:25.158623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.159206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.160056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.161468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.162517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.163537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.164024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.165613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.166746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.178957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:25.179946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:25.180625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:25.594141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:25.609498 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60cebc44-80a5-487c-9ec6-86ec04b13662 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1712 microversion: 2.1 time: 0.471019 Aug 30 18:50:25.614241 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2839/5808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:25 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1712 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:25.755065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:25.787308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a7f34e7a-9e4b-4a18-a9a8-e39aadef6bdd tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.666564 Aug 30 18:50:25.791633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2970/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:25 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:26.821168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:26.822951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:26.850535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:26.850535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:26.850535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:26.863383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:26.872359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:26.873738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:27.212955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:27.223191 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b2ff4625-f0bb-447e-b5c2-386fabae76e6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1692 microversion: 2.1 time: 0.409205 Aug 30 18:50:27.238966 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2840/5810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:26 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1692 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:28.246972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:28.249206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:28.309443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:28.316575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:28.317160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:28.318657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:28.330180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:28.330880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:28.828110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:28.841739 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f54d6fe2-b61a-4417-a366-5cebf2acf199 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1682 microversion: 2.1 time: 0.600263 Aug 30 18:50:28.844494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2971/5811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:28 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1682 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:28.874262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:28.875504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:28.893264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:28.893861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:28.894280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:28.895653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:28.895771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:28.896199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:29.525443 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c194787a-593a-48bf-84fc-f11555cf53ea tempest-TestNetworkAdvancedServerOps-716714117 tempest-TestNetworkAdvancedServerOps-716714117-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1835 microversion: 2.1 time: 0.660086 Aug 30 18:50:29.526774 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2841/5812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:28 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1835 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:29.555310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:29.559955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:29.569263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:29.580308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:29.581020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:29.582546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:29.583173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:29.583761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:29.851906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:29.862269 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e23cc8d-2a39-4e20-abb8-8b9ede27c9ad tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1682 microversion: 2.1 time: 0.313980 Aug 30 18:50:29.881719 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2972/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:29 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:30.082626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:30.084938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:30.132445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:30.133762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:30.134229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:30.141175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:30.142485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:30.147178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:30.296405 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28f6900d-d135-4459-8389-9c856726c6f2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action" status: 200 len: 38668 microversion: 2.1 time: 0.217702 Aug 30 18:50:30.299110 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2842/5814] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:50:30 2022] POST /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5/action => generated 38668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:50:32.291389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:32.292174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:32.318640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.320891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.321369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.322083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:32.322527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.322604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.323040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.351319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:32.354995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.355967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.356643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.399446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:50:32.410699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] Creating event network-changed:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h2-854119-10 Aug 30 18:50:32.442749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-209a5d3c-eda0-413a-9295-4e43ab06ef21 req-d35c88ae-833a-472a-94bf-552f69cab0ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132652 Aug 30 18:50:32.443327 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2843/5815] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:32.568298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:32.692813 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-619d9a2c-6721-436e-80d0-507dccb963d8 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 204 len: 0 microversion: 2.1 time: 0.406185 Aug 30 18:50:32.694325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2973/5816] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:50:32 2022] DELETE /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:50:32.709763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:32.710965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:32.724243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.725199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.725909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.727343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:32.728938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:32.729622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:32.841824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-674448ca-bd2e-4b8a-8d0b-49e630b23a64 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2143381672", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:32.852115 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-674448ca-bd2e-4b8a-8d0b-49e630b23a64 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] HTTP exception thrown: min_count must be <= max_count Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-674448ca-bd2e-4b8a-8d0b-49e630b23a64 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Request method failure captured: Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 184 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlv4Fsfd8VL54FzvR5YnLf_4LYwVa9Yz6m27lVHZIXMdNXcZ1jdgIWTjfG40Ijp4KzH-NUhr0zSY42xGAoKKuZwcc_YhMPRND0GObNS-HH268GkfHR3SgiRGBHuEkvTGs2bxZtuL63kX-Dhb56wvgdc50rH4ymwW4WETiCkT7Re-ePM Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 57238118a11e4b2a9779c5288342f23b Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2143381672", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: exception: min_count must be <= max_count Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2143381672', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 30 18:50:32.855294 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.861508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-674448ca-bd2e-4b8a-8d0b-49e630b23a64 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Returning 400 to user: min_count must be <= max_count {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:32.863651 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-674448ca-bd2e-4b8a-8d0b-49e630b23a64 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.409675 Aug 30 18:50:32.864630 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2844/5817] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:32 2022] POST /compute/v2.1/servers => generated 74 bytes in 421 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:50:32.989298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0aeafc21-9c45-4062-b77f-8404bc8289bd tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2135640524", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "max_count": 0}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0aeafc21-9c45-4062-b77f-8404bc8289bd tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Request method failure captured: Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 168 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlv4Fsfd8VL54FzvR5YnLf_4LYwVa9Yz6m27lVHZIXMdNXcZ1jdgIWTjfG40Ijp4KzH-NUhr0zSY42xGAoKKuZwcc_YhMPRND0GObNS-HH268GkfHR3SgiRGBHuEkvTGs2bxZtuL63kX-Dhb56wvgdc50rH4ymwW4WETiCkT7Re-ePM Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 57238118a11e4b2a9779c5288342f23b Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2135640524", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "max_count": 0}} Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2135640524', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'max_count': 0}}} Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 0 Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:50:32.994721 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:32.998283 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.004639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0aeafc21-9c45-4062-b77f-8404bc8289bd tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:33.011514 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0aeafc21-9c45-4062-b77f-8404bc8289bd tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023325 Aug 30 18:50:33.012180 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2845/5818] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:50:33.117473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e112a621-0f59-43b0-bef8-8084ff077fb3 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1849170546", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "max_count": 2.5}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e112a621-0f59-43b0-bef8-8084ff077fb3 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Request method failure captured: Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 170 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlv4Fsfd8VL54FzvR5YnLf_4LYwVa9Yz6m27lVHZIXMdNXcZ1jdgIWTjfG40Ijp4KzH-NUhr0zSY42xGAoKKuZwcc_YhMPRND0GObNS-HH268GkfHR3SgiRGBHuEkvTGs2bxZtuL63kX-Dhb56wvgdc50rH4ymwW4WETiCkT7Re-ePM Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 57238118a11e4b2a9779c5288342f23b Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1849170546", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "max_count": 2.5}} Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1849170546', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'max_count': 2.5}}} Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:50:33.134230 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.139991 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.144546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e112a621-0f59-43b0-bef8-8084ff077fb3 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:33.150819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e112a621-0f59-43b0-bef8-8084ff077fb3 tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.050794 Aug 30 18:50:33.151801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2846/5819] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:50:33.278964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62145772-612f-4399-89a4-c90aaabb810d tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1070357030", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 0}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62145772-612f-4399-89a4-c90aaabb810d tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Request method failure captured: Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 168 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlv4Fsfd8VL54FzvR5YnLf_4LYwVa9Yz6m27lVHZIXMdNXcZ1jdgIWTjfG40Ijp4KzH-NUhr0zSY42xGAoKKuZwcc_YhMPRND0GObNS-HH268GkfHR3SgiRGBHuEkvTGs2bxZtuL63kX-Dhb56wvgdc50rH4ymwW4WETiCkT7Re-ePM Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 57238118a11e4b2a9779c5288342f23b Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1070357030", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 0}} Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1070357030', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'min_count': 0}}} Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 0 Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:50:33.292306 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62145772-612f-4399-89a4-c90aaabb810d tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62145772-612f-4399-89a4-c90aaabb810d tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024519 Aug 30 18:50:33.295718 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2847/5820] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:50:33.367608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:33.394953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d2f718e-7a61-4f82-92f2-59f696c14311 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1688 microversion: 2.1 time: 0.692770 Aug 30 18:50:33.396520 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2974/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:32 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1688 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:33.432065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddbf2a1d-fa5e-4394-bdac-657e9198a28e tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1787519691", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 2.5}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddbf2a1d-fa5e-4394-bdac-657e9198a28e tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Request method failure captured: Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 170 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlv4Fsfd8VL54FzvR5YnLf_4LYwVa9Yz6m27lVHZIXMdNXcZ1jdgIWTjfG40Ijp4KzH-NUhr0zSY42xGAoKKuZwcc_YhMPRND0GObNS-HH268GkfHR3SgiRGBHuEkvTGs2bxZtuL63kX-Dhb56wvgdc50rH4ymwW4WETiCkT7Re-ePM Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cd8d116f1b7b4f639bea24aa4f408a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: cd8d116f1b7b4f639bea24aa4f408a74 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1877946415 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 57238118a11e4b2a9779c5288342f23b Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1877946415-project Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1787519691", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "min_count": 2.5}} Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1787519691', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'min_count': 2.5}}} Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:50:33.437144 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:50:33.442581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddbf2a1d-fa5e-4394-bdac-657e9198a28e tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:33.446155 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ddbf2a1d-fa5e-4394-bdac-657e9198a28e tempest-MultipleCreateNegativeTestJSON-1877946415 tempest-MultipleCreateNegativeTestJSON-1877946415-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024299 Aug 30 18:50:33.446946 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2848/5822] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:50:34.421388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:34.428159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:34.453257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:34.455104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:34.455360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:34.456151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:34.461048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:34.462086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:34.845815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:34.899395 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f12aa51-67cd-4aff-ad87-ad3e7b21342a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 200 len: 1570 microversion: 2.1 time: 0.457192 Aug 30 18:50:34.904565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2975/5823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:34 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 1570 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:34.910083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5", "name": "network-vif-deleted", "tag": "c08f6ce4-67e5-4add-854a-ba90f05f4a82"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:34.934182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:34.937628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:34.938234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:34.966262 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] Creating event network-vif-deleted:c08f6ce4-67e5-4add-854a-ba90f05f4a82 for instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 on n-h2-854119-10 Aug 30 18:50:34.966766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e00506ce-d27f-4a18-8917-1392e1385f23 req-5a776127-f3c4-4d4e-a9ef-647bc771a871 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067366 Aug 30 18:50:34.970431 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2849/5824] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:50:35.934679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:35.935394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:35.970846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:35.971687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:35.973474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:35.974667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:35.982514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:35.983249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:36.012710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] HTTP exception thrown: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Request method failure captured: Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 HTTP/1.1 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlo7eNdRA01I3W-MRgZkZv3teqriXS0Hi03L2b3Msm7JwKQE_nTf0o0CIFGNoHKhO-f1Qeq5DCjIw2QdxrbgWqsz9K_tWdWzAPtJTz3cfJ2WdlEJ1wYuXnR75h2o08zt8sWrNJOWUulBICPHel7lMev8oF9R_pmo7g9Yw9YtFUA69KU Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bf8da5657e864953b48bf5307f363139"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bf8da5657e864953b48bf5307f363139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 087be4b9803348b5ac503a1576c890c2 Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5'} Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:36.014817 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. Aug 30 18:50:36.018150 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:50:36.021420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Returning 404 to user: Instance c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:50:36.022592 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20960cd4-892e-42a7-8d7e-d03d4416e616 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5" status: 404 len: 111 microversion: 2.1 time: 0.093877 Aug 30 18:50:36.023771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2976/5825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:35 2022] GET /compute/v2.1/servers/c2fac4a9-3b7e-4377-be50-2be1e3d0dbc5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:50:42.915982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-df689f80-0554-465d-833f-1ff0ec3f7ad7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '.version_select at 0x7f4e559eb5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:42.962144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-df689f80-0554-465d-833f-1ff0ec3f7ad7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1369174717" status: 202 len: 0 microversion: 2.1 time: 0.051629 Aug 30 18:50:42.963338 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2850/5826] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 18:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1369174717 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:50:42.997096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: .version_select at 0x7f4e5af69550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1111369701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhh7jIzMoPE9q2JfJdyfMPzXHpalU7jV8ZTPstJmpEB2XoyN4CYjX2E7wWFcmQ3GE/nJctcSIoecM2ZawQBbtP+XMJtb3S9qTrGHzyb/d0hZvAqmEPD5PP2ELTuc8zqrA=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:43.006087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:43.029972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:50:43.037945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:50:43.056009 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:50:44.071370 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47372. Aug 30 18:50:44.100062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c27941d0-cf03-4061-9201-48a26b152713 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.110088 Aug 30 18:50:44.107435 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2977/5827] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:50:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:44.851541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1459318832", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6a671277-98f4-4d1a-b50b-484aab80f1e4"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:44.947620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] validate_networks() for [('6a671277-98f4-4d1a-b50b-484aab80f1e4', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:50:44.961639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:45.528035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:50:45.528565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:50:45.529391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:50:45.529655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:50:45.530153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:50:45.544876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:45.545651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:45.546290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:45.547892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:45.548567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:45.549683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:45.593024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Getting quotas for project ec2459b91ee14216ada0f7bcd20c843a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:50:45.601564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Getting quotas for user 1fd44912790c40adb4c1a1a82eebc8e2 and project ec2459b91ee14216ada0f7bcd20c843a. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:50:45.624428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:50:45.627178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:50:45.698230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1173ccd9-de4c-46b7-8585-f74bd143d324 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851423 Aug 30 18:50:45.700588 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2851/5828] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:50:45.717245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-841dd829-b0a1-4afb-9629-0bcea3a677d5 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:45.717245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-841dd829-b0a1-4afb-9629-0bcea3a677d5 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:45.781178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:45.781997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:45.790453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:45.791545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:45.792145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:45.793077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:45.793802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:45.794489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:45.935937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-841dd829-b0a1-4afb-9629-0bcea3a677d5 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:45.957958 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-841dd829-b0a1-4afb-9629-0bcea3a677d5 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1214 microversion: 2.1 time: 0.244995 Aug 30 18:50:45.970857 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2978/5829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:45 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:45.973497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lazy-loading 'services' on Instance uuid 17713ada-c352-4b32-9a82-9a7b628b6a31 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:50:46.151524 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64184323-e1d1-49f8-b11f-0a9c1ba4d46d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31/os-volume_attachments/72749e0b-3056-4577-8e45-4976a910812f" status: 202 len: 0 microversion: 2.1 time: 0.374496 Aug 30 18:50:46.152839 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2852/5830] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:50:45 2022] DELETE /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31/os-volume_attachments/72749e0b-3056-4577-8e45-4976a910812f => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:50:46.333908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:46.505492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-484687106", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:46.579395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] validate_networks() for [('ec53fb27-260a-4eb9-b545-771c64a4c519', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:50:47.002300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:47.003304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:47.048570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:47.070976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:47.072448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:47.086391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:47.087427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:47.092003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:47.267178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:50:47.268790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:50:47.269612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:50:47.270276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:50:47.270870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:50:47.290530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:47.291931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:47.293671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:47.294946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:47.300218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:47.300991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:47.313209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:47.336472 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77dc6843-b0ad-4205-85e0-245464bdbd29 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1210 microversion: 2.1 time: 0.334529 Aug 30 18:50:47.341404 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2853/5831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:46 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1210 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:47.384754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Getting quotas for project 47c518c70d2343d7990bf35ada05fc20. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:50:47.404218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Getting quotas for user c4aae15e37234749a2acb425fa56b8d5 and project 47c518c70d2343d7990bf35ada05fc20. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:50:47.455095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:50:47.465489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:50:47.529813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12e70333-4bc8-4d7f-a153-c00bbaa8f966 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Action: 'create', calling method: .version_select at 0x7f4e559b9160>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-490399035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpNXow2zLc+LEZy85kDRlLqmGENl8XTZ9BqFUkftZF0ojBCGtWw5Hwv8AGISNia0fHegF561dinT4OINKsFdZB3vZqFfc6fJQ2u9IuTnpdC3F8RfY/b059b7tqtdj1HNA=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:47.569200 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6bbe680e-7153-411a-b38a-32996362da25 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.240085 Aug 30 18:50:47.570193 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2979/5832] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:50:47.580166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12e70333-4bc8-4d7f-a153-c00bbaa8f966 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Getting quotas for project fb51c213c243445088964e31aa83abfd. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:50:47.588487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03a5a010-652b-494b-9dd1-4f83344e2166 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:47.589497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-03a5a010-652b-494b-9dd1-4f83344e2166 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:47.597862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-12e70333-4bc8-4d7f-a153-c00bbaa8f966 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Getting quotas for user 061863de2d1e4af1bcc06732d60968a5 and project fb51c213c243445088964e31aa83abfd. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:50:47.693176 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12e70333-4bc8-4d7f-a153-c00bbaa8f966 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.167221 Aug 30 18:50:47.699558 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2854/5833] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:50:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:50:47.701206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-03a5a010-652b-494b-9dd1-4f83344e2166 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:47.716215 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-03a5a010-652b-494b-9dd1-4f83344e2166 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1222 microversion: 2.1 time: 0.137070 Aug 30 18:50:47.719151 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2980/5834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:47 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:48.369927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:48.370803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:48.386967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:48.391043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:48.393204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:48.407163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:48.409564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:48.410398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:48.538213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:48.548066 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4c11d43-aaa0-44ce-9b8f-5154877f516b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1272 microversion: 2.1 time: 0.182377 Aug 30 18:50:48.563059 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2855/5835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:48 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:48.738765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:48.740793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:48.755777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:48.758027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:48.759642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:48.761129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:48.762002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:48.762773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:48.882314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:48.895757 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5e5b334-3578-4a85-812b-f0d466352dea tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1226 microversion: 2.1 time: 0.158336 Aug 30 18:50:48.897270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2981/5836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:48 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:49.587924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:49.588718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:49.605529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:49.606643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:49.607891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:49.610808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:49.613434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:49.614188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:49.818930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:49.835413 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-378de427-8960-4b8b-9806-cb6618bf0903 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1272 microversion: 2.1 time: 0.251421 Aug 30 18:50:49.853736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2856/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:49 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:49.921132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:49.924448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:49.944013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:49.944944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:49.947538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:49.949112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:49.949795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:49.950490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:49.957904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-137167374", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fb5c2245-82cc-4d8c-9695-e3e420a24d91", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-490399035", "security_groups": [{"name": "tempest-secgroup-smoke-122896615"}], "networks": [{"uuid": "37a4f086-a63d-4bb6-b60a-7f30b97d2429"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:50.122290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:50.134817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-329637c6-f2d8-48a9-a354-21d445b2decf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1282 microversion: 2.1 time: 0.217679 Aug 30 18:50:50.141900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2982/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:49 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:50.843277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] validate_networks() for [('37a4f086-a63d-4bb6-b60a-7f30b97d2429', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:50:50.858457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:50.859340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:50.887703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:50.888642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:50.890874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:50.891863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:50.892495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:50.893071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:50.983760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:50.993753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6eb56821-a97b-44d6-a517-b4d3c91cb13b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1272 microversion: 2.1 time: 0.140067 Aug 30 18:50:50.995746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2983/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:50 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:51.161347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:51.161972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:51.177060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:51.180403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:51.181074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:51.193395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:51.194266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:51.194902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:51.289522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:51.303028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98785667-fc94-4d69-96b7-5c00a37f3286 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1280 microversion: 2.1 time: 0.145633 Aug 30 18:50:51.304201 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2984/5840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:51 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:52.016225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:52.017224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:52.034544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.034953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.035865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.036922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.037537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.038135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.510454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:52.518741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-992f3771-60c9-4688-a036-09528442f385 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.506356 Aug 30 18:50:52.522719 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2985/5841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:52 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:52.534735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:52.535672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:52.549626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.555241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.556142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.557106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.559704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.560406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.565753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:50:52.566336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:50:52.566699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:50:52.567763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:50:52.568267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:50:52.610395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.610918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.611372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.620208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:52.620843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:52.622646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:52.695680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Getting quotas for project fb51c213c243445088964e31aa83abfd. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:50:52.703705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:52.709885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Getting quotas for user 061863de2d1e4af1bcc06732d60968a5 and project fb51c213c243445088964e31aa83abfd. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:50:52.715005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-448a6c18-75b1-4a0b-a5b9-378f325e2daa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1280 microversion: 2.1 time: 0.190333 Aug 30 18:50:52.720064 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2986/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:52 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:52.800467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:50:52.802951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb5c2245-82cc-4d8c-9695-e3e420a24d91',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:50:53.153393 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2209f652-f06e-492c-af17-5537a3e863bf tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.196437 Aug 30 18:50:53.168670 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2857/5843] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:50:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:50:53.172854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bd63c1e-7700-40e1-9a72-1f542057d47e tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:53.176242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1bd63c1e-7700-40e1-9a72-1f542057d47e tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:53.347615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1bd63c1e-7700-40e1-9a72-1f542057d47e tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:53.359781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1bd63c1e-7700-40e1-9a72-1f542057d47e tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1097 microversion: 2.1 time: 0.189992 Aug 30 18:50:53.363879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2987/5844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:53 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1097 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:53.546067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:53.546755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:53.579584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:53.580198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:53.585136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:53.585987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:53.586430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:53.586883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:53.751269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:53.759336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:53.774647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:53.775515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:53.776326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:53.777466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:53.778184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:53.779242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:54.124753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:54.137587 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-048dd8c2-ab0f-446b-82d7-71ea20a87a50 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.396601 Aug 30 18:50:54.138379 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2988/5845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:53 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:54.384192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:54.396043 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e5177bf8-a197-4b9f-8946-f1387ea9bad0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.854377 Aug 30 18:50:54.401967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2858/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:53 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:54.422588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:54.430662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:54.446594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:54.448372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:54.449470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:54.450778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:54.451428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:54.452059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:54.511401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd835a0-b401-4e66-9bd1-90b750fdc1ef", "tag": "5241f095-6e11-4615-85f3-c14675bcc95d"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:54.552373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:54.552917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:54.553434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:54.581615 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] Creating event network-changed:5241f095-6e11-4615-85f3-c14675bcc95d for instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef on n-h1-854119-10 Aug 30 18:50:54.602246 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5e583da3-3805-44b3-aaa5-f1df3921f5c7 req-2cc90c35-c045-453f-927d-66449881dad9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243593 Aug 30 18:50:54.602873 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2989/5847] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:50:54.692511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:54.714294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9c0321e-da9d-4a04-b050-6f910ee8a867 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1139 microversion: 2.1 time: 0.307934 Aug 30 18:50:54.727094 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2859/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:54 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1139 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:55.161605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:55.162912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:55.189339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.189853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.191556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.193544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.194050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.194515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.428218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:55.429483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:55.440965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.441591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.442041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.442801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.454944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.455641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.471046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:55.488918 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf302479-b198-4002-bee3-23192f7d14da tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.332950 Aug 30 18:50:55.494278 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2990/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:55 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:55.508221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:55.508888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:55.523388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.524041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.531440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.532498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.533199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.533883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.597557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:50:55.789771 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-62dac3fa-64ee-4c54-b6b0-2b11c44af7e4 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 204 len: 0 microversion: 2.1 time: 0.290842 Aug 30 18:50:55.793964 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2991/5850] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:50:55 2022] DELETE /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:50:55.828475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:55.833970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:55.864328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.868882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.880484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.881530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:55.882320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:55.883017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:55.978034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:56.004689 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bdd37223-38a3-4bd1-aa16-192636f3a907 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.571139 Aug 30 18:50:56.036014 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2860/5851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:55 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:56.046592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:56.047671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:56.048088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:56.063859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47a4e529-e32f-473e-8fd5-065edfca6734 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1213 microversion: 2.1 time: 0.267965 Aug 30 18:50:56.080668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:56.081642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:56.082291 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2992/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:55 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1213 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:56.082629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:56.083684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:56.084367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:56.085031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:56.512440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:56.513056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:56.529001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:56.529635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:56.529930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:56.530702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:56.531158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:56.531587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:56.896892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:56.915593 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4f03368-511f-4410-b6c1-f3c2b28699f5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.407116 Aug 30 18:50:56.921018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2993/5853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:56 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:50:56.972679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:56.983701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4cba7fc6-9862-4af9-8da6-4135fe259cc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1515 microversion: 2.1 time: 0.945423 Aug 30 18:50:56.985221 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2861/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:56 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1515 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:57.038184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:57.038834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:57.051068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.051498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.051934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.052634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.057431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.058188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.085770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:57.086682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:57.098380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.100660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.101348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.103650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.107198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.107789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.316113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:57.324429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:57.338169 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a05efc51-ce33-4ed2-a7b8-f706aa637e2d tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.301261 Aug 30 18:50:57.340542 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2994/5855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:57 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:57.372836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:57.382486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ef6cd3df-4b11-48a9-ac44-d7de4308c300 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1213 microversion: 2.1 time: 0.301023 Aug 30 18:50:57.383696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2862/5856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:57 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1213 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:57.788835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:50:57.835651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.839723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.841379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.871522 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] Creating event network-changed:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:50:57.883978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-50877eb6-f6a8-4cc0-9d19-e39b1d111b70 req-33eec271-9ec9-40bc-b5c4-089be5b769d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105549 Aug 30 18:50:57.898786 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2995/5857] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:50:57.948873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:57.949847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:57.974792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.981090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.981809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:57.982811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:57.986827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:57.986827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:58.007413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:58.008318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:58.026848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:58.033619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:58.035780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:58.036714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:58.040418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:58.042294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:58.983315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:58.996881 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f98d018-8d38-4aa8-bf4a-b508a5f18508 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1515 microversion: 2.1 time: 0.994900 Aug 30 18:50:58.997564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2996/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:58 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1515 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:59.007762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:59.008353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:59.029455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.029977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.030629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.031763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.031956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.032381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.347633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:59.354172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:50:59.370522 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84fb49d4-ed8e-4ce0-81bf-4829f55c016a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.369093 Aug 30 18:50:59.373249 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2997/5859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:58 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:59.379273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:59.379895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:59.411659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.412406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.413568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.415497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.415976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.416417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.429525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:50:59.447159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b12cb2c-7b57-4c43-b20b-803ccead392c tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 1.505084 Aug 30 18:50:59.448155 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2863/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:57 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:50:59.461254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:50:59.462241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:50:59.504934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.516312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.517354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.520746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:50:59.521784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:50:59.525317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:50:59.751929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lazy-loading 'services' on Instance uuid bfbda8ea-4642-479d-9f14-522a3cbcdc07 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:50:59.973726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-70dd9236-f16f-42a1-b694-09902bd15f85 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments/985f3f17-a0fd-4cac-a8d3-f3fd29e8b829" status: 202 len: 0 microversion: 2.1 time: 0.521361 Aug 30 18:50:59.974363 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2864/5861] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:50:59 2022] DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments/985f3f17-a0fd-4cac-a8d3-f3fd29e8b829 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:00.023546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:00.024804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:00.053336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.061228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:00.065462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.065928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.079858 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8b6fdfc-e2f8-4bb5-9c0f-8c73d74d950f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.697967 Aug 30 18:51:00.080561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2998/5862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:50:59 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:00.080867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.081652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.083505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.217782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17713ada-c352-4b32-9a82-9a7b628b6a31", "name": "network-vif-deleted", "tag": "176551a3-f33c-45b9-be45-99e380266cd7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:00.238247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.239183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.239897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.280741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] Creating event network-vif-deleted:176551a3-f33c-45b9-be45-99e380266cd7 for instance 17713ada-c352-4b32-9a82-9a7b628b6a31 on n-h2-854119-10 Aug 30 18:51:00.286713 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-aa93c25b-9146-496a-af50-0517d77c2f7f req-57d5600b-8673-4811-8549-2e0432249eb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074868 Aug 30 18:51:00.287845 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 2999/5863] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:00.400280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:00.401402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:00.433584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.438647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.439748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.441354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.441682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.447430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.851728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:00.892938 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1af5245d-ca79-4563-b41e-f5b338a4dc7c tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.501788 Aug 30 18:51:00.899432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3000/5864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:00 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:00.912376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:00.915366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:00.939188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.941402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.942031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:00.945251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:00.948730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:00.949898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:01.031244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:01.045300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8da6ca39-9203-487a-8a1b-3446b2cf022a tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 200 len: 1473 microversion: 2.1 time: 1.029428 Aug 30 18:51:01.045895 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2865/5865] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:00 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 1473 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:01.111781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:01.112871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:01.123957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:01.131848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:01.132434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:01.133248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:01.133693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:01.134136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:01.280541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:01.297042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aff5653a-98c3-4316-9d7d-218e066e642a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.394750 Aug 30 18:51:01.303626 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3001/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:00 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:01.929113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:01.930432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:01.938594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:01.939341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:01.939928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:01.942016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:01.942679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:01.943285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:02.018859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:02.040333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6afba34-3c68-4fd1-ae11-b42cc68633e8 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.932765 Aug 30 18:51:02.059371 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2866/5867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:01 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:02.082882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:02.083573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 17713ada-c352-4b32-9a82-9a7b628b6a31] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:02.110864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:02.111372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:02.112094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:02.113007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:02.113756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:02.114363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:02.157842 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] HTTP exception thrown: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Request method failure captured: Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 HTTP/1.1 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDls-JMgaRz2DSxgt0tBADOBfi3_XUxC7e_QlvHazu02-QUsjDnlPrt5-GmV3889BKeyuA_pcdNcppfnPb9ItKRQia6XRSeiCAixVeNSiMV7ydAdQrerOkSCgx4a3mDv6Lp_FPemspobO62gVUiPyhf8HGSA9JpyEzqyMrFlrkiBeHxE Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ffbb659f36e04de8ad08a44734f149ed Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ffbb659f36e04de8ad08a44734f149ed Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesSnapshotTestJSON-765647920-project Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 45b6df0080f64969b75f52895215b15c Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesSnapshotTestJSON-765647920-project Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '17713ada-c352-4b32-9a82-9a7b628b6a31'} Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:02.162188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. Aug 30 18:51:02.166578 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:02.168492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Returning 404 to user: Instance 17713ada-c352-4b32-9a82-9a7b628b6a31 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:51:02.169548 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4a09b45b-8edb-4d6a-b9dd-caf39fa15bc1 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31" status: 404 len: 111 microversion: 2.1 time: 0.094628 Aug 30 18:51:02.170303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2867/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:02 2022] GET /compute/v2.1/servers/17713ada-c352-4b32-9a82-9a7b628b6a31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:51:02.343865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:02.344991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:02.372015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:02.372564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:02.373025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:02.373784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:02.377992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:02.379946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:02.394247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:02.412925 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-acd02181-36d7-4c01-9f93-12c298a22e0b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.486732 Aug 30 18:51:02.415211 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3002/5869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:01 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:02.659175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:02.720174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:03.061464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:03.062030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:03.075970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:03.076710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:03.077298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:03.078555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:03.080857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:03.102544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:03.179499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:03.194087 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14e45a59-58a2-49fb-818d-4d5eb867acaa tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.856034 Aug 30 18:51:03.195500 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2868/5870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:02 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:03.352578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=16 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:03.477921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:03.503991 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b2c1a83-6752-4382-bb63-95b580054d2f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.446312 Aug 30 18:51:03.504597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3003/5871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:03 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:03.514752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:03.520071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:03.529847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:03.532956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:03.533583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:03.534746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:03.535687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:03.538984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:03.572185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd835a0-b401-4e66-9bd1-90b750fdc1ef", "name": "network-vif-plugged", "status": "completed", "tag": "5241f095-6e11-4615-85f3-c14675bcc95d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:03.592698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:03.595436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:03.596250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:03.597192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:03.605644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:03.624391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] Creating event network-vif-plugged:5241f095-6e11-4615-85f3-c14675bcc95d for instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef on n-h1-854119-10 Aug 30 18:51:03.635990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ce89a3b1-6841-4876-97d7-f4e635636586 req-de1fdcb3-96c1-4db1-af46-ada4113961c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232710 Aug 30 18:51:03.637397 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2869/5872] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:03.768542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:03.785984 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed9081f9-80ae-46cd-9698-aa56fba5b209 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.278231 Aug 30 18:51:03.803213 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3004/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:03 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:04.154820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:04.167148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.167897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.168488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.182730 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] Creating event network-changed:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:51:04.189216 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b89ca7ef-1e70-47e3-9ea6-d3f28bcb83fc req-35918ccf-681d-40b1-9d10-bd3bdf818e10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038926 Aug 30 18:51:04.190019 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2870/5874] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:04.220960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:04.222079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:04.232415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.233135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.234387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.236084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.236893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.237522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.531857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:04.532844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:04.549212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.549801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.550406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.551304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.551941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.552624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.588357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:04.603377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b84e71d-07df-48fd-92ea-7fab228b4db7 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.386866 Aug 30 18:51:04.623285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3005/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:04 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:04.822471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:04.823701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:04.838157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.843144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.843601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:04.844474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:04.845441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:04.846205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:05.187763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:05.202845 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f27d3d6-c4e7-4ee1-8a97-1b8bf1ad68f8 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1314 microversion: 2.1 time: 0.380151 Aug 30 18:51:05.203561 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3006/5876] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:04 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:05.266628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:05.277916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cfc86cc6-9fee-4eb5-a124-4845b9c64d9c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.749605 Aug 30 18:51:05.303023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2871/5877] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:04 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:05.639435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:05.640943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:05.673130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:05.673704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:05.674766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:05.675739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:05.676218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:05.676650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:05.997923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:06.022936 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8321435f-03b3-4ab6-8ec3-41c8f80cc9ac tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.393208 Aug 30 18:51:06.030449 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3007/5878] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:05 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:06.232847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:06.234312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:06.246920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.247607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.248569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.251259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.252267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.254210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.272217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1404535287", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "3690ea86-f443-464e-a159-8101e9d285b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1111369701", "security_groups": [{"name": "tempest-secgroup-smoke-1737836685"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:06.410759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] validate_networks() for [('3690ea86-f443-464e-a159-8101e9d285b0', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:51:06.493609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:06.508133 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab68ba6b-671b-40e1-a6a0-a0589252058a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1498 microversion: 2.1 time: 0.279547 Aug 30 18:51:06.508746 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2872/5879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:06 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:06.516133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:06.516763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:06.534457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.538106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.538909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.545832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.546565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.547234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.668255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:06.875835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:06.886988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-44086158-d834-4d55-aed0-063f75545c1f tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.377123 Aug 30 18:51:06.887739 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2873/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:06 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:06.945761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:51:06.946472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:51:06.947269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:51:06.948357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:51:06.949149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:51:06.961986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.962865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.963503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.964454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:06.965115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:06.965837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:06.989826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:51:06.991946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "name": "network-vif-plugged", "status": "completed", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:06.996278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Getting quotas for user 087be4b9803348b5ac503a1576c890c2 and project bf8da5657e864953b48bf5307f363139. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:51:07.009743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.010374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.010891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.011961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:51:07.014926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:51:07.042072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] Creating event network-vif-plugged:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:51:07.057501 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f6b5005f-33b9-4450-b18c-fc7efac257ce req-a0e77e3c-0a8d-4b96-b324-bd7f7c14ef73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069026 Aug 30 18:51:07.058668 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2874/5881] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:07.066019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:07.066916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:07.074387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.074946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.075642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.076501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.077168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.077698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.092020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c300a6c6-6126-42ad-976e-8afb8de714de tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825457 Aug 30 18:51:07.104360 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3008/5882] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:51:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:51:07.124588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba3320ca-01e7-4666-90ae-ff51d7eefea6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:07.125313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba3320ca-01e7-4666-90ae-ff51d7eefea6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:07.207699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ba3320ca-01e7-4666-90ae-ff51d7eefea6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:07.215020 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba3320ca-01e7-4666-90ae-ff51d7eefea6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1267 microversion: 2.1 time: 0.106314 Aug 30 18:51:07.228244 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3009/5883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:07 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:07.411915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:07.425636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16d769c7-5e3e-4fc3-b43f-5d88f7a4e2e6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1322 microversion: 2.1 time: 0.364778 Aug 30 18:51:07.426912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2875/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:07 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:07.583199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:07.600376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.600898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.601339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.649034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Going to try to stop instance {{(pid=122589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 18:51:07.723493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95351d27-4f29-4373-a539-40ad17f8f734 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action" status: 202 len: 0 microversion: 2.1 time: 0.143588 Aug 30 18:51:07.725718 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3010/5885] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:07 2022] POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:07.738587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:07.740036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:07.752725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.754030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.755028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.757518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.758529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.759338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.912571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:07.913265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:07.921893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.922464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.922838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.923547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:07.924362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:07.925052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:07.961557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:07.997175 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91d5530e-458e-43d3-97bb-b3c6563df124 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.266642 Aug 30 18:51:07.999425 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2876/5886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:07 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:08.190005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:08.204464 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a28ca30a-4f86-43aa-99df-9a785236bfdb tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.299122 Aug 30 18:51:08.208206 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3011/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:07 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:08.236469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:08.237240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:08.257847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.264472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.266618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.269547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.270072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.270559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.347060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:08.357220 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac76bd40-6d7a-401f-834b-edc0af14aaa2 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1263 microversion: 2.1 time: 0.125164 Aug 30 18:51:08.358645 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2877/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:08 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1263 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:08.450651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:08.451277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:08.466900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.472141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.472838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.473762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.474251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.477215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.542448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1673254487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2094816941", "security_groups": [{"name": "tempest-secgroup-smoke-1314100298"}], "block_device_mapping_v2": [{"uuid": "b00a35d9-7a51-42b6-bbc0-8dfd2a831c6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:08.811689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:08.828286 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0dc4511c-7368-4070-ad85-6b2c3b24f08e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1517 microversion: 2.1 time: 0.381660 Aug 30 18:51:08.828901 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3012/5889] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:08 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1517 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:08.853419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:08.856193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:08.880342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.886457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.887371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.888373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:08.889065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:08.889700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:08.977826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lazy-loading 'flavor' on Instance uuid 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:51:09.025411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] validate_networks() for [('5ad63c30-231e-4cbb-9f2b-2cf3c7693e3a', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:51:09.139515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:09.156187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83ab2996-e402-4a35-9c91-ee1718e5d2c9 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action" status: 200 len: 32 microversion: 2.1 time: 0.306768 Aug 30 18:51:09.157200 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3013/5890] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:08 2022] POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:51:09.175042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:09.178938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:09.194323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.196925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.197604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:09.199547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.200467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.203148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:09.282029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:51:09.509214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8984d03-f092-412c-9158-532cfda359ce tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 204 len: 0 microversion: 2.1 time: 0.349453 Aug 30 18:51:09.510310 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3014/5891] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:51:09 2022] DELETE /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:51:09.526509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:09.536995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:09.564375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.565055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.565802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:09.566913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.567658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.568357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:09.931484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:09.943596 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-59a8295c-5304-4213-806a-e27ba728ec20 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.431895 Aug 30 18:51:09.946718 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3015/5892] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:09 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:09.970730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:09.974634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:09.988800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.989507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.990218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:09.991563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:09.992593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:09.993082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.223043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:51:10.224953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:51:10.225620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:51:10.226189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:51:10.226945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:51:10.248525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.250572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.251632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.253625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.254529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.255148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.284140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:51:10.294614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Getting quotas for user 3fbc33c37c584618a1ab28f8cd5f96b7 and project 8eb44a45007144eab36bcdaeb2d6d588. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:51:10.376951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:51:10.379677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b00a35d9-7a51-42b6-bbc0-8dfd2a831c6a',volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:51:10.394420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:10.408288 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-576f57ed-ed54-43fa-9788-9d9da0800241 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.458670 Aug 30 18:51:10.412949 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3016/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:09 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:10.417941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:10.418587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:10.467092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.472435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.472435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.472648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.473108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.473487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.725334 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6782ef7-7199-4119-b05a-4952a1648067 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.191266 Aug 30 18:51:10.739843 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2878/5894] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:51:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:51:10.747900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:10.750567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:10.764477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.787337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.788047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:10.788987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:10.791401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:10.793238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.100555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.109746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-975ed48e-08c8-48c7-819f-c8f75eb97fe9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1325 microversion: 2.1 time: 0.366555 Aug 30 18:51:11.110694 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2879/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:10 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:11.142276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:11.143578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:11.148859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.161645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.162583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.163320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.165037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.165827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.166652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.168868 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b42b476a-857a-483a-bc3b-691981cb2a95 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1280 microversion: 2.1 time: 0.754608 Aug 30 18:51:11.190162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3017/5896] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:10 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1280 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:11.197880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-51a8d4cf-cef1-43fb-a0ea-1b4d671319cc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:11.198525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-51a8d4cf-cef1-43fb-a0ea-1b4d671319cc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:11.276967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-51a8d4cf-cef1-43fb-a0ea-1b4d671319cc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.286315 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-51a8d4cf-cef1-43fb-a0ea-1b4d671319cc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1095 microversion: 2.1 time: 0.094945 Aug 30 18:51:11.287017 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3018/5897] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:11 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:11.298735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:11.299804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:11.319501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.320148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.320553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.321377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.321833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.322279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.432552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.443700 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ea3f438-4cd1-458f-a1ec-c19bc2e4826e tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1504 microversion: 2.1 time: 0.318056 Aug 30 18:51:11.444432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2880/5898] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:11 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:11.449866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:11.450992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:11.458836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.459624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.460416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.461304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:11.461771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:11.462454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:11.598156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.611762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d66c399-d1da-49f2-9479-39aa5a1cc5d2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.323433 Aug 30 18:51:11.614231 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3019/5899] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:11 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:11.688368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:11.707338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71b529df-4316-4f8e-b082-9566f79a1cfb tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.259865 Aug 30 18:51:11.708345 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2881/5900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:11 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:12.135327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.136088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.146846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.148095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.148706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.149724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.151064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.151505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.201315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.202053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.215980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.216515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.216975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.217718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.222066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.223223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.463976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:12.474735 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-24c4aada-954b-44d9-bb1a-5d6c1ea3375d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.344268 Aug 30 18:51:12.475370 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3020/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:12.501764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.503479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.534313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.536062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.537819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.538678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.544356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.548050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.554085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:12.573455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1faef509-3548-436a-999a-6e50fa94bdef tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.378637 Aug 30 18:51:12.575928 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2882/5902] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:12.593481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd835a0-b401-4e66-9bd1-90b750fdc1ef", "name": "network-vif-deleted", "tag": "5241f095-6e11-4615-85f3-c14675bcc95d"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:12.624236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.626065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.628236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.668669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] Creating event network-vif-deleted:5241f095-6e11-4615-85f3-c14675bcc95d for instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef on n-h1-854119-10 Aug 30 18:51:12.682814 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3030d934-daa3-4c3f-91c7-de764ff3e0d3 req-295981e6-bc2c-4d55-82c1-8f28b105c36a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101986 Aug 30 18:51:12.687501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2883/5903] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:12.701196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.704701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.713164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:12.724272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.725083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.728139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.728736 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e046a02-4a5d-4054-acad-b2f983245464 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1201 microversion: 2.1 time: 0.229902 Aug 30 18:51:12.729545 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3021/5904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1201 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:12.730402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.731699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.733628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.755486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.756660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.770260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.770892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.771615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.773113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.774028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.776074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.826082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.828049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.830400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.831103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lazy-loading 'fault' on Instance uuid 0dd835a0-b401-4e66-9bd1-90b750fdc1ef {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:51:12.902323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:12.914165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9ca6f65-1cac-489b-9ae6-7f4b9a9de3a9 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 200 len: 1304 microversion: 2.1 time: 0.224228 Aug 30 18:51:12.922448 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2884/5905] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 1304 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:12.936939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:12.938114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:12.947919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.948880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.949705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:12.950474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:12.951157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:12.951585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.041641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:13.055030 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f18c26cd-0c4c-4a81-be22-e8135ac964d5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.312285 Aug 30 18:51:13.056924 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3022/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:13.187519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:13.225380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.225984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.226462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.253292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] Creating event network-changed:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:51:13.274975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c4a670ad-a375-4c91-9cd0-077f0f688c92 req-f9071ccf-ad04-4e9c-84c9-8e79d6579651 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092356 Aug 30 18:51:13.275967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3023/5907] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:13.407115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:13.416938 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-367bdcde-2a2a-4124-8fde-021cd463ac6b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.492508 Aug 30 18:51:13.433040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2885/5908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:12 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:13.497358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:13.498452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:13.510505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.511049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.511497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.512307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.512777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.513218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.598399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:13.599076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:13.618927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.619675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.625924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.626951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.627704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.630976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.883566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:13.892875 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d0f2cb82-8cb2-4cde-a8d9-0a1889054045 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.400206 Aug 30 18:51:13.906787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:13.909312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3024/5909] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:13 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:13.916170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:13.917025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:13.925613 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4532217-d480-432d-acb2-950f6393e64a tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.331881 Aug 30 18:51:13.925950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.926620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.927219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.929107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.929615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.930046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.935789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2886/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:13 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:13.953160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:13.957966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 0dd835a0-b401-4e66-9bd1-90b750fdc1ef] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:13.971141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.977353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.978048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:13.979208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:13.979913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:13.980363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.009098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] HTTP exception thrown: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Request method failure captured: Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef HTTP/1.1 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlwBML7XmS3_FR-fgLtyYKulfUoVb62ZwqAR3r2c3nw0nBa_brKiRa2-D31uq7rSzHsrWCv3NEtiew1CHsdHb0dA8ocJnZFNZ1SpnIE8WDAlQIU0oaNAXFFBz9gKf_3V53Avwd61yYNNEbHaaWsA9MO57vIFd_IIEbsgO7RRr7kCQlg Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ec2459b91ee14216ada0f7bcd20c843a Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesActionsTest-474673596 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesActionsTest-474673596 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ec2459b91ee14216ada0f7bcd20c843a Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesActionsTest-474673596 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesActionsTest-474673596-project Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1fd44912790c40adb4c1a1a82eebc8e2 Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesActionsTest-474673596-project Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '0dd835a0-b401-4e66-9bd1-90b750fdc1ef'} Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:14.010975 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Returning 404 to user: Instance 0dd835a0-b401-4e66-9bd1-90b750fdc1ef could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c1171ec-4e23-49d8-80eb-5f6cde31e24b tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef" status: 404 len: 111 microversion: 2.1 time: 0.075624 Aug 30 18:51:14.015036 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2887/5911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:13 2022] GET /compute/v2.1/servers/0dd835a0-b401-4e66-9bd1-90b750fdc1ef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:51:14.038432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:14.067106 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d352b94-0aae-42b0-b6a9-4f48d63104d1 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1211 microversion: 2.1 time: 0.156318 Aug 30 18:51:14.070312 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3025/5912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:13 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:14.080154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:14.080679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:14.091109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.091823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.092281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.093019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.093494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.093938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.101808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-296887122", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "6a671277-98f4-4d1a-b50b-484aab80f1e4"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:14.174209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] validate_networks() for [('6a671277-98f4-4d1a-b50b-484aab80f1e4', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:51:14.374155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:14.386935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7dcebdc-c6b0-4a37-92d2-878f05e1bf1a tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.310915 Aug 30 18:51:14.387908 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2888/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:14 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:14.440731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:14.441422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:14.448085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.448827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.449598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.450624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.451232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.451836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.474157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:14.610587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:14.619658 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5599106-d653-452c-8721-2f4a926c45a3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.182884 Aug 30 18:51:14.620238 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2889/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:14 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:14.708553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:51:14.709181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:51:14.709656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:51:14.710100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:51:14.710550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:51:14.733338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.733820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.734622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.735631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.736243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.736835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.773619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Getting quotas for project ec2459b91ee14216ada0f7bcd20c843a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:51:14.781913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Getting quotas for user 1fd44912790c40adb4c1a1a82eebc8e2 and project ec2459b91ee14216ada0f7bcd20c843a. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:51:14.802833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:51:14.806141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:51:14.876581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d159e92-0893-4299-ac51-bbfdd6851b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778817 Aug 30 18:51:14.887978 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3026/5915] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:51:14.902061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e1901353-d477-455b-9088-3bff8c7aecee tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:14.909702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e1901353-d477-455b-9088-3bff8c7aecee tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:14.917250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:14.917871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:14.952324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.952832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.953273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:14.953995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:14.954485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:14.957239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.132774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e1901353-d477-455b-9088-3bff8c7aecee tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:15.142305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e1901353-d477-455b-9088-3bff8c7aecee tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1213 microversion: 2.1 time: 0.251923 Aug 30 18:51:15.145852 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2890/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:14 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:15.158522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:15.159689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:15.179230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.180009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.180496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.184344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.185934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.187106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.232020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:15.244370 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40634810-1c48-4495-82ce-bc89c00795c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.332837 Aug 30 18:51:15.247207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3027/5917] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:14 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:15.276294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:15.277135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:15.293070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.293575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.300289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.302965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.303601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.316134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.594384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:15.606111 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85eadaab-7b31-47dc-93ce-8fc280b098c1 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.458661 Aug 30 18:51:15.609225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2891/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:15 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:15.627180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:15.628516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:15.638893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.641799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.644800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.645859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.646437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.646909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.734142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:15.745893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a08913c1-3c16-41d8-9d8f-a5bca201255b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1279 microversion: 2.1 time: 0.497513 Aug 30 18:51:15.758407 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3028/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:15 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1279 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:15.758407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:15.758407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:15.759510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.760203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.760837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.761788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:15.762487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:15.762987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:15.970525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:15.987502 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0ab69fd-d35d-4ae9-a695-58bf77189e61 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.374951 Aug 30 18:51:16.004708 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2892/5920] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:15 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:16.061201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12208996-872d-42ae-8edd-144b6d3d35c8", "tag": "113115e7-30fc-49d6-b4f3-1a1ca7c4cf86"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:16.084664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.085342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.085885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.111156 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] Creating event network-changed:113115e7-30fc-49d6-b4f3-1a1ca7c4cf86 for instance 12208996-872d-42ae-8edd-144b6d3d35c8 on n-h1-854119-10 Aug 30 18:51:16.125306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f3e88003-dc79-4c59-a27a-e0146f2e17c3 req-04717f53-350f-45cb-9144-f5117f03b329 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073231 Aug 30 18:51:16.126128 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2893/5921] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:16.167114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:16.168042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:16.181103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:16.187102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.192028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.194378 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a028804-3dd6-49db-878c-fd397770c59e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.445924 Aug 30 18:51:16.194524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.195259 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3029/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:15 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:16.195667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.203321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.203926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.270079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:16.271056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:16.285159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.285663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.286320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.287380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.288272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.288880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.380845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:16.399128 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4aed947f-8d88-4d3b-884d-63f4a2788e96 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1265 microversion: 2.1 time: 0.228267 Aug 30 18:51:16.399969 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2894/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:16 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:16.546018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:16.557078 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-563a5926-775e-4c8d-a005-74fb62d2a3c4 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.292871 Aug 30 18:51:16.558565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3030/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:16 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:16.629664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:16.630310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:16.639570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.640331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.641028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.644079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.644742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.645508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.771976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:16.778110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:16.795188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.795942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.798009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.799219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:16.802602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:16.803163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:16.816784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:16.859136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:16.870377 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06e0f18c-8a86-4990-8854-af90fd10737c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.244851 Aug 30 18:51:16.896234 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2895/5925] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:16 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.012329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:17.012935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:17.016129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:17.020756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.021626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.022237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.023180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.023791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.024370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.027416 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9ea3fd9e-dcfd-4ccc-9de5-d16abe04e6ff tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1279 microversion: 2.1 time: 0.262080 Aug 30 18:51:17.034481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3031/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:16 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.184480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:17.193405 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50afa51b-29ec-4560-8cc1-7210e33db169 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.187673 Aug 30 18:51:17.219701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:17.220165 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2896/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:17 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.222117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:17.233559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.234050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.234519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.235228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.237293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.237732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.422517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:17.424716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:17.438761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.440766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.441401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.443591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.450079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.451468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.468533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:17.491924 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-142e48bd-7c1c-4295-829f-85c5f5cb1666 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.276191 Aug 30 18:51:17.493270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3032/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:17 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.579310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:17.579920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:17.587579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.588474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.589173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.590018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.590628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.591421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.648181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:17.657840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14353d14-b374-40aa-ac82-0b76c44a86cc tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1283 microversion: 2.1 time: 0.240836 Aug 30 18:51:17.659835 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2897/5929] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:17 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.777056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:17.786712 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4c3013b8-757a-46dc-8084-9b17d05b9b14 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.211562 Aug 30 18:51:17.787772 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3033/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:17 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:17.916335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:17.918711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:17.940789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.941829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.942473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:17.943403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:17.948209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:17.949402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.052760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:18.053726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:18.063503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.064298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.064925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.065705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.066215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.066673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.221508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:18.231129 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b294a13a-0158-4dc8-992b-1a4459a54315 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1279 microversion: 2.1 time: 0.185128 Aug 30 18:51:18.239848 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3034/5931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:18 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:18.246397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:18.247177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:18.254937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.255625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.257172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.258015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.258603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.259135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.525672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:18.537866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b248cae3-e3b9-434d-83eb-a87466f3bbbe tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1676 microversion: 2.1 time: 0.296410 Aug 30 18:51:18.546532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3035/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:18 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:18.556940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:18.557801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:18.565799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.566538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.567073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.568149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.568867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.569376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.640384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:18.658314 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6bdc9fb8-d051-4932-ac9c-eb836e5ee381 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.763306 Aug 30 18:51:18.662827 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2898/5933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:17 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:18.681394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "name": "network-vif-plugged", "status": "completed", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:18.717701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.718605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.719258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.756607 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] Creating event network-vif-plugged:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:51:18.763439 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1413f0f9-7fb4-4dfc-898c-4caaadf9702e req-a72b1271-6623-4033-806d-288c96ed2051 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098768 Aug 30 18:51:18.766677 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2899/5934] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:18.769689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:18.775608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:18.776666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:18.779772 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58e5252e-e409-4c5c-a5bb-8b4a6a523127 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.229895 Aug 30 18:51:18.786266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.787804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.788479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.789451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:18.790123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:18.792897 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3036/5935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:18 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:18.797795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1814460262", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "5f9ad738-c57a-45b7-bdea-c33a1a270653"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:18.804426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:18.868490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] validate_networks() for [('5f9ad738-c57a-45b7-bdea-c33a1a270653', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:51:19.232353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:19.241877 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d516973-db77-484f-846c-8b12c4777c2a tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.473620 Aug 30 18:51:19.247042 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2900/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:18 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:19.252272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.258977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:19.273834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.278996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.279737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.280672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.281313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.281916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.480773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:51:19.481439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:51:19.482059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:51:19.482683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:51:19.483248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:51:19.496556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.497290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.497881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.498833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.499634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.500219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.517669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:19.524435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Getting quotas for project ffbb659f36e04de8ad08a44734f149ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:51:19.530889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Getting quotas for user 45b6df0080f64969b75f52895215b15c and project ffbb659f36e04de8ad08a44734f149ed. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:51:19.546727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:51:19.550438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:51:19.606013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-769b4fb8-baae-4b8f-81d2-15ed6b8c7831 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811821 Aug 30 18:51:19.609750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:19.613218 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3037/5937] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:51:19.618566 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9baa5091-988f-490a-b158-9e6135014e9d tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1393 microversion: 2.1 time: 0.370039 Aug 30 18:51:19.619338 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2901/5938] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1393 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:19.624470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.625301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:19.631927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.632638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.633217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.634105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.634869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.635338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.635605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.636138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:19.644154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.644721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.645167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.645892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.646510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.646952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.859076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:19.869470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aebccae5-ea14-4a59-9fd3-132cc723a694 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1279 microversion: 2.1 time: 0.254852 Aug 30 18:51:19.884360 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3038/5939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:19.889594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b019d406-bf37-4aef-87b7-0ff87d83acfb tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.890136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b019d406-bf37-4aef-87b7-0ff87d83acfb tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:19.935240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:19.944080 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b025d041-2909-4db5-9cb5-4c31338e70e2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1653 microversion: 2.1 time: 0.323227 Aug 30 18:51:19.954382 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2902/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1653 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:19.954382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.954382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:19.964234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:19.971448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b019d406-bf37-4aef-87b7-0ff87d83acfb tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:19.979748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b019d406-bf37-4aef-87b7-0ff87d83acfb tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1219 microversion: 2.1 time: 0.094537 Aug 30 18:51:19.982780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3039/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:19.995349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:19.995971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:20.018885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.019378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.019812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.020705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.021312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.021913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.266459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:20.276781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:20.279978 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4055ff27-8c26-4b7c-aa7a-4444dcbe2960 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.333498 Aug 30 18:51:20.281110 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2903/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:20.288586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:20.296280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.297036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.297643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.298072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:20.324518 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9eb3f900-9592-4ae4-8d1a-e0a368f22337 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.340580 Aug 30 18:51:20.325146 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3040/5943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:19 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:20.339020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Going to try to start instance {{(pid=122590) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 18:51:20.368625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:20.369536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:20.381168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.382858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.383668 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33ad92f6-378e-48e8-a3fd-816fe50389cd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action" status: 202 len: 0 microversion: 2.1 time: 0.100776 Aug 30 18:51:20.383983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.385260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.386156 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2904/5944] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:20 2022] POST /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:20.387957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.390977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.396915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:20.397876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:20.413985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.414799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.419328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.420462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.421123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.421735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.666630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:20.679999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07bb3c20-4096-4c7a-9025-a217c958cf62 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.323680 Aug 30 18:51:20.681747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3041/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:20 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:20.687885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:20.689892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:20.698622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.699510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.701069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.702026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.703176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.703817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.790605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:20.803051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8cbe58a2-7e06-4fbb-a812-b422997df275 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1662 microversion: 2.1 time: 0.411657 Aug 30 18:51:20.803682 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2905/5946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:20 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1662 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:20.853199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ff73cb-a669-4c45-ad73-8d2dae94182b", "tag": "95d42c7b-2efb-48a9-ad80-78dac82bfc7f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:20.864892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.865786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.866414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.892024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] Creating event network-changed:95d42c7b-2efb-48a9-ad80-78dac82bfc7f for instance 53ff73cb-a669-4c45-ad73-8d2dae94182b on n-h1-854119-10 Aug 30 18:51:20.898165 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cbd5cdbc-5d2a-4bb6-8358-7b8627ef9bdb req-611a88fa-a6b4-4a2e-990d-23c6a19571a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048637 Aug 30 18:51:20.899678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2906/5947] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:20.905163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:20.906391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:20.915431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.915962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.916491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.917453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:20.918074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:20.918784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:20.978326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:20.991299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6fe74fd4-e65b-482e-ba5d-75830afcd480 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1565 microversion: 2.1 time: 0.307604 Aug 30 18:51:21.008392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3042/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:20 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1565 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:21.020858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:21.021455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:21.038147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.038697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.039137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.040088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.040304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.040735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.204386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:21.220713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-606c2021-203e-4f37-9a14-c018f3d9f124 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.318840 Aug 30 18:51:21.222697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2907/5949] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:20 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:21.231903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:21.232884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:21.244305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.245124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.245569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.246306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.246797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.247239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.252453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:21.521215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:21.532573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-42b1f092-ffd5-4d47-829e-5732e2409911 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1565 microversion: 2.1 time: 0.307234 Aug 30 18:51:21.533172 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2908/5950] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:21 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1565 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:21.539824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:21.540933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:21.551074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:21.552825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.553470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.553924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.555020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.559563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.561666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.612144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:21.623173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-774b0bfe-256d-4f01-8f17-aa2820086c10 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1271 microversion: 2.1 time: 0.613482 Aug 30 18:51:21.624409 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3043/5951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:21 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1271 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:21.632753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:21.633973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:21.645422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.646061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.646838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.647707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:21.648236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:21.648732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:21.963061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:21.978389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8188387d-3012-4987-9641-ed0a4b0de5c4 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.442119 Aug 30 18:51:21.981428 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2909/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:21 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:21.988152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:22.001468 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ee224a3-0bcb-4837-8880-4ba2a61ee494 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.375475 Aug 30 18:51:22.002209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "name": "network-vif-plugged", "status": "completed", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:22.019967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3044/5953] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:21 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:22.027557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.028206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.028437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:22.028654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.029464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:22.038078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.039711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.040403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.041523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.042250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.042930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.044010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] Creating event network-vif-plugged:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:51:22.054594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-89bd5de0-0f1a-44da-92b4-b7d2853301f1 req-d2dfa259-eb47-4b71-9e73-b8b1b04321cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071272 Aug 30 18:51:22.055212 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2910/5954] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:22.067838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:22.068766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:22.079647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.080488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.080677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.081380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.081846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.082512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.279263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:22.293933 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ae36a0ca-88e0-41f6-9c90-f2a97f464b1f tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.271324 Aug 30 18:51:22.305799 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3045/5955] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:22 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:22.314595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:22.316298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:22.325155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.326228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.326808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.327550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.328107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.328634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.510657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:22.518824 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-566ccdd6-5f2b-4f99-814c-c0940f058a66 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1662 microversion: 2.1 time: 0.462310 Aug 30 18:51:22.519423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2911/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:22 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1662 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:22.620019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:22.629469 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-439331b5-3a69-4a8b-bc13-211f0469df66 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.321885 Aug 30 18:51:22.630694 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3046/5957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:22 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:22.645479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:22.646110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:22.653155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.653155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.653616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.654427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:22.654744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:22.655416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:22.736887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:22.745500 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-87f97066-1d56-4fc8-9ec1-a29ec743f742 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1277 microversion: 2.1 time: 0.104115 Aug 30 18:51:22.752101 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2912/5958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:22 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:23.002959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.004047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.012838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.013624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.014262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.015323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.016253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.016949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.035867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.036925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.054947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.055774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.056697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.059428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.060835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.062013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.262530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:23.274759 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7d20181e-aff0-4f4e-b5f5-57680691e716 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1268 microversion: 2.1 time: 0.275520 Aug 30 18:51:23.286628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3047/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:22 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1268 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:23.323001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.323345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.331910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.332297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.332740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.333467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.334263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.334906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.336740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:23.366077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06ef85e3-c659-4fa4-9d33-4dc46258e793 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.343284 Aug 30 18:51:23.367926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2913/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:23 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:23.539364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:23.541139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.541995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.548476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ba939a9b-bcac-4feb-9730-88244b887a81 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.230396 Aug 30 18:51:23.556293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.557091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.557764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.558977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.559909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.560634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.563610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3048/5961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:23 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:23.653484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.655255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.662988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.663484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.663925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.664630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.665255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.665844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.697161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:23.824913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:23.833196 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e97dba8f-6d50-4e90-8f53-b7fd71d29db2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1666 microversion: 2.1 time: 0.295926 Aug 30 18:51:23.841380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2914/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:23 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1666 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:23.841380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080dc8eb-2970-4c6a-83e9-d40b51febe32", "tag": "02b9ec2b-4503-414b-b23b-d482fa118e68"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:23.848237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.848755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.849189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.861318 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] Creating event network-changed:02b9ec2b-4503-414b-b23b-d482fa118e68 for instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 on n-h2-854119-10 Aug 30 18:51:23.868085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a5a1de26-049d-4c2a-8299-77e13624eca7 req-8080cd4d-41eb-4cd0-8968-3017016c1a17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Aug 30 18:51:23.870125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2915/5963] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:23.878436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:23.879200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:23.885656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.886152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.886642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.887389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:23.888013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:23.888454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:23.901221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:23.915675 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98d0985b-75ac-4aed-b4c0-fb4e222ab2e7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.266709 Aug 30 18:51:23.916728 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3049/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:23 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.022600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.023229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.030825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.031326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.031768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.032494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.032955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.033447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.204294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.214638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06e6f55e-7c63-4f6f-8fd8-471e4bec3ccb tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1565 microversion: 2.1 time: 0.197970 Aug 30 18:51:24.231496 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3050/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1565 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.237489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:24.249374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.250025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.250582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.321446 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] Creating event network-changed:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:51:24.326776 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3ccf3928-2b23-499f-bad6-0536cd23c830 req-03f8edc5-4aa9-493e-a548-45ba97f932cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093789 Aug 30 18:51:24.327648 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3051/5966] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:24.334273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.335051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.342173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.342815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.343260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.343975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.344429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.344859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.513706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.526609 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ccca81a-84d4-419e-b4da-0ac427d22f56 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.654841 Aug 30 18:51:24.527212 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2916/5967] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:23 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.532610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.533243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.539908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.540718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.541481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.543122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.543679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.544192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.601933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.612186 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8eacd59b-c3dd-435a-94fd-aded518d8959 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1458 microversion: 2.1 time: 0.282002 Aug 30 18:51:24.624258 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3052/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1458 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.633860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.634673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.640968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.641470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.641905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.643164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.643637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.644067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.754439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.769226 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b80c832-4097-4013-87a0-949cf1b92fa2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.240497 Aug 30 18:51:24.769826 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2917/5969] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.775577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.777166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.784576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.785936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.786504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.787236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.787859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.788441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.872432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.883286 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09367654-4644-41a3-b6b2-1e7804a8a364 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.257772 Aug 30 18:51:24.884065 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3053/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:24.937365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:24.938328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:24.948581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.948745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:24.949407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.950155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.951387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:24.952164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:24.952878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:24.957543 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a17b511a-2cf3-4a1f-a035-54b2b75c9027 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1458 microversion: 2.1 time: 0.186423 Aug 30 18:51:24.958568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2918/5971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1458 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:25.154675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:25.165153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4c007b2-8da5-4d59-a4e9-b381e09e0f54 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.231711 Aug 30 18:51:25.168011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3054/5972] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:24 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:25.551392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:25.552086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:25.558193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:25.561087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.561593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.562036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:25.562779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.563405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.563856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:25.792625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:25.793717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:25.804497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.805702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.806800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:25.807539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.807996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.808403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:25.902020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:25.911132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a17dcc05-9752-43ae-875e-4271bcca4a35 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.365000 Aug 30 18:51:25.912347 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2919/5973] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:25 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:25.917271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:25.918169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:25.925898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.926770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.927466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:25.928257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:25.928921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:25.929425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:26.047241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:26.056476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2a64a9f1-54dd-428c-b3bc-a48d8f53faa5 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.267874 Aug 30 18:51:26.057037 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3055/5974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:25 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:26.190971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:26.191645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:26.197972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:26.198520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:26.198963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:26.199680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:26.200137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:26.200566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:26.287369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:26.301018 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc87cb40-0b67-49c5-9913-227cecd1b502 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.387282 Aug 30 18:51:26.301628 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2920/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:25 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:26.351392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:26.365731 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93a8312b-4d72-46e6-aba6-3de36ccfd2cf tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.178864 Aug 30 18:51:26.366805 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3056/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:26 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:26.933476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:26.934124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:26.941447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:26.941940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:26.942706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:26.943455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:26.943908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:26.944539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.077340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:27.078116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:27.085971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.086614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.087288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.088061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.088724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.089230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.164752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:27.178780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a4b3ac3-2f6f-443e-be66-668f6871935d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.249300 Aug 30 18:51:27.180560 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2921/5977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:26 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:27.248327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:27.256683 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f696dae6-4b3e-4700-8c56-7aa57815ab0a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.183317 Aug 30 18:51:27.257272 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3057/5978] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:27 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:27.327042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:27.328394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:27.338443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.338961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.339825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.340905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.341390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.341838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.379643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff73cb-a669-4c45-ad73-8d2dae94182b", "name": "network-vif-plugged", "status": "completed", "tag": "95d42c7b-2efb-48a9-ad80-78dac82bfc7f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:27.400776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.401420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.402869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.434299 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] Creating event network-vif-plugged:95d42c7b-2efb-48a9-ad80-78dac82bfc7f for instance 53ff73cb-a669-4c45-ad73-8d2dae94182b on n-h1-854119-10 Aug 30 18:51:27.443303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f562b666-110e-4a3a-97a4-7ad4d9c0621a req-b8a7b1b7-331f-4dcd-875f-f0b91f383f61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067862 Aug 30 18:51:27.444226 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3058/5979] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:27.449624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:27.450334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:27.458544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.458956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.459320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.460035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.460487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.460912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.707084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:27.740060 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a3381b8-c2a4-4e39-b745-3ae33267911c tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.293297 Aug 30 18:51:27.758318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3059/5980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:27 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:27.763890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:27.771306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:27.774736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:27.775221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:27.775711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:27.780948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea0237b2-3241-4b9e-a909-c5079affd592 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.461404 Aug 30 18:51:27.785750 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2922/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:27 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:27.788963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] Creating event network-changed:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:51:27.793563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3bff2680-282c-42e1-8e94-8fb693e81b57 req-8658acb9-3073-4d3a-9087-330abb034f9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033639 Aug 30 18:51:27.794559 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3060/5982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:28.201783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:28.202502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:28.210134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.210767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.211295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.212085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.212614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.213157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.281041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:28.282851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:28.293421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.294436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.295189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.296297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.297683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.298498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.381877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:28.390687 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6d99da89-4e7b-4083-a1f9-320238c4b232 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.193566 Aug 30 18:51:28.402674 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2923/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:28 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:28.587502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:28.599271 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54e95fab-629e-4c54-8ef6-06e5274061c0 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.324428 Aug 30 18:51:28.625400 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3061/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:28 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:28.764546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:28.765176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:28.776338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.776973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.777437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.778204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.783415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.784061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.802876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:28.803488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:28.815687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.817262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.817987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:28.819312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:28.820034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:28.820666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.091435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:29.110095 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2cef3f21-91e7-4242-84df-fa78e514f7dc tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.349457 Aug 30 18:51:29.110732 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2924/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:28 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:29.254289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:29.262757 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60425d66-3a33-4358-9d42-fe998e7434a1 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1313 microversion: 2.1 time: 0.464216 Aug 30 18:51:29.263351 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3062/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:28 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:29.361126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:29.376025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:29.376799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:29.377676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.393180 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] Creating event network-changed:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:51:29.400141 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ba5927d0-27f4-4499-8657-117ffb3ee842 req-eb03b86a-53f9-4bd2-9878-cbe40672e45f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045901 Aug 30 18:51:29.401102 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2925/5987] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:29.413198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:29.413970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:29.426600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:29.427113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:29.427716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.428787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:29.429694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:29.429694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.511941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:29.604510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:29.614144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce52000f-1511-40c7-bf92-177c23331bc6 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.204864 Aug 30 18:51:29.615030 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3063/5988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:29 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:29.633705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:29.634763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:29.641707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:29.642556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:29.643171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.644138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:29.644667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:29.645432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:29.865623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:29.869443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:29.878694 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ed8006b-d42c-4cde-a5ff-bff89f9ce342 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.249203 Aug 30 18:51:29.880002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2926/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:29 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:30.128302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=24 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:30.132797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:30.133682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:30.140939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.141460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.141888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.142669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.143392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.143829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.284408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:30.285247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:30.293679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.294511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.295113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.296040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.296660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.297245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.312502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:30.322426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9fd19f65-fba0-4a87-8c52-a04308b1a0a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.194803 Aug 30 18:51:30.334509 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3064/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:30 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:30.512993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080dc8eb-2970-4c6a-83e9-d40b51febe32", "name": "network-vif-plugged", "status": "completed", "tag": "02b9ec2b-4503-414b-b23b-d482fa118e68"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:30.538494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.539271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.539719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.552078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:30.552648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] Creating event network-vif-plugged:02b9ec2b-4503-414b-b23b-d482fa118e68 for instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 on n-h2-854119-10 Aug 30 18:51:30.557810 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-78da313c-9c73-4dbc-b01a-a65f05f974f3 req-62f21e59-390c-41cc-bbcc-30e9d87cdb6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049146 Aug 30 18:51:30.558498 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3065/5991] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:30.562044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fec942e9-84c3-4cca-afd1-892d3f4c1188 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1497 microversion: 2.1 time: 0.281738 Aug 30 18:51:30.562675 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2927/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:30 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:30.636297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:30.637052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:30.644071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.644577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.645031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.645747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.646197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.646663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.796223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:30.805034 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9fe56f1-ea93-4e0f-8fac-960aa77c2d6e tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.173207 Aug 30 18:51:30.805835 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3066/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:30 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:30.899837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:30.900693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:30.907220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.907877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.908319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:30.909128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:30.909631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:30.910092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.045741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:31.046278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:31.052879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.053368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.053803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.054571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.055023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.055443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.058062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:31.066224 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dcfa8d18-12ff-41a6-b21f-07d0bef770af tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.170435 Aug 30 18:51:31.066832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2928/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:30 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:31.084773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:51:31.119320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:31.173717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d0ea403-94e9-4669-bc2a-76940e12e484 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 204 len: 0 microversion: 2.1 time: 0.131897 Aug 30 18:51:31.174863 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3067/5995] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:51:31 2022] DELETE /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:51:31.184231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:31.184856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:31.191569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.192340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.192833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.193605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.194051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.194528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.332268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:31.340992 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8efa024b-1d63-4e43-b81d-3885f1785fb0 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1503 microversion: 2.1 time: 0.160742 Aug 30 18:51:31.341751 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2929/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:31 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:31.347643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:31.348434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:31.355735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.356309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.356808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.357582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.358103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.358648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.417300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:31.436248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.437011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.437657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.451959 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] Creating event network-changed:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:51:31.457387 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9826d83e-d1a9-40f0-a9d5-132d75942663 req-25981c0f-e87a-494a-9dbd-40032c2dea00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043758 Aug 30 18:51:31.458010 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2930/5997] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:31.518180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:31.526733 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-903069e5-e706-4c23-a993-7ef8aeb32c3e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.185398 Aug 30 18:51:31.527295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3068/5998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:31 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:31.827684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:31.828333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:31.838325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.838853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.839301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:31.840548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:31.841175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:31.841620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.031004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:32.039403 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1d71870d-248a-4242-b928-ff57d1f868da tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1319 microversion: 2.1 time: 0.216360 Aug 30 18:51:32.040001 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2931/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:31 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:32.088271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:32.089126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:32.099106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.099893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.100527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.103002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.103577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.104063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.282964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:32.295184 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c069da3a-2840-4c32-a56c-632511d3401f tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.211396 Aug 30 18:51:32.295792 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3069/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:32 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:32.363941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:32.364577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:32.371851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.372354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.372804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.373539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.374006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.374469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.549742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:32.550767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:32.557324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.557868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.558253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.561761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.562267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.562732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.722104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:32.731999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73424339-c5fc-45e1-9232-90a6c94eeeec tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.187976 Aug 30 18:51:32.732648 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3070/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:32 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:32.737284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12208996-872d-42ae-8edd-144b6d3d35c8", "name": "network-vif-plugged", "status": "completed", "tag": "113115e7-30fc-49d6-b4f3-1a1ca7c4cf86"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:32.747155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:32.747621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:32.748042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:32.760230 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] Creating event network-vif-plugged:113115e7-30fc-49d6-b4f3-1a1ca7c4cf86 for instance 12208996-872d-42ae-8edd-144b6d3d35c8 on n-h1-854119-10 Aug 30 18:51:32.765404 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2f56574c-5a21-47e4-b496-4a75d6075eb6 req-4dd1207c-f2d4-4d33-91fb-bc89eb29e54b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 Aug 30 18:51:32.766105 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3071/6002] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:32.827177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:32.836373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1935fb9-680b-4313-bb87-4b6c5b92b001 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1503 microversion: 2.1 time: 0.476649 Aug 30 18:51:32.846491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2932/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:32 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1503 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:33.068470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:33.069355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:33.075868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.076361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.076794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.077681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.078459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.079342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.218332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:33.226882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b1d8677-c0d8-44bb-8bae-2a6b65ec6be3 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1509 microversion: 2.1 time: 0.162991 Aug 30 18:51:33.227481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3072/6004] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:33 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:33.248935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "318f6c0f-e4bb-409d-a0be-5d9f9a310c35", "device": "/dev/sdb"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:33.251527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:33.258285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.258828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.259354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.260101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.260597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.261042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.318020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:33.318750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:33.326209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.327035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.327708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.328641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.329991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.330705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.509360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:33.518356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34d0f814-19f5-46aa-ba93-1e7822502e33 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.204900 Aug 30 18:51:33.519538 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3073/6005] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:33 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:33.618020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ff73cb-a669-4c45-ad73-8d2dae94182b", "name": "network-vif-deleted", "tag": "95d42c7b-2efb-48a9-ad80-78dac82bfc7f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:33.637236 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0a5d7e4-2d97-4b02-8949-f327c9c40ca5 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "POST /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392379 Aug 30 18:51:33.638591 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2933/6006] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:51:33 2022] POST /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:33.655255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.656409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.656856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.671665 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] Creating event network-vif-deleted:95d42c7b-2efb-48a9-ad80-78dac82bfc7f for instance 53ff73cb-a669-4c45-ad73-8d2dae94182b on n-h1-854119-10 Aug 30 18:51:33.677704 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4d204b36-1fb6-45bc-b3ba-3bf79aa7e845 req-aa49935b-c37d-4c5c-ab6a-6b526d0b84f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067219 Aug 30 18:51:33.678668 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3074/6007] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:33.755885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:33.756767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:33.763413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.764124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.764376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.765274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.765949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.766517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.857579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:33.858293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:33.869793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.871290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.872093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.873376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.874058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.874731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.927533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:33.928993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:33.929926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:33.931199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lazy-loading 'fault' on Instance uuid 53ff73cb-a669-4c45-ad73-8d2dae94182b {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:51:33.946308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:33.962450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea19ab0e-dfd5-496e-b8fb-b7779980b4f8 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1267 microversion: 2.1 time: 0.209409 Aug 30 18:51:33.963108 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2934/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:33 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:33.984220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd44912790c40adb4c1a1a82eebc8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2459b91ee14216ada0f7bcd20c843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:33.992407 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b153c10-3638-4bbe-add3-bed85a9c9614 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 200 len: 1303 microversion: 2.1 time: 0.139075 Aug 30 18:51:33.993047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3075/6009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:33 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:51:34.541266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:34.541861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:34.549481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:34.549924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:34.550588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:34.551316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:34.551782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:34.552223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:34.690631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:34.699313 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8e823c19-705e-4245-937f-4e0a0bfb1917 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.162547 Aug 30 18:51:34.699907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2935/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:34 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:34.984709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:34.985473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:34.993253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:34.993757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:34.994189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:34.994972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:34.995433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:34.995853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.014220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:35.014936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] [instance: 53ff73cb-a669-4c45-ad73-8d2dae94182b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:35.021627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.022470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.022925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.023688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.024157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.024818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.041291 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] HTTP exception thrown: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Request method failure captured: Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b HTTP/1.1 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlwBML7XmS3_FR-fgLtyYKulfUoVb62ZwqAR3r2c3nw0nBa_brKiRa2-D31uq7rSzHsrWCv3NEtiew1CHsdHb0dA8ocJnZFNZ1SpnIE8WDAlQIU0oaNAXFFBz9gKf_3V53Avwd61yYNNEbHaaWsA9MO57vIFd_IIEbsgO7RRr7kCQlg Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: ec2459b91ee14216ada0f7bcd20c843a Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesActionsTest-474673596 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec2459b91ee14216ada0f7bcd20c843a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesActionsTest-474673596 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: ec2459b91ee14216ada0f7bcd20c843a Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesActionsTest-474673596 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesActionsTest-474673596-project Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1fd44912790c40adb4c1a1a82eebc8e2 Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesActionsTest-474673596-project Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '53ff73cb-a669-4c45-ad73-8d2dae94182b'} Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:51:35.043042 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] Returning 404 to user: Instance 53ff73cb-a669-4c45-ad73-8d2dae94182b could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c9545fc-b36c-4d29-bb92-de5329ef9875 tempest-VolumesActionsTest-474673596 tempest-VolumesActionsTest-474673596-project] 10.222.0.25 "GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b" status: 404 len: 111 microversion: 2.1 time: 0.034542 Aug 30 18:51:35.047161 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2936/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:35 2022] GET /compute/v2.1/servers/53ff73cb-a669-4c45-ad73-8d2dae94182b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:51:35.150710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:35.159316 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad4d4920-ad3b-4f06-80af-a0fe0a0efa2b tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1453 microversion: 2.1 time: 0.178724 Aug 30 18:51:35.160028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3076/6012] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:34 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:35.290561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:35.291215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:35.300809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.301360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.301844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.302605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.303080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.303517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.458485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:35.467666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7f3b9f90-94aa-437c-bbea-9c9a7430300d tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1453 microversion: 2.1 time: 0.181468 Aug 30 18:51:35.468494 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2937/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:35 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:35.722912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:35.724184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:35.732768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:35.735886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.736639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.738639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:35.740409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:35.741093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:35.742078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:36.021310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:36.030689 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9a415adb-e973-4d3a-b896-bda100dd73be tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.313382 Aug 30 18:51:36.032027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3077/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:35 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:37.063921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:37.069228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:37.101165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:37.102028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:37.104156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:37.107879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:37.108630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:37.110543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:37.550649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:37.567858 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5a57727e-b912-4404-bdf7-4a02fbac7eb8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.515963 Aug 30 18:51:37.573310 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2938/6015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:37 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:38.399356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12208996-872d-42ae-8edd-144b6d3d35c8", "tag": "113115e7-30fc-49d6-b4f3-1a1ca7c4cf86"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:38.413343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:38.414126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:38.414764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:38.448415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] Creating event network-changed:113115e7-30fc-49d6-b4f3-1a1ca7c4cf86 for instance 12208996-872d-42ae-8edd-144b6d3d35c8 on n-h1-854119-10 Aug 30 18:51:38.462194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-940c2082-61cd-415b-b3a8-9a34d828739a req-774c3d84-130b-4738-bcba-2a5a55c78968 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067110 Aug 30 18:51:38.469462 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3078/6016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:38.597953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:38.600171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:38.612575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:38.613493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:38.614113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:38.615082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:38.615723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:38.616313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:38.913433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:38.930770 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16d8d7e9-0175-4cad-8d7d-94062cc4d837 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.336730 Aug 30 18:51:38.933816 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2939/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:38 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:39.972168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:39.972871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:39.983301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:39.985164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:39.985856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:39.987583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:39.988769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:39.989629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:40.192640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:40.230657 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b26dd114-4470-4320-9d22-f18820594271 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.265402 Aug 30 18:51:40.245721 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3079/6018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:39 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:41.264524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:41.265377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:41.273090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:41.273813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:41.274437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:41.275366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:41.276003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:41.276427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:41.460438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:41.470494 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13619a83-5419-4d52-a7f4-b9b2941123f6 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.209755 Aug 30 18:51:41.471895 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2940/6019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:41 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:42.493098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:42.493637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:42.503198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:42.503963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:42.504404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:42.505310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:42.505934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:42.506855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:42.711058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:42.719200 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6deebbdb-0722-4873-8cc6-5c79a6eeffe4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.230466 Aug 30 18:51:42.719789 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3080/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:42 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:43.744535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:43.745197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:43.754633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:43.755164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:43.757744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:43.757744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:43.758230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:43.760028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:43.955764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:43.981054 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-330e1950-2239-400e-b6d6-d2e645d68fbf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1523 microversion: 2.1 time: 0.241475 Aug 30 18:51:43.989743 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2941/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:43 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:45.005404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:45.005999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:45.014276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:45.015133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:45.016244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:45.031012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:45.033693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:45.033693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:45.202193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:45.211789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b31b624e-c0ee-44e3-aec0-c749f5bab87a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1503 microversion: 2.1 time: 0.211025 Aug 30 18:51:45.213264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3081/6022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:44 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:51:45.240599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48853e77-f09c-4a98-ba93-ef8df9ce3a9e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'create', calling method: .version_select at 0x7f4e566175e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-172818448", "description": "tempest-description-948704069"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:45.520289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48853e77-f09c-4a98-ba93-ef8df9ce3a9e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.286058 Aug 30 18:51:45.521098 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2942/6023] 10.222.0.25 () {60 vars in 1180 bytes} [Tue Aug 30 18:51:45 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:45.535610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-172818448"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:45.540680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:45.562463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:45.565368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:45.565965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:45.567082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:45.567919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:45.568504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:45.752195 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Adding security group ed7d932c-eddc-4c6e-8d3d-0c2ed93f6130 to port 9fc3de90-506f-417f-954b-524295aad522 Aug 30 18:51:46.236480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36146823-4370-4cf9-bc17-debc66f9bdc3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action" status: 202 len: 0 microversion: 2.1 time: 0.705759 Aug 30 18:51:46.238386 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3082/6024] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:45 2022] POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:46.249591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-172818448"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:46.250257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:46.257207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:46.260800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:46.261314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:46.261772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:46.262933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:46.263450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:46.263897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:46.297747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:46.300880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:46.302166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:46.341168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] Creating event network-changed:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:51:46.350764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-843b9ac9-e5d4-488e-af86-d73469499570 req-0988385c-b882-4793-9610-012526376095 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102277 Aug 30 18:51:46.352049 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3083/6025] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:46.534539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.network.security_group_api [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Removing security group ed7d932c-eddc-4c6e-8d3d-0c2ed93f6130 from port 9fc3de90-506f-417f-954b-524295aad522 Aug 30 18:51:47.395294 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a233d950-3cc9-4ab6-a429-dd868e16a86a tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action" status: 202 len: 0 microversion: 2.1 time: 1.152770 Aug 30 18:51:47.396584 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2943/6026] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:46 2022] POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:47.408294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c22d33b-b505-4808-8821-ec18bd3b84c8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'create', calling method: .version_select at 0x7f4e55cc39d0>, body: {"pool": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:47.439114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:47.501358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:47.504165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:47.504908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:47.527488 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] Creating event network-changed:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:51:47.537719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bea90d72-473e-47c4-9b19-8dde42032a0f req-63d5daa0-43f9-4303-bb76-724a1ad5863b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106399 Aug 30 18:51:47.538813 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2944/6027] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:49.755147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c22d33b-b505-4808-8821-ec18bd3b84c8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.351792 Aug 30 18:51:49.755763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3084/6028] 10.222.0.25 () {60 vars in 1170 bytes} [Tue Aug 30 18:51:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:51:49.776214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.110"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:49.780011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:49.789129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:49.789939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:49.790569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:49.791629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:49.792388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:49.792984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:49.819241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:49.831099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:51:49.831628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquired lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:51:51.530688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Building network info cache for instance {{(pid=122590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:51:51.548480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:51.576828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:51.578808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:51.580056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:51.618171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] Creating event network-changed:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:51:51.632769 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0fa23c61-39d9-4b93-ab73-b4f64b6c2b68 req-72addd63-af4d-409c-ad53-d9d22661c8ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087557 Aug 30 18:51:51.635281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3085/6029] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:51.655307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:51.663040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:51.682851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:51.683386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:51.687095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:51.690480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:51.692618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:51.693087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:51.832210 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afe2f952-bd40-4383-856a-e04b81cab27b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action" status: 200 len: 24564 microversion: 2.1 time: 0.195136 Aug 30 18:51:51.834172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3086/6030] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:51 2022] POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action => generated 24564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 18:51:53.092720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Updating instance_info_cache with network_info: [{"id": "9fc3de90-506f-417f-954b-524295aad522", "address": "fa:16:3e:97:9b:3b", "network": {"id": "ec53fb27-260a-4eb9-b545-771c64a4c519", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1546400366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "47c518c70d2343d7990bf35ada05fc20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9fc3de90-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:51:53.124966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Releasing lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:51:53.126875 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e28e2fb-d56a-4721-95d7-fa36c55640f8 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action" status: 202 len: 0 microversion: 2.1 time: 3.355911 Aug 30 18:51:53.129002 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2945/6031] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:49 2022] POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action => generated 0 bytes in 3359 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:51:53.142846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.110"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:53.402798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:53.416290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:53.417878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:53.418586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:53.421116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:53.423275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:53.426271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:53.770279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 18:51:53.770779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquired lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 18:51:55.189230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Building network info cache for instance {{(pid=122589) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 18:51:55.202660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:51:55.224064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=72 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:55.226845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:55.227664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:55.228409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:55.247551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] Creating event network-changed:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:51:55.255078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9ea5050c-a06e-4aed-81b2-e43eb06daa60 req-4ff11c92-5dab-42e5-bec0-12b2184e66e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056446 Aug 30 18:51:55.256313 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2946/6032] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:51:56.442876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Updating instance_info_cache with network_info: [{"id": "9fc3de90-506f-417f-954b-524295aad522", "address": "fa:16:3e:97:9b:3b", "network": {"id": "ec53fb27-260a-4eb9-b545-771c64a4c519", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1546400366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "47c518c70d2343d7990bf35ada05fc20", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9fc3de90-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122589) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 18:51:56.467342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:51:56.473996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Releasing lock "refresh_cache-48d2a0de-02f0-4e9c-ad4b-374510aeaf61" {{(pid=122589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 18:51:56.475357 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e65e85b-7dcd-4dfa-8747-cb5faa3e7bb4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action" status: 202 len: 0 microversion: 2.1 time: 3.341153 Aug 30 18:51:56.478435 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3087/6033] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:51:53 2022] POST /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61/action => generated 0 bytes in 3343 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 18:51:56.486010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f4c62ffd-46f3-42d2-87ce-2ef979a316f4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '.version_select at 0x7f4e54090280>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:57.989687 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f4c62ffd-46f3-42d2-87ce-2ef979a316f4 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/59b235e3-a954-474b-80e1-7180e34a93af" status: 202 len: 0 microversion: 2.1 time: 1.508136 Aug 30 18:51:57.990717 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2947/6034] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:51:56 2022] DELETE /compute/v2.1/os-floating-ips/59b235e3-a954-474b-80e1-7180e34a93af => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:58.000834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a658d514-81b3-4351-ae01-848f505d781b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '.version_select at 0x7f4e56e66670>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:58.489594 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a658d514-81b3-4351-ae01-848f505d781b tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ed7d932c-eddc-4c6e-8d3d-0c2ed93f6130" status: 202 len: 0 microversion: 2.1 time: 0.493127 Aug 30 18:51:58.492430 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3088/6035] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 18:51:57 2022] DELETE /compute/v2.1/os-security-groups/ed7d932c-eddc-4c6e-8d3d-0c2ed93f6130 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:51:58.513344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:58.522077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:58.560384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:58.568334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:58.569517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:58.575630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:58.577941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:58.586943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:58.631532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:51:58.809597 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60bcd627-7bc5-4e4b-ba27-f3d128aea0f3 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "DELETE /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 204 len: 0 microversion: 2.1 time: 0.308362 Aug 30 18:51:58.812898 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2948/6036] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:51:58 2022] DELETE /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:51:58.823980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:51:58.825442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:51:58.835991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:58.836991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:58.837518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:58.838490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:51:58.839608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:51:58.840263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:51:59.160074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:51:59.195983 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5cec6831-3470-4a81-b7a3-4c0990e07bcf tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1509 microversion: 2.1 time: 0.369685 Aug 30 18:51:59.219868 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3089/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:51:58 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:00.233175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:00.234267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:00.244126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:00.245305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:00.246181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:00.247319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:00.247878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:00.248660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:00.462083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:00.471655 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3f1c2bfc-e1df-4489-a77c-02b142ce653e tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1509 microversion: 2.1 time: 0.242842 Aug 30 18:52:00.472781 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2949/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:00 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:01.496991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:01.497801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:01.508237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:01.509268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:01.509978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:01.511033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:01.511740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:01.512417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:01.695039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:01.706699 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3353496d-7656-4068-8309-19e07f193d53 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1509 microversion: 2.1 time: 0.213943 Aug 30 18:52:01.707363 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3090/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:01 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:02.644485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:02.647987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:02.657496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.658923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.659575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.660618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.661353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.662015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.719929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed338e3e-30e6-410e-9ae6-735336df8efa tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080248 Aug 30 18:52:02.721730 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2950/6040] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:52:02 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 18:52:02.729182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:02.731101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:02.739322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:02.743059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.744278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.744941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.746105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.746803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.747414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.747522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:02.762816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.763344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.763801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.764856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:02.765713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:02.766562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:02.920721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:52:02.921171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:52:02.921829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:52:02.927213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:52:02.928794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:52:02.984190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:02.995047 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-533cd213-c743-48e9-bf6e-741236262961 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1509 microversion: 2.1 time: 0.270417 Aug 30 18:52:02.996044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3091/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:02 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:03.003206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:03.004055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:03.013491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.014324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.014987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.016050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.016778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.017523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.029691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:03.037654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.038617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.039559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.040504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.041484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.042517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.047926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:52:03.090417 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a87b66f-f2f2-4d95-a317-45c62ddc448e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action" status: 202 len: 1136 microversion: 2.1 time: 0.358680 Aug 30 18:52:03.092267 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2951/6042] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:52:02 2022] POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action => generated 1136 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 30 18:52:03.097773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:03.098678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:03.108270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.108900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.109218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.109943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.110438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.111375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.191526 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3ddda06-80aa-4c37-8126-69b846984103 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 204 len: 0 microversion: 2.1 time: 0.190748 Aug 30 18:52:03.192829 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3092/6043] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:52:02 2022] DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:52:03.206326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:03.208327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:03.219274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.219762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.220196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.220996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.221454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.221879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.247143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lazy-loading 'services' on Instance uuid 080dc8eb-2970-4c6a-83e9-d40b51febe32 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:52:03.353363 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-793957a6-6fde-4106-a23b-fc4988e03736 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "DELETE /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32/os-volume_attachments/318f6c0f-e4bb-409d-a0be-5d9f9a310c35" status: 202 len: 0 microversion: 2.1 time: 0.259607 Aug 30 18:52:03.358083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2952/6044] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:52:03 2022] DELETE /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32/os-volume_attachments/318f6c0f-e4bb-409d-a0be-5d9f9a310c35 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:52:03.365266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:03.366171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:03.372830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.373349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.373794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.374558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.375029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.375471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.448138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:03.457879 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d09a79ba-b3f0-482c-96fd-3a7badcf60b9 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.263391 Aug 30 18:52:03.458640 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3093/6045] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:03 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:03.464029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d2a0de-02f0-4e9c-ad4b-374510aeaf61", "name": "network-vif-deleted", "tag": "9fc3de90-506f-417f-954b-524295aad522"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:03.475412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:03.476389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:03.476968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:03.495082 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] Creating event network-vif-deleted:9fc3de90-506f-417f-954b-524295aad522 for instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 on n-h2-854119-10 Aug 30 18:52:03.501541 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6b8a1298-57bb-4d5e-aad9-b2d5b68a8875 req-0aadca70-c3f6-4fb2-9bed-92dae88d5f0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041315 Aug 30 18:52:03.502481 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3094/6046] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:03.540076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:03.550614 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7cbe0f6-ab34-4ea9-a6a3-a46568980907 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1672 microversion: 2.1 time: 0.190817 Aug 30 18:52:03.551235 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2953/6047] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:03 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:04.018692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:04.019784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:04.026915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.027516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.027992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.029157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.029627 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.030044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.109175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:04.123101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f83f39e-d662-4b5b-a0fa-09c5ea9475ff tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1467 microversion: 2.1 time: 0.105325 Aug 30 18:52:04.123101 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3095/6048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:04 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1467 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:04.487199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:04.487816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:04.496170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.496706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.497166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.498411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.498889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.499334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.575446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:04.577670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:04.588934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.589609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.590128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.591555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:04.591555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:04.592162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:04.661678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:04.672107 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b75241b-494e-4f4a-8e86-af440e8feb8b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.188814 Aug 30 18:52:04.672949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2954/6049] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:04 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:04.767695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:04.777183 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac59b14e-0308-4f94-a188-a9154a4a16c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1672 microversion: 2.1 time: 0.207867 Aug 30 18:52:04.777797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3096/6050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:04 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:05.142457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:05.143186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:05.151243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.151734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.152186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:05.152911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.153384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.153796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:05.231748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:05.245307 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-124daca3-b9d9-4c28-b2d4-36da23dc7bb2 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1467 microversion: 2.1 time: 0.108460 Aug 30 18:52:05.260030 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2955/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:05 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1467 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:05.712526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:05.713958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:05.747588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.750838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.753018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:05.755099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.758623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.758623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:05.801626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:05.802250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:05.826639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.833007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.833672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:05.838499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:05.839082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:05.843508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:06.025722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:06.038692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-375e16ea-2f69-4894-8b72-cc0a07134a0e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1672 microversion: 2.1 time: 0.241787 Aug 30 18:52:06.060910 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2956/6052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:05 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:06.135302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:06.145409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bde62c9-00ba-4ec2-a900-299c471e8c65 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.450346 Aug 30 18:52:06.146599 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3097/6053] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:05 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:06.271380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:06.272344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:06.300062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:06.302861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:06.303644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:06.304652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:06.305144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:06.305595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:06.435253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:06.435908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:06.440480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:06.442210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lazy-loading 'fault' on Instance uuid 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:52:06.589655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4aae15e37234749a2acb425fa56b8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c518c70d2343d7990bf35ada05fc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:06.606321 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dacdc8c1-86f1-41a6-b303-1daccc819140 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 200 len: 1312 microversion: 2.1 time: 0.340283 Aug 30 18:52:06.606321 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2957/6054] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:06 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:07.070901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:07.071977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:07.078237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:07.098478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.098478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.103039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.105191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.106982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.111160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.173574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:07.174803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:07.191639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.193938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.195889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.198579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.200033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.200944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.237729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:07.271795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:07.284675 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9e4a8f0-9df9-4ea3-a7f9-cb108ffaf88e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1605 microversion: 2.1 time: 0.219626 Aug 30 18:52:07.285636 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3098/6055] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:07 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:07.634201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:07.634751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] [instance: 48d2a0de-02f0-4e9c-ad4b-374510aeaf61] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:07.646802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.647266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.650582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.651270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:07.651796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:07.652236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:07.688565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] HTTP exception thrown: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Request method failure captured: Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 HTTP/1.1 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlwGy0fKWGeTaf-0iMR0tgJmH-SOsRdj7xz3rrrDSDwVu6907lIIY25xJm_Uy0CzRxRY9R87UuIsrjRW0b0xtiZX8R7Wbcl-xbPiudBmfG9PNdGZIG0_cIHRkKQfQJX02JcSZC-zoz2GxB9eaErrk66A2ZLaZyRPeScxwJ9pDBL_4Nc Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 47c518c70d2343d7990bf35ada05fc20 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-757747219 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47c518c70d2343d7990bf35ada05fc20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/47c518c70d2343d7990bf35ada05fc20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/47c518c70d2343d7990bf35ada05fc20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_47c518c70d2343d7990bf35ada05fc20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-757747219 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 47c518c70d2343d7990bf35ada05fc20 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-757747219 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerRescueTestJSONUnderV235-757747219-project Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: c4aae15e37234749a2acb425fa56b8d5 Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-757747219-project Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '48d2a0de-02f0-4e9c-ad4b-374510aeaf61'} Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:07.701200 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. Aug 30 18:52:07.710051 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:07.714538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] Returning 404 to user: Instance 48d2a0de-02f0-4e9c-ad4b-374510aeaf61 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:52:07.721285 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcbf16e0-47d9-47e0-bf0f-98c2f8736091 tempest-ServerRescueTestJSONUnderV235-757747219 tempest-ServerRescueTestJSONUnderV235-757747219-project] 10.222.0.25 "GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61" status: 404 len: 111 microversion: 2.1 time: 0.090954 Aug 30 18:52:07.735421 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3099/6056] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:07 2022] GET /compute/v2.1/servers/48d2a0de-02f0-4e9c-ad4b-374510aeaf61 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:52:07.739698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:07.779945 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ad7a0b0-83e1-488c-befa-50b18be9c4a5 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.606434 Aug 30 18:52:07.799107 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2958/6057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:07 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:08.318683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:08.320597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:08.328935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.336785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.338311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.340718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.341464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.344780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.368205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:08.369491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:08.391671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.392883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.393718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.399384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.404644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.405507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.489050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:08.517791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3db2b61b-9d77-4cd5-a019-eb65ef4d5c2b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 200 len: 1605 microversion: 2.1 time: 0.204252 Aug 30 18:52:08.518584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:52:08.524549 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3100/6058] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:08 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:08.536397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:08.592778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.593583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.595269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.640107 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] Creating event network-changed:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:52:08.655068 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a40b873e-6230-4f97-9b50-621aa2095bcd req-86d467be-d2a5-4af3-a41f-16885b865147 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127120 Aug 30 18:52:08.657248 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3101/6059] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:08.671569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbda8ea-4642-479d-9f14-522a3cbcdc07", "name": "network-vif-deleted", "tag": "98f046a7-986f-4d6d-b8b6-8eba506d78ae"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:08.725421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.732698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.734180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.761209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04032e09-5881-4cf4-9c69-ec0cc86c772b tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 204 len: 0 microversion: 2.1 time: 0.400513 Aug 30 18:52:08.762414 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2959/6060] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:52:08 2022] DELETE /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:52:08.786713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:08.793037 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] Creating event network-vif-deleted:98f046a7-986f-4d6d-b8b6-8eba506d78ae for instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 on n-h2-854119-10 Aug 30 18:52:08.793649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:08.805609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0a0cc0cd-7daf-43c8-8944-24cacd37f962 req-065ef236-658c-4ff6-8e7a-dd3468d5521b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145273 Aug 30 18:52:08.809361 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3102/6061] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:08.820075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:08.825474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:08.833621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.834132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.838521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.843725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.852274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.852849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.855182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.855621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:08.856058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.856898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:08.857431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:08.859267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:09.192790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:09.207780 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4d1f666-9b83-49a7-b91e-350b770950d6 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.396658 Aug 30 18:52:09.208732 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3103/6062] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:08 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:09.553778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:09.557471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:09.577380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:09.579098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:09.580391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:09.582659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:09.583178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:09.584669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:09.586207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:09.606163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a504f76-5cf5-4f02-8e6e-a1245c67624d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1582 microversion: 2.1 time: 0.838720 Aug 30 18:52:09.607180 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2960/6063] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:08 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1582 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:09.630847 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 HTTP/1.1 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bfbda8ea-4642-479d-9f14-522a3cbcdc07'} Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:09.634771 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-696bd7b8-e6a2-43fe-8b79-20eb097d1974 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 404 len: 111 microversion: 2.1 time: 0.091537 Aug 30 18:52:09.650295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3104/6064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:09 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:52:09.653859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-153c85ac-b000-4822-b696-3408b308ee69 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '.version_select at 0x7f4e55b8fdc0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:09.718928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-153c85ac-b000-4822-b696-3408b308ee69 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697893927" status: 202 len: 0 microversion: 2.1 time: 0.071698 Aug 30 18:52:09.719865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2961/6065] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:52:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697893927 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:52:10.234267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:10.234963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:10.252167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:10.257098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:10.259593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:10.260774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:10.261448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:10.262041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:10.637413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:10.638534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:10.661934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:10.662595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:10.663182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:10.667384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:10.670430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:10.672167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:10.823385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:10.838944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21ec4d7a-6e61-45a6-aac3-ec2b6c3db8ef tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.608985 Aug 30 18:52:10.845670 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3105/6066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:10 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:11.439995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-481c4a83-2d55-4f78-a07c-fbe9cfc29b5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: .version_select at 0x7f4e55cc31f0>, body: {"keypair": {"name": "tempest-keypair-315296765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8z03aTwBJ4d65zo6P0Owdab2xy5sO+NQuej0s+B2yxX3nRR2GXQh69JnIHz7ijQoQx9tW8FdekjsKAeSb/z8pcq+aNrue8UndH1HU4a8QbjsvMQgb3efL1y/nSkvOstg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:11.464624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-481c4a83-2d55-4f78-a07c-fbe9cfc29b5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for project e2a9d975528d4fc5a070323842500908. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:52:11.473079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-481c4a83-2d55-4f78-a07c-fbe9cfc29b5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for user 504f1d4d8eb44acb8a1cf28fad277c0d and project e2a9d975528d4fc5a070323842500908. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:52:11.514930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:11.517958 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-481c4a83-2d55-4f78-a07c-fbe9cfc29b5d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086182 Aug 30 18:52:11.544584 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3106/6067] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:52:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:11.588300 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cfc0b1ce-630e-4844-9cb0-133feaa828a5 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1582 microversion: 2.1 time: 0.943037 Aug 30 18:52:11.609461 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2962/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:10 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1582 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:11.882512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:11.883277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:11.915266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:11.916010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:11.916544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:11.917406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:11.917960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:11.919615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:12.370077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:12.382719 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bb278cb-2907-4e4d-b744-9a614188768e tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.508814 Aug 30 18:52:12.383706 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3107/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:11 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:12.480517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6fbc93-6066-46ca-94a9-07ff9b2d9997", "name": "network-vif-deleted", "tag": "81748155-a499-4c0d-ac7e-0f7faed8956f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:12.524695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:12.525427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:12.525892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:12.573990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] Creating event network-vif-deleted:81748155-a499-4c0d-ac7e-0f7faed8956f for instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 on n-h1-854119-10 Aug 30 18:52:12.604821 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-5f340cbd-05d9-40a8-b9af-703b702d83e6 req-fce9da18-9550-4834-8e6f-7a3bfd2626a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131004 Aug 30 18:52:12.608797 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2963/6070] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:12.637628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:12.638797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:12.664111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:12.665522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:12.667839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:12.669514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:12.670663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:12.672484 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:12.687380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:12.849325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:12.908358 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5fdc21c-a374-4fa7-8e8b-2437654062db tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.270992 Aug 30 18:52:12.913374 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3108/6071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:12 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:13.411465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:13.412282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:13.432012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:13.432748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:13.433227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:13.435135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:13.435700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:13.436164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:13.832874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:13.849128 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0c72f34e-d3c5-4fdf-98e3-01ec7d25ad96 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.447240 Aug 30 18:52:13.856789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2964/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:13 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:13.936979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:13.942286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:13.967924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:13.974021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:13.975028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:13.976206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:13.977103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:13.977781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.075371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:14.093703 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-db772e98-f916-485d-8721-d197fa4f5738 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.159737 Aug 30 18:52:14.107396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3109/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:13 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:14.670192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:14.671024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:14.687501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.688311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.691446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.693117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.695300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.697057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.809954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:52:14.898875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:14.901122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:14.944723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.949354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.950827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:14.959683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:14.961791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:14.962491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.105394 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e70bc5f6-94f4-4b42-981a-d898a898e4c7 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "DELETE /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 204 len: 0 microversion: 2.1 time: 0.440250 Aug 30 18:52:15.110325 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2965/6074] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:52:14 2022] DELETE /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:52:15.129512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:15.130668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:15.151495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.165514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.166302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.169620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.170266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.172973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.380680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:15.400022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74094a00-a8c4-4115-a726-f099577520a6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.283253 Aug 30 18:52:15.417300 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2966/6075] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:15 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:15.423118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:15.425728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:15.454408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.459976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.459976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.461131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:15.462014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:15.462879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:15.485163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:15.501261 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9eaafba6-3f01-4b8f-aedb-c83fdd57a40b tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.612798 Aug 30 18:52:15.501261 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3110/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:14 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:15.506662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2140178558", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ae283a4-2e24-4d7a-af5c-43a1c3f20002"}], "security_groups": [{"name": "tempest-securitygroup--87438608"}], "key_name": "tempest-keypair-315296765", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:15.668061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] validate_networks() for [('8ae283a4-2e24-4d7a-af5c-43a1c3f20002', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:52:15.902637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:15.919068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f78496b9-7cd8-4356-b89d-74e5b84319dc tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1515 microversion: 2.1 time: 0.500209 Aug 30 18:52:15.935601 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2967/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:15 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:16.395605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:52:16.396553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:52:16.397447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:52:16.398677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:52:16.399475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:52:16.431041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.431930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:16.434608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.434963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:16.436029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.441877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.442845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.444299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.460251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.462548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.465127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.471199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.472147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.475604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.532593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for project e2a9d975528d4fc5a070323842500908. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:52:16.578550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Getting quotas for user 504f1d4d8eb44acb8a1cf28fad277c0d and project e2a9d975528d4fc5a070323842500908. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:52:16.631366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:52:16.639117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:52:16.662083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:16.676152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b424887f-c7d9-404d-a961-d1f732b7f52d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.255147 Aug 30 18:52:16.695575 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2968/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:16 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:16.703944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:16.708095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:16.726129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.726887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.727653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.728897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:16.729653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:16.730607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:16.787445 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6a6f6b44-4160-4547-81ef-ca54caf67d96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.288509 Aug 30 18:52:16.788585 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3111/6079] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:52:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:52:16.801969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4bebc600-d7d2-4e72-8d5c-0241b51d75df tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:16.803283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4bebc600-d7d2-4e72-8d5c-0241b51d75df tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:16.928619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4bebc600-d7d2-4e72-8d5c-0241b51d75df tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:16.945325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4bebc600-d7d2-4e72-8d5c-0241b51d75df tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1237 microversion: 2.1 time: 0.148340 Aug 30 18:52:16.945953 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3112/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:16 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:16.964019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:16.964019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:17.011943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:17.013112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.013650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.014111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.019022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.021401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.021892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.034390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-123f0aac-7a90-418f-8b1b-a15c32d97939 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1691 microversion: 2.1 time: 0.337024 Aug 30 18:52:17.035426 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2969/6081] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:16 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:17.321949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:17.341611 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-860b39e0-ce8c-4be5-a5c7-0843e9e675ef tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1515 microversion: 2.1 time: 0.385195 Aug 30 18:52:17.350649 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3113/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:16 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:17.711816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:17.715952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:17.729440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.730331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.731347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.732666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:17.734603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:17.735452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:17.840804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:17.873461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-534e05af-c364-4576-838b-3a2913f467c0 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.167940 Aug 30 18:52:17.875451 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2970/6083] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:17 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:17.987497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:17.991196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:18.032119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.034793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.036416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.044227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.056633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.059383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.065130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:18.066012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:18.075721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.079319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.080085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.082407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.087811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.088573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.266184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:18.282972 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-02ea3461-4043-43ac-bfae-bbb303980df5 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1233 microversion: 2.1 time: 0.306890 Aug 30 18:52:18.283591 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3114/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:17 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1233 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:18.378991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:18.380859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:18.391699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.392540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.393722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.394706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.395364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.396141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.555823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:18.572107 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-38ba71a3-d696-4c52-9b3e-c5b09014fda7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1697 microversion: 2.1 time: 0.511172 Aug 30 18:52:18.573251 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2971/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:18 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1697 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:18.631899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:18.654806 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f277da90-fb8e-43d2-8cd9-f653cbc0b00d tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1515 microversion: 2.1 time: 0.269570 Aug 30 18:52:18.655505 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3115/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:18 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:18.898585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:18.899215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:18.916095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.918549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.920747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.923619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.924903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.926768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:18.950310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080dc8eb-2970-4c6a-83e9-d40b51febe32", "name": "network-vif-deleted", "tag": "02b9ec2b-4503-414b-b23b-d482fa118e68"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:18.984566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:18.985301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:18.993509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.055327 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] Creating event network-vif-deleted:02b9ec2b-4503-414b-b23b-d482fa118e68 for instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 on n-h2-854119-10 Aug 30 18:52:19.078978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-84f94740-05c1-41fc-aafd-02bed6fc0fd2 req-f3582fd6-74fb-4756-8d2b-60358291e596 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131833 Aug 30 18:52:19.082800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3116/6087] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:19.310615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:19.312270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:19.336418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.339334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.344236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.345369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.347039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.350294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.444392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:19.455733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b12e5fb5-49b3-48e5-8f1a-4cd58d769d8d tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.561731 Aug 30 18:52:19.456355 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2972/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:18 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:19.552517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:19.564005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e20d4f4-50d5-4ece-8f54-c22f9a54bb49 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1307 microversion: 2.1 time: 0.259869 Aug 30 18:52:19.565469 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3117/6089] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:19 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:19.601248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:19.602080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:19.614250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.615728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.616559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.617499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.618494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.619374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.720179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1785597050", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": "none"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:19.803030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:52:19.803877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:52:19.804457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:52:19.804891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:52:19.805328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:52:19.816411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.817016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.817581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.818947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.819677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.820556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.844823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Getting quotas for project c1aed129f3a34f18914214fe625398d8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:52:19.852499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Getting quotas for user 0ea1d2a77a8d4d7e9c8091480a2b10cb and project c1aed129f3a34f18914214fe625398d8. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:52:19.900119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:19.908897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:52:19.913410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:52:19.916378 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9399a556-cce2-408f-88fc-5c3bea418303 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1697 microversion: 2.1 time: 0.319603 Aug 30 18:52:19.930395 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3118/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:19 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:19.934947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:19.936165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:19.972171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.973376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.974180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.975549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:19.976500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:19.977756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:19.988421 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f15d00b-c316-4bfe-82cf-35ab1af0cfdc tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.530862 Aug 30 18:52:19.989260 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2973/6091] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 18:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 18:52:20.001897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:20.003390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:20.077026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.077589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.077999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.078661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lazy-loading 'fault' on Instance uuid 080dc8eb-2970-4c6a-83e9-d40b51febe32 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:52:20.090759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.102731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.106337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.111948 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2295ec73-9151-48d2-b176-d48a66e0ffb0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1278 microversion: 2.54 time: 0.113241 Aug 30 18:52:20.113777 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2974/6092] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:19 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:52:20.181869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45b6df0080f64969b75f52895215b15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb659f36e04de8ad08a44734f149ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.197531 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-052a58d6-7b0d-4b57-ab47-d2867b04571b tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 200 len: 1309 microversion: 2.1 time: 0.273234 Aug 30 18:52:20.215756 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3119/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:19 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:20.481091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:20.482227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:20.498859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.499453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.511221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.512165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.514512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.515085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.545888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:20.593330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:20.597292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:20.629232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.631187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.632889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.639467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.646522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.648604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.650162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:20.659960 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4b9820db-b19c-47b7-8228-094708c78533 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.186243 Aug 30 18:52:20.660880 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2975/6094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:20 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:20.944582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:20.945468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:20.949890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:20.991759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:20.992848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:20.995626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:20.997403 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.003809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.004608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.071598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:21.101473 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d25daaac-f4e4-4908-b781-547da397513b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.518688 Aug 30 18:52:21.118959 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3120/6095] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:20 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:21.142804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:21.144641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:21.175596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.180725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.186540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.189649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.191610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.192333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.316414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:21.336493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:21.360305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:21.364202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1cd5e49e-006f-40e2-8634-6662024553af tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1282 microversion: 2.54 time: 0.231073 Aug 30 18:52:21.365677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3121/6096] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:21 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:52:21.383881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:21.384556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] [instance: 080dc8eb-2970-4c6a-83e9-d40b51febe32] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:21.397150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.398755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.400750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.401645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:21.403602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:21.404454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:21.436111 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] HTTP exception thrown: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Request method failure captured: Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 HTTP/1.1 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDls-JMgaRz2DSxgt0tBADOBfi3_XUxC7e_QlvHazu02-QUsjDnlPrt5-GmV3889BKeyuA_pcdNcppfnPb9ItKRQia6XRSeiCAixVeNSiMV7ydAdQrerOkSCgx4a3mDv6Lp_FPemspobO62gVUiPyhf8HGSA9JpyEzqyMrFlrkiBeHxE Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: ffbb659f36e04de8ad08a44734f149ed Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ffbb659f36e04de8ad08a44734f149ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: ffbb659f36e04de8ad08a44734f149ed Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-765647920 Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-VolumesSnapshotTestJSON-765647920-project Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 45b6df0080f64969b75f52895215b15c Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-VolumesSnapshotTestJSON-765647920-project Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '080dc8eb-2970-4c6a-83e9-d40b51febe32'} Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:21.445276 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] Returning 404 to user: Instance 080dc8eb-2970-4c6a-83e9-d40b51febe32 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:52:21.449055 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8855e048-62ea-4417-9a73-48d8e66b5f77 tempest-VolumesSnapshotTestJSON-765647920 tempest-VolumesSnapshotTestJSON-765647920-project] 10.222.0.25 "GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32" status: 404 len: 111 microversion: 2.1 time: 0.079909 Aug 30 18:52:21.450801 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3122/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:21 2022] GET /compute/v2.1/servers/080dc8eb-2970-4c6a-83e9-d40b51febe32 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:52:21.618272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:21.628198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f92f18a2-79d3-4b20-a2fc-1e63185121f0 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1682 microversion: 2.1 time: 0.688451 Aug 30 18:52:21.637282 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2976/6098] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:20 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1682 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:21.988230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:21.988903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:22.014127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.015203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.016799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.019217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.019973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.022834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.126944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:22.127646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:22.136063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061863de2d1e4af1bcc06732d60968a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb51c213c243445088964e31aa83abfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.139337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.140135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.140802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.141889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.142696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.144096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.145063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-70a12d02-707c-43a4-9036-c2f19445bf33 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 200 len: 1228 microversion: 2.1 time: 0.467325 Aug 30 18:52:22.175651 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3123/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:21 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 1228 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:22.208903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a", "tag": "bc70119b-d286-40ba-b2ca-55fa292bff6a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:22.234055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.236972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.237593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.276580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] Creating event network-changed:bc70119b-d286-40ba-b2ca-55fa292bff6a for instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a on n-h1-854119-10 Aug 30 18:52:22.288706 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-69656b88-bed1-440d-934c-2ea5b330f3f8 req-f9a0afa5-c532-4c82-be3e-945cf00bb1ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086487 Aug 30 18:52:22.289448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3124/6100] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:52:22.393546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:22.395054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:22.402657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.404012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.404773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.405669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:22.406722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:22.407320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:22.528579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.533879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.538380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.540051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:22.542014 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab2d22f3-0c31-456c-b7c6-3fd26c16bbb2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1348 microversion: 2.54 time: 0.154580 Aug 30 18:52:22.543349 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3125/6101] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:22 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1348 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:52:22.547419 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ecb6ac31-e1f1-42cf-b058-b9f7c5e5493d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.426644 Aug 30 18:52:22.548759 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2977/6102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:22 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:23.074035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "name": "network-vif-plugged", "status": "completed", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:23.128607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.135582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.136038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.167335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] Creating event network-vif-plugged:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:52:23.193993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:23.195390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] [instance: fe6fbc93-6066-46ca-94a9-07ff9b2d9997] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:23.202332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9109f07c-e69d-4bd8-b165-764bb42cf8c2 req-7f3677e5-1306-433c-bd19-e656e381b530 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140168 Aug 30 18:52:23.204490 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3126/6103] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:23.207952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.208725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.209340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.210096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.210787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.211367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.236896 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] HTTP exception thrown: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Request method failure captured: Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 HTTP/1.1 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlstS8AAp5zs387jfj278jKJi_929ALSj6TkdoFDbR8Dgin1mMVOFzqpo6fvmoWC7CRefiWAolOcltHLvnCNo96SLr8sJ28c7Wp7UcK0Qb5fnmKWGLDyMzWd8aY5OaD_Sk4RSc0wfiLqaJ7IkDReoBbWonDaS1v2ROP1KrR6WX8G40A Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: fb51c213c243445088964e31aa83abfd Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBackupRestore-1224707041 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb51c213c243445088964e31aa83abfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fb51c213c243445088964e31aa83abfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fb51c213c243445088964e31aa83abfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fb51c213c243445088964e31aa83abfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBackupRestore-1224707041 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: fb51c213c243445088964e31aa83abfd Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1224707041 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBackupRestore-1224707041-project Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 061863de2d1e4af1bcc06732d60968a5 Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBackupRestore-1224707041-project Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'fe6fbc93-6066-46ca-94a9-07ff9b2d9997'} Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:52:23.239890 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. Aug 30 18:52:23.244337 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:52:23.246215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Returning 404 to user: Instance fe6fbc93-6066-46ca-94a9-07ff9b2d9997 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:52:23.247415 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7bb0450-1a7c-4fb5-98da-89e6ace4530c tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997" status: 404 len: 111 microversion: 2.1 time: 0.080244 Aug 30 18:52:23.252865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2978/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:23 2022] GET /compute/v2.1/servers/fe6fbc93-6066-46ca-94a9-07ff9b2d9997 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:52:23.484161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5fde7003-6e74-4bf2-9a38-5d13f7990fd6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] Calling method '.version_select at 0x7f4e56c7bca0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:23.510728 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5fde7003-6e74-4bf2-9a38-5d13f7990fd6 tempest-TestVolumeBackupRestore-1224707041 tempest-TestVolumeBackupRestore-1224707041-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-490399035" status: 202 len: 0 microversion: 2.1 time: 0.030824 Aug 30 18:52:23.511654 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3127/6105] 10.222.0.25 () {58 vars in 1266 bytes} [Tue Aug 30 18:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-490399035 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:52:23.566532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:23.567262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:23.575386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.576144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.576790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.577677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.578606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.578914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:23.579679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.579935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:23.591956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.595371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.599374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.599374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:23.599374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:23.599374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:23.705459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:23.722138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:23.723876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:23.740243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-da4efe98-ced9-4885-a983-c40f38a4b3b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1336 microversion: 2.54 time: 0.175670 Aug 30 18:52:23.741293 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2979/6106] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:23 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1336 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:52:23.834945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:23.851225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9141bff0-9b76-42e4-87a8-d064da278fe7 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.285230 Aug 30 18:52:23.852042 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3128/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:23 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:24.778921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:24.779810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:24.787644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.788408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.789013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.791795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.792648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.793764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.882014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:24.883655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:24.908090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.909715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.912733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.913741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:24.917880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:24.918359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:24.961052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:25.005231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:25.007455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:25.009843 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-90448ebd-7e19-4cd4-af4b-2cd52edd1982 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1357 microversion: 2.54 time: 0.249231 Aug 30 18:52:25.011040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2980/6108] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:24 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 18:52:25.072807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0724de74-2a0d-458e-a9d5-22003e039e63 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Action: 'create', calling method: .version_select at 0x7f4e559b9af0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1842922140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyNy6k1FQa4AuGGOsRwbeT8h6DaFUG+papkxbqiDy2IAorn7qtkyNfEu5tLDRgjOfj0unWaBXJoqiNPIelhKA4a4gMB9AY+xMN+fOuW27uCC4Eb9Om5YX+IZ+yEejZYAg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:25.185765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0724de74-2a0d-458e-a9d5-22003e039e63 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Getting quotas for project c1aed129f3a34f18914214fe625398d8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:52:25.233543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-0724de74-2a0d-458e-a9d5-22003e039e63 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Getting quotas for user 0ea1d2a77a8d4d7e9c8091480a2b10cb and project c1aed129f3a34f18914214fe625398d8. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:52:25.306313 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0724de74-2a0d-458e-a9d5-22003e039e63 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.251519 Aug 30 18:52:25.307832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2981/6109] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 18:52:25 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 18:52:25.322018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1842922140", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:25.326212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:25.339085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:25.346160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:25.346752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:25.348348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:25.349199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:25.349706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:25.350158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:25.351357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:25.355206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac6366df-5998-42ca-aa32-66b4a9a2eca4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.478054 Aug 30 18:52:25.356541 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3129/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:24 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:25.687927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:52:25.691249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:52:25.694709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:52:25.695833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:52:25.706310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:52:25.997412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:26.022057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.026062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.030438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.034486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.036129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.037314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.156425 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-94df980f-8b04-4137-ba60-ccdc7ec9df1b tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "POST /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c/action" status: 202 len: 1140 microversion: 2.54 time: 0.840151 Aug 30 18:52:26.182872 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2982/6111] 10.222.0.25 () {62 vars in 1320 bytes} [Tue Aug 30 18:52:25 2022] POST /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c/action => generated 1140 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 18:52:26.189944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:26.191364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:26.228639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.232124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.235006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.239676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.243974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.247323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.386632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:26.388508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:26.412388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.413247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.414215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.415416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:26.419863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:26.423951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:26.484097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:26.492901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:26.516180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:26.521964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:26.530593 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-589697d6-d6d8-4729-b71e-56c71042efc4 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.342328 Aug 30 18:52:26.533397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3130/6112] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:26 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:26.840793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:26.864150 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16c922f4-534b-446f-93e1-6deab7c28ccd tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.478198 Aug 30 18:52:26.871307 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2983/6113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:26 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:27.569315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:27.571305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:27.584848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:27.603547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.606319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.607341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:27.612446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.613312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.615471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:27.861901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:27.888993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:27.889837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:27.902394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:27.910872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:27.920595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.921687 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f7e3721b-cba7-4f53-9cad-6484b74c78bb tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.359190 Aug 30 18:52:27.926111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.926948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3131/6114] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:27 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:27.927726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:27.931994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:27.932700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:27.933226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:28.203929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a", "name": "network-vif-plugged", "status": "completed", "tag": "bc70119b-d286-40ba-b2ca-55fa292bff6a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:28.223721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:28.235065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:28.235817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:28.246108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:28.296470 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] Creating event network-vif-plugged:bc70119b-d286-40ba-b2ca-55fa292bff6a for instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a on n-h1-854119-10 Aug 30 18:52:28.313512 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b0b8676e-6538-4acb-bbe5-7b6e68d997fa req-8ccb26a2-0865-4959-8e02-642113b89b04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113625 Aug 30 18:52:28.314528 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3132/6115] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:52:28.799902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:28.892681 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ff86292e-1ef7-4bfe-876f-eb83f2ee3498 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.979535 Aug 30 18:52:28.903720 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2984/6116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:27 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:52:28.965033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:28.967032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:29.005427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:29.005936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:29.006439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:29.007134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:29.007596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:29.008023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:29.264245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:29.282372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:29.286880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:29.291107 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff537590-61cd-4dd7-8452-274e5d09e551 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.339716 Aug 30 18:52:29.295180 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3133/6117] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:28 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:29.926225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:29.927248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:29.938549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:29.956332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:29.958991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:29.961880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:29.964714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:29.965583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:29.966492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.317082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:30.317737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:30.332730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:30.333782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:30.334223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.334987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:30.335420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:30.339956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:30.432554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:30.446296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:30.448064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:30.449304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ef722ce1-8ec5-4b47-918f-1ec34118d03c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.137090 Aug 30 18:52:30.455066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3134/6118] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:30 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:30.483418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:30.497219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c629206-be3b-48e1-907b-235880d58c0b tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1361 microversion: 2.1 time: 0.578853 Aug 30 18:52:30.516616 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2985/6119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:29 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1361 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:31.473517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:31.474835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:31.496924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.498459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.499142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.501480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.503285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.505218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.522114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:31.523743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:31.540872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.541402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.541866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.542638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.547647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.552206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.868559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:31.878295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-131f0fdf-b1cb-46d2-9419-3440ce80ba96 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1546 microversion: 2.1 time: 0.360403 Aug 30 18:52:31.879103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2986/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:52:31 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1546 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:52:31.903657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:31.904603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:31.912436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.913692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.914402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:31.915449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:31.916175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:31.916831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:32.023810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2dc45d80-0e69-4ac5-be83-181dae336fb0 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128120 Aug 30 18:52:32.030568 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2987/6121] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 18:52:31 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:32.304258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:32.317226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:32.320982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:32.323755 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ff0cf33-362b-46be-aa2a-646d86bd1cf6 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.854953 Aug 30 18:52:32.325439 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3135/6122] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:31 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:33.353794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:33.355692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:33.378460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:33.379359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:33.379479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:33.380199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:33.380682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:33.381126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:33.476728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:33.498458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:33.504483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:33.508596 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aacab997-996e-4724-8067-25b68fd5f1aa tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.163845 Aug 30 18:52:33.512658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2988/6123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:33 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:33.656180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a", "tag": "bc70119b-d286-40ba-b2ca-55fa292bff6a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:33.695643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:33.704415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:33.704953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:33.757999 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] Creating event network-changed:bc70119b-d286-40ba-b2ca-55fa292bff6a for instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a on n-h1-854119-10 Aug 30 18:52:33.778044 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ccdac48e-4475-4b79-b10b-b0d2aad1daad req-a68126dd-5abf-4ec3-8957-4fde26edeceb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126741 Aug 30 18:52:33.779748 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3136/6124] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:52:34.543021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:34.543945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:34.561543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:34.565084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:34.565776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:34.579735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:34.580620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:34.581342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:34.846116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:34.868373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:34.871833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:34.876813 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6bca3b04-7151-4dee-8be9-3df106ff4cae tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.337098 Aug 30 18:52:34.877703 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2989/6125] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:34 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:35.905199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:35.905993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:35.935458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:35.939552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:35.940247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:35.944999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:35.945819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:35.950067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:36.136851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:36.152449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:36.158104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:36.162235 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1721b9b-f7b1-4cc1-a01e-4ad2179038a0 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.264679 Aug 30 18:52:36.177213 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3137/6126] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:35 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:37.191955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:37.193458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:37.202506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:37.210338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:37.212627 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:37.214178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:37.215219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:37.218037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:37.218884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:37.443087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:37.490980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:37.493165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:37.497542 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92fe4bd0-cd32-4218-be1f-ac9e77f0a16f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.310097 Aug 30 18:52:37.498757 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2990/6127] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:37 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:38.524207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:38.525455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:38.536267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:38.543473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:38.544085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:38.544969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:38.545574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:38.546150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:38.620535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:38.633973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:38.636030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:38.637502 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f32ed4d-b8fc-4f90-9426-091d4e640885 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.118773 Aug 30 18:52:38.638852 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3138/6128] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:38 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:39.662250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:39.663642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:39.672021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:39.672863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:39.673660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:39.675265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:39.675969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:39.676671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:39.698049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:39.772878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:39.791495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:39.797240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:39.802134 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-174f3902-0206-4b5e-a573-90cd4afd0d0a tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.144780 Aug 30 18:52:39.804697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2991/6129] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:39 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:40.848116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:40.849511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:40.867618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:40.868498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:40.869173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:40.870165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:40.871477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:40.872136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:40.996037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:41.005700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:41.007853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:41.009416 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c1af019-dde0-4ec8-b4f1-92f3ff3224f2 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.165655 Aug 30 18:52:41.010293 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3139/6130] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:40 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:42.036200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:42.037561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:42.046993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:42.047862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:42.048916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:42.050398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:42.051086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:42.051889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:42.162075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:42.173006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:42.175374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:42.176907 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d098a706-7cf5-4689-bb51-0bea9e53c77c tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.147182 Aug 30 18:52:42.177712 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2992/6131] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:42 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:43.204801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:43.205440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:43.213578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:43.214098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:43.214577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:43.218911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:43.219392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:43.219924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:43.305157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:43.316589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:43.319383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:43.321421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb51646b-c502-4643-9546-c06141d97483 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.123524 Aug 30 18:52:43.322988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3140/6132] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:43 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:44.348124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:44.348748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:44.358455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:44.358993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:44.359621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:44.360379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:44.360966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:44.361406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:44.436014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:44.446039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:44.447525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:44.448864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61e2df3a-cde6-45c7-973a-3aec7a2e3a22 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.105800 Aug 30 18:52:44.449461 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2993/6133] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:44 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:45.474152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:45.474770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:45.481038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:45.481532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:45.482010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:45.482798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:45.483263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:45.483686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:45.551197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:45.562518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:45.565372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:45.567032 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-37895170-17cd-4cc0-9f5a-e990cc5b87de tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.097802 Aug 30 18:52:45.567911 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3141/6134] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:45 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:46.591987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:46.593440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:46.601282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:46.601963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:46.602613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:46.603662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:46.604352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:46.604977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:46.681992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:46.696043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:46.699505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:46.701085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-95384616-4b11-459e-91cf-00538e27054d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.113675 Aug 30 18:52:46.701909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2994/6135] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:46 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:47.746557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:47.747925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:47.756085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:47.756689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:47.757186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:47.757980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:47.758533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:47.759084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:47.856458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:47.886391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:47.886391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:47.886391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8e830b6d-3582-4ef9-8fdd-575f3d1ac618 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.163653 Aug 30 18:52:47.886391 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3142/6136] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:47 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:48.005624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:52:48.008141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:48.015499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:48.016956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:48.018235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:48.019312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:48.019795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:48.020846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:48.106183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a095ff8a-df21-4e91-b2ad-26bc80203594 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action" status: 200 len: 24557 microversion: 2.1 time: 0.105082 Aug 30 18:52:48.119097 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2995/6137] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:52:47 2022] POST /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208/action => generated 24557 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 18:52:48.911065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:48.911675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:48.922652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:48.923453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:48.925276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:48.926518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:48.927275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:48.927985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:49.030711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:49.040074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:49.041525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:49.042721 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d814ba5b-6387-4d7a-b45b-89755d96a738 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.135682 Aug 30 18:52:49.043287 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3143/6138] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:48 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:50.073282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:50.074011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:50.081893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:50.082430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:50.082891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:50.083626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:50.084098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:50.084535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:50.186119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:50.197151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:50.198656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:50.199886 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be4bc209-b10c-4199-a057-1dfe17e208ba tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.131199 Aug 30 18:52:50.200456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2996/6139] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:50 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:51.223922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:51.224674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:51.232237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:51.232724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:51.233146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:51.233868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:51.234316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:51.234955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:51.308399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:51.318799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:51.320577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:51.321843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9bf2c2a-6447-479c-acf0-d59e3d6776a5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.102111 Aug 30 18:52:51.322711 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3144/6140] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:51 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:52.346007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:52.346695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:52.351594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:52.356614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:52.357117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:52.357812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:52.358646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:52.359217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:52.359672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:52.431386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:52.441020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:52.442809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:52.444225 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-34027a0d-1b35-45ff-9833-01566acb111d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.102860 Aug 30 18:52:52.445144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2997/6141] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:52 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:53.475507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:53.476560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:53.490964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:53.491457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:53.491929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:53.492635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:53.493083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:53.493613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:53.602955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:53.612238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:53.613990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:53.615308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b36fbe2-3882-488d-805c-d63f5e27ae24 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.150170 Aug 30 18:52:53.621703 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3145/6142] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:53 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:54.639244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:54.639866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:54.650334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:54.650903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:54.651348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:54.652068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:54.652525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:54.652955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:54.723344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:54.733981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:54.736125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:54.737351 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-458e2e45-fba4-497a-bfac-11a96d0f16f9 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.102152 Aug 30 18:52:54.737920 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2998/6143] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:54 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:55.761185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:55.762545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:55.772542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:55.773449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:55.775258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:55.775258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:55.775258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:55.777288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:55.844714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:55.854328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:55.856175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:55.857579 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95809e00-f0df-4fe5-93f0-1f90906b844f tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.100385 Aug 30 18:52:55.871635 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3146/6144] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:55 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:56.888053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:56.889181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:56.902655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:56.903490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:56.904399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:56.906036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:56.907115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:56.908244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:57.008406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:57.018392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:57.020521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:57.021855 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a6ed9cd-a062-438d-8a7b-ffc4b6fb2352 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.141230 Aug 30 18:52:57.022569 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 2999/6145] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:56 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:58.046291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:58.047567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:58.057728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:58.058557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:58.059186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:58.060102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:58.060721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:58.061308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:58.066653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=96 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:52:58.135764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:58.151750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:58.153861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:58.155792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c07f5b23-c6ef-4b93-8660-d6fa206486b7 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.113350 Aug 30 18:52:58.171145 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3147/6146] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:58 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:52:59.185368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:52:59.185997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:52:59.198280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:59.199112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:59.199738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:59.200658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:52:59.201294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:52:59.201905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:52:59.330116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:59.351197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:59.354938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:52:59.359514 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28bf49f9-0d09-413e-b4c7-6b5044cf8433 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1409 microversion: 2.54 time: 0.178219 Aug 30 18:52:59.360939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3000/6147] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:52:59 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1409 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:00.386505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:00.387954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:00.389802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:00.390612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:00.398948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:00.410306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.410538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.410906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.412470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.412997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.413724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.413999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.414893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.415368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.415637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.415865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.416337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.456449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:53:00.590198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:00.592299 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5dcbb960-017e-4524-a9b5-e02ca1b83d7a tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 204 len: 0 microversion: 2.1 time: 0.207621 Aug 30 18:53:00.598696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3001/6148] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:53:00 2022] DELETE /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:53:00.604121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:00.605273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:00.607770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:00.611753 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f02aa790-9301-49c4-9720-1245b6065364 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1415 microversion: 2.54 time: 0.229799 Aug 30 18:53:00.626494 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3148/6149] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:00 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1415 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:00.626705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.626705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.626705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.632876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:00.632876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:00.635227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] Creating event network-changed:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:53:00.638778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.641667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9dded788-914b-4027-afed-d1ab497fe108 req-cf4d3f7b-204b-4e92-b856-b8dcf2c6acef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040894 Aug 30 18:53:00.642465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.642804 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3002/6150] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:00.643133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.644808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:00.653894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:00.654929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:00.852147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:00.862383 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b812807-1ef3-4145-bd8f-52509faede85 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1688 microversion: 2.1 time: 0.246640 Aug 30 18:53:00.862988 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3149/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:00 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:01.648449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:01.651338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:01.672896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:01.677336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:01.679050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:01.680865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:01.683877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:01.685946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:01.879242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:01.888055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:01.889947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:01.890848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:01.892816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:01.894183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3ce34be-c21e-4c5a-b95e-eec992e9bf23 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1415 microversion: 2.54 time: 0.254944 Aug 30 18:53:01.895362 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3003/6152] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:01 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1415 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:01.907793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:01.912675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:01.912675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:01.913335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:01.913892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:01.914435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:02.426486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:02.437986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bb5f201-51ce-4573-88dc-07b68a63876c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1688 microversion: 2.1 time: 0.556343 Aug 30 18:53:02.438975 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3150/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:01 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1688 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:02.919310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:02.921320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:02.929590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:02.930392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:02.931020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:02.931926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:02.932554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:02.933152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:03.026255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:03.050223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:03.051777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:03.053049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-409e959e-e353-45a6-a1aa-47e35f372793 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1415 microversion: 2.54 time: 0.138912 Aug 30 18:53:03.063600 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3004/6154] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:02 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1415 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:03.303930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e8faa7-0ba8-45af-a968-76e2dc6ce208", "name": "network-vif-deleted", "tag": "ca8f734c-6ea8-4c24-9ae4-14785d39f8cd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:03.316020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:03.316833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:03.317438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:03.331222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] Creating event network-vif-deleted:ca8f734c-6ea8-4c24-9ae4-14785d39f8cd for instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 on n-h2-854119-10 Aug 30 18:53:03.341571 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5fd70bfb-e8d7-482e-b875-632b33d90ba0 req-f7e6023d-2046-4fe5-9948-c37cbb11ec10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038132 Aug 30 18:53:03.342977 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3151/6155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:03.460760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:03.461645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:03.468817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:03.469771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:03.470420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:03.471341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:03.471953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:03.472546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:03.528797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:03.540309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:03.542001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:03.542788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lazy-loading 'fault' on Instance uuid 95e8faa7-0ba8-45af-a968-76e2dc6ce208 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:53:03.623665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087be4b9803348b5ac503a1576c890c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8da5657e864953b48bf5307f363139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:03.643243 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-47fd6d78-d463-4825-8c21-4efd93b4604f tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 200 len: 1357 microversion: 2.1 time: 0.186472 Aug 30 18:53:03.645727 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3005/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:03 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:04.084684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:04.085421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:04.093541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.094040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.094693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.095428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.095944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.096587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.223302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.237511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.240256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.241788 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d36d8b9a-129e-48fc-96f8-996e3790b41d tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1400 microversion: 2.54 time: 0.163265 Aug 30 18:53:04.242950 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3152/6157] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:04 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1400 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:04.265395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ce05fb6-9a58-4c8e-9470-bdfd2b26ed58 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '.version_select at 0x7f4e55bbe310>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:04.301719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ce05fb6-9a58-4c8e-9470-bdfd2b26ed58 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1842922140" status: 204 len: 0 microversion: 2.54 time: 0.039517 Aug 30 18:53:04.304006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3006/6158] 10.222.0.25 () {60 vars in 1319 bytes} [Tue Aug 30 18:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1842922140 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:53:04.322976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:04.324129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:04.332822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.333673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.334297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.335207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.335808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.336367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.398144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:53:04.553572 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-affde94b-6c1f-4686-8762-fca836129175 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 204 len: 0 microversion: 2.54 time: 0.234300 Aug 30 18:53:04.554427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3153/6159] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 18:53:04 2022] DELETE /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 18:53:04.562966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:04.564135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:04.578288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.578988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.579658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.580526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.581002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.587155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.664963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:04.665861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] [instance: 95e8faa7-0ba8-45af-a968-76e2dc6ce208] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:04.676340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.677121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.677957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.679591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:04.680343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:04.680591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.682311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:04.694540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.700723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] HTTP exception thrown: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Request method failure captured: Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 HTTP/1.1 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlo7eNdRA01I3W-MRgZkZv3teqriXS0Hi03L2b3Msm7JwKQE_nTf0o0CIFGNoHKhO-f1Qeq5DCjIw2QdxrbgWqsz9K_tWdWzAPtJTz3cfJ2WdlEJ1wYuXnR75h2o08zt8sWrNJOWUulBICPHel7lMev8oF9R_pmo7g9Yw9YtFUA69KU Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bf8da5657e864953b48bf5307f363139"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bf8da5657e864953b48bf5307f363139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bf8da5657e864953b48bf5307f363139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: bf8da5657e864953b48bf5307f363139 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1351480127 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 087be4b9803348b5ac503a1576c890c2 Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1351480127-project Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '95e8faa7-0ba8-45af-a968-76e2dc6ce208'} Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:04.702859 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. Aug 30 18:53:04.707701 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:04.708279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:04.709305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Returning 404 to user: Instance 95e8faa7-0ba8-45af-a968-76e2dc6ce208 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:53:04.710644 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f352a4d-39ff-4bb2-8eab-1fb171d85d7c tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208" status: 404 len: 111 microversion: 2.1 time: 0.049773 Aug 30 18:53:04.711159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f513ee08-28b7-4276-a1ca-4bb17b13312e tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1406 microversion: 2.54 time: 0.151015 Aug 30 18:53:04.726529 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3154/6160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:04 2022] GET /compute/v2.1/servers/95e8faa7-0ba8-45af-a968-76e2dc6ce208 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:53:04.726907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3007/6161] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:04 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:05.737208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:05.737964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:05.751507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:05.763207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:05.763689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:05.764467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:05.764941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:05.765383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:05.770533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:05.880280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:05.892254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:05.895269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea1d2a77a8d4d7e9c8091480a2b10cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aed129f3a34f18914214fe625398d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:05.896916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-56fb5cb4-ea4e-40aa-b92b-bf68db621cd5 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 200 len: 1406 microversion: 2.54 time: 0.165048 Aug 30 18:53:05.897647 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3008/6162] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:05 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 18:53:06.922102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:06.925230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] [instance: f91e900b-bf17-42fb-85b0-cb581cebec1c] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:06.964889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:06.966310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:06.971239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:06.973331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:06.974234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:06.974908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:07.014209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] HTTP exception thrown: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Request method failure captured: Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c HTTP/1.1 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlxjU-SEn5f6Uuyv7dneSTBH4z2KFHZvcaHGMDLB49H9Rc3kenEIN9W5Fa32lFIexXPqMyywKkP-Jr4KHS08fCdd0vlF3MukkTWbTdRU7LeZyPpMr4xF7KmKFAF650oXtuxPoAsPZPkuNq1-VoRwJWi7s8B2R7wIkGRAJSdliHuCIpg Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Openstack-Nova-Api-Version: 2.54 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: c1aed129f3a34f18914214fe625398d8 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerShowV254Test-1796520902 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1aed129f3a34f18914214fe625398d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1aed129f3a34f18914214fe625398d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1aed129f3a34f18914214fe625398d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1aed129f3a34f18914214fe625398d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerShowV254Test-1796520902 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: c1aed129f3a34f18914214fe625398d8 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerShowV254Test-1796520902 Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerShowV254Test-1796520902-project Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 0ea1d2a77a8d4d7e9c8091480a2b10cb Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerShowV254Test-1796520902-project Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f91e900b-bf17-42fb-85b0-cb581cebec1c'} Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:07.017125 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. Aug 30 18:53:07.021879 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:07.024068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] Returning 404 to user: Instance f91e900b-bf17-42fb-85b0-cb581cebec1c could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:53:07.025519 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-049c8226-f51a-454d-8dfa-bc33b1d278a1 tempest-ServerShowV254Test-1796520902 tempest-ServerShowV254Test-1796520902-project] 10.222.0.25 "GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c" status: 404 len: 111 microversion: 2.54 time: 0.108252 Aug 30 18:53:07.026617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3155/6163] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 18:53:06 2022] GET /compute/v2.1/servers/f91e900b-bf17-42fb-85b0-cb581cebec1c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:53:07.561459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:07.562204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:07.572669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:07.573201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:07.573653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:07.574417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:07.574896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:07.575338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:07.636490 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd3fd4b3-b6d7-4916-9392-270d59b47c4e tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/ips" status: 200 len: 144 microversion: 2.1 time: 0.079061 Aug 30 18:53:07.637432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3009/6164] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 18:53:07 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/ips => generated 144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:10.375630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d68f490a-717c-4c4e-be32-0b2768e3d108"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:10.378767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:10.402775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:10.403210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:10.403665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:10.404431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:10.404894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:10.405320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:11.057414 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e80710a-49c6-4b07-9d0f-4d798ab6b2f4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685545 Aug 30 18:53:11.058768 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3156/6165] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:53:10 2022] POST /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:13.722904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-906ae660-bb5a-43c4-b3f2-d19b60d28eb7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] Calling method '.version_select at 0x7f4e54099c10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:13.762638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-906ae660-bb5a-43c4-b3f2-d19b60d28eb7 tempest-TestNetworkAdvancedServerOps-1351480127 tempest-TestNetworkAdvancedServerOps-1351480127-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1111369701" status: 202 len: 0 microversion: 2.1 time: 0.044085 Aug 30 18:53:13.767083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3010/6166] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 18:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1111369701 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:53:23.561445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:23.562224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:23.565907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:23.569645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:23.589318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=9 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:23.596561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12208996-872d-42ae-8edd-144b6d3d35c8", "tag": "113115e7-30fc-49d6-b4f3-1a1ca7c4cf86"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:23.611789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:23.613102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:23.613735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:23.615185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:23.620045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:23.620752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:23.624785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:23.632323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:23.633025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:23.634404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:23.654144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] Creating event network-changed:113115e7-30fc-49d6-b4f3-1a1ca7c4cf86 for instance 12208996-872d-42ae-8edd-144b6d3d35c8 on n-h1-854119-10 Aug 30 18:53:23.663257 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6cdcc665-38c5-4b32-80c9-377a79a5ce22 req-8c7cc33f-ec03-4460-ade2-f07dad6505a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076891 Aug 30 18:53:23.664513 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3011/6167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:23.703332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:53:23.926878 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8a5a077-7239-4645-9d9d-7f237b479450 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 204 len: 0 microversion: 2.1 time: 0.371311 Aug 30 18:53:23.931003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3157/6168] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:53:23 2022] DELETE /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:53:23.942502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:23.942718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:23.961396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:23.962727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:23.963205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:23.966130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:23.966716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:23.967161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:24.227591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1086450896", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:24.348225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] validate_networks() for [('a736d63b-5e7d-4499-88da-1d0757a0c6cc', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:53:24.948662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:24.971067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b5a79c71-96e6-41ae-bf84-758c0e6ea30e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1578 microversion: 2.1 time: 1.037293 Aug 30 18:53:24.976012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3158/6169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:23 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1578 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:26.007602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:26.008259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:26.033138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:26.035694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:26.036255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:26.038004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:26.039400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:26.040684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:26.864205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:26.875046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f419d9af-d8c1-4b44-8d96-57b7e50c2d1e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1578 microversion: 2.1 time: 0.877511 Aug 30 18:53:26.876543 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3159/6170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:25 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1578 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:27.898878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:27.899688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:27.930467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:27.931160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:27.931622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:27.932961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:27.935250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:27.935900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:28.036961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:53:28.038235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:53:28.039116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:53:28.039950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:53:28.040955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:53:28.069785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:28.073600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:28.074138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:28.075030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:28.077378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:28.081828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:28.142214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Getting quotas for project 728ab02b517b4a4e8459726c69162d06. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:53:28.164805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Getting quotas for user e2bc7574f65541369d8fca3aa7292329 and project 728ab02b517b4a4e8459726c69162d06. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:53:28.222799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:28.228841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:53:28.232301 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-997c76e1-fcea-41d0-95b8-62ef61f9ca27 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1391 microversion: 2.1 time: 0.337906 Aug 30 18:53:28.233741 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3160/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:27 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:28.253646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:53:28.387505 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea6068e2-5dd8-4688-a107-08cd31693051 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.563522 Aug 30 18:53:28.397293 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3012/6172] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:53:28.404144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-980902c2-ce1f-48ab-837c-f1b06bdc84df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:28.404959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-980902c2-ce1f-48ab-837c-f1b06bdc84df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:28.527565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12208996-872d-42ae-8edd-144b6d3d35c8", "name": "network-vif-deleted", "tag": "113115e7-30fc-49d6-b4f3-1a1ca7c4cf86"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:28.564833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:28.570545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:28.571106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:28.621553 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] Creating event network-vif-deleted:113115e7-30fc-49d6-b4f3-1a1ca7c4cf86 for instance 12208996-872d-42ae-8edd-144b6d3d35c8 on n-h1-854119-10 Aug 30 18:53:28.636185 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-35817850-4efd-4ac9-a367-ed013d5fcd0a req-8c10aeb3-a65c-458a-8401-08a8b82dd5aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119962 Aug 30 18:53:28.636791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3013/6173] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:29.047490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-980902c2-ce1f-48ab-837c-f1b06bdc84df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:29.078807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-980902c2-ce1f-48ab-837c-f1b06bdc84df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1217 microversion: 2.1 time: 0.676076 Aug 30 18:53:29.082864 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3161/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:28 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1217 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:29.256362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:29.257270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:29.272940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:29.277121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:29.278459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:29.279788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:29.286501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:29.287310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:29.579752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:29.601842 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf63c604-1b57-4696-85d8-dd8079ceafe3 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.348382 Aug 30 18:53:29.604926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3014/6175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:29 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:30.113457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:30.118015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:30.154687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:30.156137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:30.157472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:30.161423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:30.180334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:30.183213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:30.627031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:30.627651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:30.651683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:30.654668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:30.655278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:30.656048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:30.666773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:30.667402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:30.699863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:30.727395 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04aa2cca-3499-4d85-a3a2-fd7784fd3037 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1213 microversion: 2.1 time: 0.618377 Aug 30 18:53:30.748785 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3162/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:30 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1213 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:30.964822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:30.981234 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dc5779c6-96da-4180-ad8a-d64a571cfc83 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.359922 Aug 30 18:53:30.985471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3015/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:30 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:31.092962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:31.095855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:31.107469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.108181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.108812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:31.109756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.113328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.114012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:31.166309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b554f2e8-7bf2-4eff-b0d6-b8dc7378eccf tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077356 Aug 30 18:53:31.179820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:31.180669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:31.184358 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3163/6178] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:53:31 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:31.189205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.190095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.190774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:31.193987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.194986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.195662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:31.261699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9ae33a0-22f5-4162-89f8-5ab80ab0b8f9 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108" status: 200 len: 194 microversion: 2.1 time: 0.086746 Aug 30 18:53:31.263485 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3016/6179] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 18:53:31 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:31.755053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:31.756193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:31.781980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.782558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.783002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:31.792986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:31.797860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:31.798681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:32.009650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:32.011038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:32.033254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:32.049573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:32.049573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:32.050439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:32.050886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:32.051563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:32.417372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:32.417372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-821af4ca-c3d0-49cd-acaf-7d24dc9280e9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.396465 Aug 30 18:53:32.417372 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3017/6180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:32 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:32.687127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:32.701922 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-81638e34-0b0b-4562-a7d3-68526df12f18 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1275 microversion: 2.1 time: 0.950771 Aug 30 18:53:32.704659 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3164/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:31 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1275 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:33.446946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:33.449547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:33.482680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:33.490194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:33.493044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:33.494879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:33.498631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:33.499521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:33.726033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:33.727302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:33.736830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:33.739860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:33.740788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:33.741760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:33.742560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:33.746020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:34.037363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:34.056874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:34.064650 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ba051ef-5715-4bbe-842f-dd0b29af7487 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.627818 Aug 30 18:53:34.084579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3018/6182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:33 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:34.092310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0672ce5f-be85-4d52-845c-b080a060edd6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1275 microversion: 2.1 time: 0.370124 Aug 30 18:53:34.099382 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3165/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:33 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:35.090039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:35.090721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:35.115175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.115427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.115914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.122996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.123676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:35.124301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:35.126072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.126900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.138418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.138927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.139367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.150616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.151322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.151785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.387886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:35.397997 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f007a1b4-7851-402e-9b22-ba8a02caa232 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.312599 Aug 30 18:53:35.406891 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3019/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:35 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:35.498272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e86167-5ed6-4f13-ab19-a6a3c909847f"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:35.501459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:35.522477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.523028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.523491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.524250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:35.524731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:35.525179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:35.551578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:35.560118 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e10c521e-e32e-4444-96d3-4a70a5ebd5ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1275 microversion: 2.1 time: 0.440501 Aug 30 18:53:35.567123 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3166/6185] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:35 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1275 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:36.261047 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf3f6b61-9c5d-432b-a6f6-3c7949e5745c tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "POST /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766903 Aug 30 18:53:36.264646 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3020/6186] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 18:53:35 2022] POST /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:36.428823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:36.430056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:36.448487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:36.451680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:36.454255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:36.455297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:36.457563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:36.458209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:36.707143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:36.718543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23e8c0fd-29cc-45c6-bdf9-4b52ca342632 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.294744 Aug 30 18:53:36.722061 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3167/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:36 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:36.729361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:36.734702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:36.748238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:36.749456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:36.751364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:36.753924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:36.755814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:36.756685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:37.286201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5f65a9f4-ee07-4bb4-ab3a-c2be8dd01768 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Action: 'create', calling method: .version_select at 0x7f4e558dba60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1063097857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9HTDxsXi5xgL2R+cYwP/W4prZb6uPvSQTgQK23hJoAvTsbC2CxBKiFKOHC3Q1p740cjnpJchi+XP5eZASMV8aIg0dWFuPGlytRCuzue7aKyVWJ7uzGv4lDL5W1XVmgTg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:37.325078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5f65a9f4-ee07-4bb4-ab3a-c2be8dd01768 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:53:37.335688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-5f65a9f4-ee07-4bb4-ab3a-c2be8dd01768 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for user ebbf64d66f9d412aaf33eb66c4438ab2 and project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:53:37.403255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:37.405376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5f65a9f4-ee07-4bb4-ab3a-c2be8dd01768 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.931226 Aug 30 18:53:37.413621 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3021/6188] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 18:53:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:37.415612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c7afc6b-c4e5-4fa4-b695-ba0cab13da8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.691991 Aug 30 18:53:37.420399 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3168/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:36 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:37.742034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:37.742803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:37.768760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:37.773292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:37.775586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:37.782041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:37.787790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:37.789858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:38.011239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:38.028381 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5ede453f-d61d-48d0-9841-4f80aedd5f59 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.290916 Aug 30 18:53:38.047191 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3022/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:37 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:38.444180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:38.445482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:38.461004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:38.464000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:38.470232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:38.471380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:38.472007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:38.472640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:38.916983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:38.945949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40722d80-ea31-48c3-9152-865ad421f81b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.502461 Aug 30 18:53:38.946733 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3169/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:38 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:39.069194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:39.069828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:39.072233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:39.096453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:39.098234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:39.098853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:39.099649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:39.108868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:39.111247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:39.388673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:39.407106 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-808f3fa9-d898-444d-a56f-3157d3e4740e tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.341881 Aug 30 18:53:39.409547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3023/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:39 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:39.673823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:39.688782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:39.702752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:39.704243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:39.705327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:39.722928 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] Creating event network-changed:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:53:39.731213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4e5918d4-39ce-46b6-be86-dd2d482b2876 req-2993dada-e02a-4f48-9891-730140aa8b2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061585 Aug 30 18:53:39.733333 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3170/6193] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:39.968567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:39.969559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:39.976437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:39.978149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:39.980687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:39.982767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:39.984357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:39.985716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:40.259449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1995379639", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1063097857", "security_groups": [{"name": "tempest-secgroup-smoke-223888144"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "78ed1180-9582-4bc0-bb9a-feafa201d638"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:40.313694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:40.344304 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f23826a-ac52-4548-9451-5981ba8d418d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.379787 Aug 30 18:53:40.348979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3024/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:39 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:40.432124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:40.432943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:40.440299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:40.441109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:40.442070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:40.443161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:40.445483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:40.447574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:40.569604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] validate_networks() for [('78ed1180-9582-4bc0-bb9a-feafa201d638', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:53:40.599534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:40.618573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e7a2587-2f19-4bd4-8e9e-309be56df8a5 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.188189 Aug 30 18:53:40.630379 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3025/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:40 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:41.371592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:41.373379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:41.413330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:41.414260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:41.417957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:41.419253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:41.420930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:41.421618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:41.717339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:41.732849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-125341df-685d-4734-80c1-5fad2af1a0cd tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.365358 Aug 30 18:53:41.753678 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3026/6196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:41 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:41.761294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:41.763216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:41.771133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:41.772066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:41.773872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:41.774897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:41.775747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:41.776337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:42.015400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:42.040755 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-30992181-bbf7-4412-8fae-1955b3e81a19 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 200 len: 1226 microversion: 2.1 time: 0.284180 Aug 30 18:53:42.043971 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3027/6197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:41 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 1226 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:42.468290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:53:42.475773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for user ebbf64d66f9d412aaf33eb66c4438ab2 and project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: dict_keys(['metadata_items']) {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:53:42.528401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:53:42.531037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:53:42.532055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:53:42.534369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:53:42.539291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:53:42.566241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:42.566775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:42.569664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:42.570928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:42.571667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:42.574402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:42.642864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:53:42.652825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Getting quotas for user ebbf64d66f9d412aaf33eb66c4438ab2 and project 118b28e48f2e4ec7b8496ee5dd6829bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:53:42.716457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:53:42.720074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:53:42.760085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:42.760867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:42.775426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:42.777711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:42.778379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:42.780505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:42.783034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:42.784312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:42.816077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-326d685b-082a-4310-8f09-7041afca3d7c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.563481 Aug 30 18:53:42.828784 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3171/6198] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:53:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:53:42.842375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb9808e5-20f5-432f-9f79-1dd437491254 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:42.849378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb9808e5-20f5-432f-9f79-1dd437491254 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:43.023588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb9808e5-20f5-432f-9f79-1dd437491254 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:43.039881 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb9808e5-20f5-432f-9f79-1dd437491254 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1303 microversion: 2.1 time: 0.206514 Aug 30 18:53:43.053518 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3172/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:42 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:43.064432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:43.068439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 12208996-872d-42ae-8edd-144b6d3d35c8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:43.086256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:43.087801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:43.089054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:43.090039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:43.091045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:43.095170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:43.128253 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 HTTP/1.1 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '12208996-872d-42ae-8edd-144b6d3d35c8'} Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:53:43.130230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 12208996-872d-42ae-8edd-144b6d3d35c8 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f77bb78e-2ee9-4683-9986-4e45d50b0eb6 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8" status: 404 len: 111 microversion: 2.1 time: 0.071507 Aug 30 18:53:43.134295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3173/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:43 2022] GET /compute/v2.1/servers/12208996-872d-42ae-8edd-144b6d3d35c8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:53:43.829015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:43.843258 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-88d3c475-945b-4dc8-a7c8-21b1f28f8d2b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 1.088793 Aug 30 18:53:43.844719 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3028/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:42 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:44.061316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:44.061936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:44.084592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:44.087237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:44.088191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:44.090245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:44.092066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:44.092516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:44.217611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:44.236481 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ddf0d3c-bca8-40ab-91ba-6fe68ec3bb91 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1355 microversion: 2.1 time: 0.178735 Aug 30 18:53:44.237539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3174/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:44 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1355 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:44.866304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:44.867690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:44.883095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:44.883868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:44.884477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:44.885513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:44.886187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:44.887180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:44.916422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:45.258555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:45.259477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:45.267615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:45.276807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:45.285142 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-965cf9d5-508e-4aa9-9067-00d64d68a0e2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.423185 Aug 30 18:53:45.288508 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3029/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:44 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:45.293886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:45.295958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:45.300933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:45.303849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:45.306869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:45.456723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:45.462668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:45.464128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:45.466971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2158e206-a372-4bcc-b7ec-61b25767a745 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1361 microversion: 2.1 time: 0.213692 Aug 30 18:53:45.474640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:45.475421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:45.475713 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3175/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:45 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:45.476501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:45.499169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] Creating event network-vif-plugged:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:53:45.509459 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fae184bb-e6ec-4f91-a435-189137804efd req-226c31b9-9985-4f7f-a9c0-145af34e16f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052127 Aug 30 18:53:45.511688 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3030/6205] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:46.313787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:46.315114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:46.324937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:46.326400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:46.327561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:46.331140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:46.331908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:46.333467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:46.498630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:46.501177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:46.517345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:46.517872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:46.518329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:46.530520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:46.531397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:46.531888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:46.633952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:46.648614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-959c56d5-0c76-47ca-b6fe-653a074faba2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1317 microversion: 2.1 time: 0.343432 Aug 30 18:53:46.665476 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3176/6206] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:46 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:47.014409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:47.031932 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e001b710-edda-4b0a-8d85-2c706b673fca tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1428 microversion: 2.1 time: 0.537977 Aug 30 18:53:47.045817 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3031/6207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:46 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1428 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:47.525951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf33bde1-b04a-4be1-aefa-b5955fb8e174", "tag": "2b443b93-e8d7-48f2-a419-815664f26781"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:47.550281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:47.554050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:47.556008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:47.583444 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] Creating event network-changed:2b443b93-e8d7-48f2-a419-815664f26781 for instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 on n-h1-854119-10 Aug 30 18:53:47.607142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-f042986e-ba4f-4ba7-9826-a01db1456f81 req-6d267f50-aa81-40de-9bb5-365b3d14625d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091787 Aug 30 18:53:47.611170 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3177/6208] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:47.673520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:47.674160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:47.677129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:47.684372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:47.685245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:47.685853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:47.686771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:47.687449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:47.688728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:47.984138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:47.999204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0176f74d-8699-4c7e-a525-34b0754391d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.330235 Aug 30 18:53:48.000070 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3032/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:47 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:48.054303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:48.055732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:48.064690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:48.069682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:48.071998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:48.072903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:48.075750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:48.076324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:48.232458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-866606792", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:48.325966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] validate_networks() for [('a736d63b-5e7d-4499-88da-1d0757a0c6cc', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:53:48.494714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:48.514792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-879c97fd-9e7c-4ef0-9c0d-5e6f1264dab7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1428 microversion: 2.1 time: 0.463269 Aug 30 18:53:48.518512 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3178/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:48 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1428 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:49.543087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:49.543762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:49.558584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:49.561022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:49.561974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:49.563547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:49.564272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:49.565190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:49.798919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:53:49.799392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:53:49.800199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:53:49.800954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:53:49.801420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:53:49.823572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:49.824159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:49.824629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:49.825470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:49.825951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:49.826422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:49.855006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Getting quotas for project 728ab02b517b4a4e8459726c69162d06. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:53:49.862325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Getting quotas for user e2bc7574f65541369d8fca3aa7292329 and project 728ab02b517b4a4e8459726c69162d06. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:53:49.890435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:53:49.893920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:53:49.929289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:49.941791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be826d5e-131c-4cb7-81c6-4462fdc4da58 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1428 microversion: 2.1 time: 0.401874 Aug 30 18:53:49.943874 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3179/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:49 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1428 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:50.012607 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fdaa2e74-e99a-4c6f-b67b-6b68f167086d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779497 Aug 30 18:53:50.013265 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3033/6212] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 18:53:50.026980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ebd3874f-a25a-49e3-9a77-0a056811c86c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:50.030150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ebd3874f-a25a-49e3-9a77-0a056811c86c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:50.136622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ebd3874f-a25a-49e3-9a77-0a056811c86c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:50.146838 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ebd3874f-a25a-49e3-9a77-0a056811c86c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1216 microversion: 2.1 time: 0.124084 Aug 30 18:53:50.163111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3180/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:50 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:50.976260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:50.977616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:50.984708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:50.985488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:50.986098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:50.987129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:50.987772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:50.988405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:51.169528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:51.171264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:51.190987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:51.192222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:51.195492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:51.198979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:51.200985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:51.201489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:51.202252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:51.215257 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32b1ce81-55e0-4140-93ce-e2e50468e297 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1428 microversion: 2.1 time: 0.244926 Aug 30 18:53:51.243229 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3034/6214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:50 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1428 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:51.352543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:51.362850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ee478a2-8d49-41b4-aeb3-74634f8b2edc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1268 microversion: 2.1 time: 0.198093 Aug 30 18:53:51.363989 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3181/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:51 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:52.182570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf33bde1-b04a-4be1-aefa-b5955fb8e174", "name": "network-vif-plugged", "status": "completed", "tag": "2b443b93-e8d7-48f2-a419-815664f26781"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:52.194409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:52.195319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:52.195978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:52.209756 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] Creating event network-vif-plugged:2b443b93-e8d7-48f2-a419-815664f26781 for instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 on n-h1-854119-10 Aug 30 18:53:52.215336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c0117009-880d-477f-885e-f134fb46c2d1 req-7956a0b5-1fe1-4889-b15d-5521384292ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036589 Aug 30 18:53:52.216668 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3035/6216] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:52.253550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:52.254196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:52.263331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:52.263970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:52.264385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:52.265107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:52.265688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:52.266128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:52.384883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:52.385872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:52.393031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:52.393599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:52.394203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:52.395000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:52.395474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:52.396127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:52.469704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:52.478602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab81f96d-817b-4cbf-8c04-456ecc61d2ef tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1274 microversion: 2.1 time: 0.098720 Aug 30 18:53:52.479185 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3036/6217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:52 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:52.516901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:52.525493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0137e838-d06f-4e82-b22f-9e18d765dfd5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1428 microversion: 2.1 time: 0.276804 Aug 30 18:53:52.526259 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3182/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:52 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1428 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:53.368144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1708c9b-f31d-4de0-9edc-65108a7fcc95", "tag": "36af4548-462e-477a-9fb3-2ef8c23647fb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:53.381029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.381634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.382080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.394606 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] Creating event network-changed:36af4548-462e-477a-9fb3-2ef8c23647fb for instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 on n-h2-854119-10 Aug 30 18:53:53.399627 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c3650e6d-1c86-47ba-a218-fb9023a8140d req-3470f791-d4b1-4687-b478-4faa0739b319 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045869 Aug 30 18:53:53.400244 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3037/6219] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:53.500884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:53.501466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:53.507120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:53.510368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.511106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.511779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.512841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.513373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.514003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.550181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:53.550945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:53.558362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.559340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.560004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.560946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.561629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.562395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.735272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:53.745220 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-18293d64-5df0-4847-af0c-1f98f6f70589 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.248456 Aug 30 18:53:53.745944 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3183/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:53 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:53.789907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:53.802279 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96bcb11e-bfb3-491f-811e-752c45dfd37c tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1607 microversion: 2.1 time: 0.257196 Aug 30 18:53:53.817833 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3038/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:53 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1607 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:53.824994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:53.825844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:53.832308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:53.834652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.835272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.835706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:53.836640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:53.837091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:53.837504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.037390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:54.046168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-77687745-4367-44f5-a027-f3731dfebd60 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1607 microversion: 2.1 time: 0.225306 Aug 30 18:53:54.060797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3184/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:53 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1607 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:54.067336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:54.067941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:54.070030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:54.075954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.076464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.076919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.077757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.078278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.079027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.304798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:54.313144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c6fb750-bd7c-41e0-9d44-0b631b86fd2e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1607 microversion: 2.1 time: 0.250207 Aug 30 18:53:54.314017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3039/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:54 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1607 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:54.461814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:54.462780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f695b42-5e5d-4e45-a3c6-d270d607b8f6", "tag": "74e409c3-1d7b-41b2-baf9-1ffcebc833ea"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:54.463291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:54.472534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.473038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.473567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.474501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.474967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.475903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.477404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.477943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.478585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.496754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] Creating event network-changed:74e409c3-1d7b-41b2-baf9-1ffcebc833ea for instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 on n-h1-854119-10 Aug 30 18:53:54.503204 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1f46a418-63c8-4b17-a36e-a6ad4f6ca2d8 req-f3c297a8-9c77-4ac3-94f4-8880652a4ffb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044918 Aug 30 18:53:54.508576 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3040/6224] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:54.521213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:53:54.644989 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1899e6b-b669-45fa-86a0-fe40442523aa tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 204 len: 0 microversion: 2.1 time: 0.190087 Aug 30 18:53:54.645818 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3185/6225] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:53:54 2022] DELETE /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:53:54.656948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:54.657940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:54.668410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.669254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.669938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.671314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.672508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.673224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.767965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:54.769051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:54.781232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.782119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.782894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.784033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:54.784726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:54.785910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:54.847889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:54.858242 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d673539e-4729-4f92-83d9-6f30a058ec3a tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1577 microversion: 2.1 time: 0.206735 Aug 30 18:53:54.859478 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3041/6226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:54 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:55.345904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:55.361093 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cf6aeff5-4ba2-454d-b424-e38d83d6346f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.592872 Aug 30 18:53:55.362676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3186/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:54 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:53:55.881661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:55.882456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:55.889997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:55.890547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:55.891255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:55.892070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:55.892558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:55.893060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.255516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:56.264672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb12d425-6b39-4e42-b6b0-f9f8f726ebf9 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1577 microversion: 2.1 time: 0.387103 Aug 30 18:53:56.266057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3042/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:55 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1577 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:56.380664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:56.381351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:56.388963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.389651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.392294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.393095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.394799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.400861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.440784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:56.443084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:56.454929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.455438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.455887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.456620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.457085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.457827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.492177 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8ad715d3-dc1b-4e61-96a9-c3e255a61f64 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055841 Aug 30 18:53:56.492943 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3043/6229] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:53:56 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:53:56.631742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:56.632649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:56.639005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.639749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.640178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:56.640757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.641744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.642447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.643092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.653273 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-34d383a3-9255-49e7-93c4-5f51956dbd38 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.276593 Aug 30 18:53:56.654136 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3187/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:56 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:56.679103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80629160-3ca8-4d4a-ba9c-51ba75f7b757 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108" status: 200 len: 194 microversion: 2.1 time: 0.051366 Aug 30 18:53:56.679987 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3044/6231] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 18:53:56 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:56.693750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:56.694569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:56.700963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.701448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.701884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.702611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.703162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.703720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.791548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f695b42-5e5d-4e45-a3c6-d270d607b8f6", "name": "network-vif-deleted", "tag": "74e409c3-1d7b-41b2-baf9-1ffcebc833ea"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:56.801847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:56.802648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:56.803257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:56.817155 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] Creating event network-vif-deleted:74e409c3-1d7b-41b2-baf9-1ffcebc833ea for instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 on n-h1-854119-10 Aug 30 18:53:56.819386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lazy-loading 'services' on Instance uuid 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:53:56.824190 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-31b5bdfb-9018-423e-ab75-ddb9233a4fdf req-bf928c24-f756-45ac-ae0c-2610cb145858 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036272 Aug 30 18:53:56.826518 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3045/6232] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:56.919334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6add2508-72b3-41db-b14a-9699ce3e5419 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108" status: 202 len: 0 microversion: 2.1 time: 0.232733 Aug 30 18:53:56.920233 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3188/6233] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:53:56 2022] DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/d68f490a-717c-4c4e-be32-0b2768e3d108 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:53:57.289804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:57.290753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:57.308245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:57.308858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:57.309383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:57.310148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:57.310648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:57.311091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:57.351513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf33bde1-b04a-4be1-aefa-b5955fb8e174", "tag": "2b443b93-e8d7-48f2-a419-815664f26781"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:57.385096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:57.388866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:57.389633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:57.420009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] Creating event network-changed:2b443b93-e8d7-48f2-a419-815664f26781 for instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 on n-h1-854119-10 Aug 30 18:53:57.426392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-dd5aa5bf-fac9-46f4-b2c3-d445f81729f2 req-b6bdc26d-285d-4e24-bbc7-64f2d4793497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079425 Aug 30 18:53:57.431696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3189/6234] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:57.471491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:57.482676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d645be0a-7497-4ca6-b312-456be370ca55 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1225 microversion: 2.1 time: 0.198285 Aug 30 18:53:57.494370 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3046/6235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:57 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:57.678518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:57.679630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:57.690409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:57.693619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:57.694317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:57.695108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:57.695739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:57.696170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:57.897506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:57.905756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-49c453ba-793f-4584-8056-50aaec1482c9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.233708 Aug 30 18:53:57.911354 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3190/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:57 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:58.507013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:58.507641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:58.515687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:58.517027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:58.518370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:58.519240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:58.519749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:58.520174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:58.595539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:58.604396 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74a7c2e5-7757-4290-92f2-c06123c7d402 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1225 microversion: 2.1 time: 0.101805 Aug 30 18:53:58.617725 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3047/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:58 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:58.932173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:58.932783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:58.940402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:58.940884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:58.941312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:58.942022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:58.942498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:58.942917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:59.084458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:59.092620 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e5470252-66c6-4dba-b450-19ab199dc38e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.164416 Aug 30 18:53:59.093471 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3191/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:58 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:53:59.368554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1708c9b-f31d-4de0-9edc-65108a7fcc95", "name": "network-vif-plugged", "status": "completed", "tag": "36af4548-462e-477a-9fb3-2ef8c23647fb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:53:59.382267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:59.382804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:59.383475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:59.395666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] Creating event network-vif-plugged:36af4548-462e-477a-9fb3-2ef8c23647fb for instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 on n-h2-854119-10 Aug 30 18:53:59.402545 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7e810935-b405-414a-83a3-070e5611886f req-dd3d705b-5468-4f53-8cdb-61806a9513be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039258 Aug 30 18:53:59.403147 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3048/6239] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:53:59.625665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:53:59.626286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:53:59.632836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:59.633511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:59.634007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:59.634794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:53:59.635315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:53:59.635793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:53:59.654793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:53:59.702159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:53:59.710449 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb0f587d-5955-40cf-8046-f00fcba38f07 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1225 microversion: 2.1 time: 0.089342 Aug 30 18:53:59.711167 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3192/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:53:59 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:00.112191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:00.113831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:00.120268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:00.121185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:00.129700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:00.130138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:00.130618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:00.131343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:00.131819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:00.132453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:00.270234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:00.278696 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c698ce49-fa72-402b-bda7-7ed83dd5ca07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1316 microversion: 2.1 time: 0.168609 Aug 30 18:54:00.279293 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3049/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:00 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:00.732841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:00.737199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:00.740857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:00.748121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:00.748864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:00.749306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:00.750644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:00.751153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:00.751585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:00.816494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:00.825968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bfd3c5e9-35f9-4aed-861c-08d3cf7d9442 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1225 microversion: 2.1 time: 0.098418 Aug 30 18:54:00.826597 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3193/6242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:00 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:01.302923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:01.304254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:01.317160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.318365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.319394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.320901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.321989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.323037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.377098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:01.535071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:01.543935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b01ca813-9957-4caf-8905-d95a7dc95b34 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1503 microversion: 2.1 time: 0.247056 Aug 30 18:54:01.544527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3050/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:01 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:01.565068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:01.565684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:01.572472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.572964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.573398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.574108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.574611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.575050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.603123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:54:01.691388 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1a1cb5fe-9611-49c5-b8e1-be627ab8617f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 204 len: 0 microversion: 2.1 time: 0.130005 Aug 30 18:54:01.692269 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3194/6244] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:01 2022] DELETE /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:54:01.700438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:01.701073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:01.709118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.709634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.710095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.710864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.711344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.711789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.848488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:01.849629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:01.857109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.857649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.858102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.859148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:01.863354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.863682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.864342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.887947 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-249d94e2-e3fc-495b-97fb-0e665f431465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1509 microversion: 2.1 time: 0.191184 Aug 30 18:54:01.890847 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3051/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:01 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:01.906256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:01.907395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:01.907791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:01.908241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lazy-loading 'fault' on Instance uuid 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:54:01.956670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbc33c37c584618a1ab28f8cd5f96b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb44a45007144eab36bcdaeb2d6d588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:01.967046 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-782d52fe-eee8-4ca3-ae94-95ce0ac50ef7 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 200 len: 1184 microversion: 2.1 time: 0.123375 Aug 30 18:54:01.968433 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3195/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:01 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 1184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:02.912523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:02.913152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:02.921696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:02.922218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:02.922810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:02.923441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:02.923914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:02.924348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:02.989531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:02.990178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 5f695b42-5e5d-4e45-a3c6-d270d607b8f6] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:02.997365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:02.997840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:02.998267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:02.999077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:02.999673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:02.999965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:03.017740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 HTTP/1.1 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '5f695b42-5e5d-4e45-a3c6-d270d607b8f6'} Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.019762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. Aug 30 18:54:03.024557 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.026015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 5f695b42-5e5d-4e45-a3c6-d270d607b8f6 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:03.027098 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91f96ca5-2322-4947-a80e-370e6cbe8b34 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6" status: 404 len: 111 microversion: 2.1 time: 0.042129 Aug 30 18:54:03.031281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3196/6247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:02 2022] GET /compute/v2.1/servers/5f695b42-5e5d-4e45-a3c6-d270d607b8f6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:54:03.089143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:03.098777 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e6a6bba-84c3-456d-b2a6-249ef2391e61 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1509 microversion: 2.1 time: 0.190392 Aug 30 18:54:03.099341 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3052/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:02 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:03.619444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:03.620175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:03.627915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:03.628836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:03.629504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:03.630488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:03.631289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:03.632047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:03.650843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce HTTP/1.1 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '25c5602a-61fd-476b-b6e9-8262afae2bce'} Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:03.652641 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:03.658147 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdb9d462-dff3-4677-84d8-c3efc1b113ae tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 404 len: 111 microversion: 2.1 time: 0.042177 Aug 30 18:54:03.659879 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3197/6249] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:03 2022] DELETE /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:03.669872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:03.670760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] [instance: 25c5602a-61fd-476b-b6e9-8262afae2bce] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:03.680996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:03.681883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:03.682544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:03.683445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:03.684120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:03.684563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:03.700786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] HTTP exception thrown: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Request method failure captured: Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce HTTP/1.1 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDliQufxwsLx016fJPPHlOr13ahup4zj1mEmk18UIM-v4mLssAdTSjVG54aRzegsmUvPApQ6l9lv1PZO7YZNQs4_ELYcuYoFBcic4TUZJkqgxIMZGI8GDwvayCJF4KTfjazuzDbl9o93vI0RRj-w_2ANli4WMa1C1YCu-YNL0HWOJzVA Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb44a45007144eab36bcdaeb2d6d588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 8eb44a45007144eab36bcdaeb2d6d588 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2137021416 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 3fbc33c37c584618a1ab28f8cd5f96b7 Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestVolumeBootPattern-2137021416-project Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '25c5602a-61fd-476b-b6e9-8262afae2bce'} Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:03.702704 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Returning 404 to user: Instance 25c5602a-61fd-476b-b6e9-8262afae2bce could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e802bba5-d8f0-426a-a905-96dfcbafeaa2 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce" status: 404 len: 111 microversion: 2.1 time: 0.039620 Aug 30 18:54:03.707153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3053/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:03 2022] GET /compute/v2.1/servers/25c5602a-61fd-476b-b6e9-8262afae2bce => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:04.066760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1708c9b-f31d-4de0-9edc-65108a7fcc95", "name": "network-vif-deleted", "tag": "36af4548-462e-477a-9fb3-2ef8c23647fb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:04.099227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:04.100022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:04.101218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:04.127094 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] Creating event network-vif-deleted:36af4548-462e-477a-9fb3-2ef8c23647fb for instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 on n-h2-854119-10 Aug 30 18:54:04.128273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:04.134157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:04.134786 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-06c161d4-5c8c-4916-a1ae-4cd628e7f571 req-98f3557b-71b0-46c9-871a-d32af5ebd7b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074169 Aug 30 18:54:04.136294 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3198/6251] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:04.145621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:04.146876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:04.147557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:04.148541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:04.149445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:04.150119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:04.234295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:04.243203 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-064b7204-8b61-4827-8241-710886f60b0f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 200 len: 1301 microversion: 2.1 time: 0.126741 Aug 30 18:54:04.243760 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3054/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:04 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 1301 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:05.265580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.266296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.273152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.273660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.274100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.274850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.275307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.275719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.290774 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 HTTP/1.1 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f1708c9b-f31d-4de0-9edc-65108a7fcc95'} Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:05.292473 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-747e110c-7e93-436b-8177-a3b5997adad7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 404 len: 111 microversion: 2.1 time: 0.033900 Aug 30 18:54:05.297418 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3199/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:05 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:05.304233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.304876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.312217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.312732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.313183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.313907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.314399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.314849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.448637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:05.458111 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a9f8687-8979-4b5c-a543-ce1591b7456a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.158131 Aug 30 18:54:05.458741 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3055/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:05 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:05.575868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03068389-65bf-4b4c-8c17-87bbf09cd37b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03068389-65bf-4b4c-8c17-87bbf09cd37b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 163 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": 12345, "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 12345 Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:05.579906 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 18:54:05.584502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:05.586113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-03068389-65bf-4b4c-8c17-87bbf09cd37b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:05.587176 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-03068389-65bf-4b4c-8c17-87bbf09cd37b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015505 Aug 30 18:54:05.588235 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3200/6255] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:05 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:05.597185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.597826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.604582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.606203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.606707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.607449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.608050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.608499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.709029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.709922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.718166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.719458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.720125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.720930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.721482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.722073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.755508 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-298260d8-f65e-49a9-a52c-03de5be91692 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/e9e86167-5ed6-4f13-ab19-a6a3c909847f" status: 200 len: 194 microversion: 2.1 time: 0.054658 Aug 30 18:54:05.756403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3201/6256] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 18:54:05 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/e9e86167-5ed6-4f13-ab19-a6a3c909847f => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:54:05.768087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.769246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.776337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.777013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.777618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.778364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.778874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:05.779216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.779646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.790303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9a8c95e5-fe36-4d2b-b9af-30eaa7ed45e5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.197660 Aug 30 18:54:05.801973 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3056/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:05 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:05.813747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:05.814772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:05.821878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.822502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.822950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.823675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:05.824303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:05.824943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:05.876767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lazy-loading 'services' on Instance uuid 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:54:05.978749 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dd249497-7858-4009-98e5-13c112d89090 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/e9e86167-5ed6-4f13-ab19-a6a3c909847f" status: 202 len: 0 microversion: 2.1 time: 0.213070 Aug 30 18:54:05.982954 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3202/6258] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 18:54:05 2022] DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments/e9e86167-5ed6-4f13-ab19-a6a3c909847f => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:05.987589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:05.999430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8fcd711c-5170-4791-a894-3c2bbb02a9df tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.188145 Aug 30 18:54:06.000431 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3057/6259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:05 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:07.565233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-331eb1ae-580a-436e-8431-84e88d773843 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-301709608", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bfcee929-29ab-461e-be5b-83a16449cf3a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:07.629500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-331eb1ae-580a-436e-8431-84e88d773843 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-331eb1ae-580a-436e-8431-84e88d773843 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 357 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-301709608", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bfcee929-29ab-461e-be5b-83a16449cf3a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: exception: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-301709608', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bfcee929-29ab-461e-be5b-83a16449cf3a'}], 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:07.661789 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-331eb1ae-580a-436e-8431-84e88d773843 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Block Device bfcee929-29ab-461e-be5b-83a16449cf3a is not bootable. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-331eb1ae-580a-436e-8431-84e88d773843 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.103852 Aug 30 18:54:07.666168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3203/6260] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:07.675368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:07.676062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:07.684350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:07.684875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:07.685329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:07.686127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:07.686570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:07.687014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:07.838929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:07.847943 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1f35bbff-4441-44d3-b3af-5fdb71c80e35 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.178837 Aug 30 18:54:07.848680 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3058/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:07 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:07.875500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:07.876234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:07.882805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:07.883515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:07.883941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:07.884636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:07.885086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:07.885501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:08.028169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:08.037403 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a8024f4-4010-4538-956f-6df720374a47 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.172086 Aug 30 18:54:08.037990 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3204/6262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:07 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:09.365720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee220394-2d98-41d9-9e97-b0703d885a73 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] Calling method '.version_select at 0x7f4e55b5fee0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:09.423410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee220394-2d98-41d9-9e97-b0703d885a73 tempest-TestVolumeBootPattern-2137021416 tempest-TestVolumeBootPattern-2137021416-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2094816941" status: 202 len: 0 microversion: 2.1 time: 0.062117 Aug 30 18:54:09.424158 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3059/6263] 10.222.0.25 () {58 vars in 1263 bytes} [Tue Aug 30 18:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2094816941 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:09.646058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1b9e177-96ca-4854-a1a4-1c7514ff9bc9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803990418", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "destination_type": "local"}, {"source_type": "volume", "uuid": "1aa0a8a6-216a-4237-b692-7e1f75705558", "destination_type": "invalid"}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1b9e177-96ca-4854-a1a4-1c7514ff9bc9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 494 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803990418", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "destination_type": "local"}, {"source_type": "volume", "uuid": "1aa0a8a6-216a-4237-b692-7e1f75705558", "destination_type": "invalid"}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-803990418', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1aa0a8a6-216a-4237-b692-7e1f75705558', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:09.650694 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1b9e177-96ca-4854-a1a4-1c7514ff9bc9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:09.654622 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1b9e177-96ca-4854-a1a4-1c7514ff9bc9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011022 Aug 30 18:54:09.656934 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3205/6264] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:09 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:09.661782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:09.662519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:09.671926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:09.672478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:09.673008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:09.673748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:09.674226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:09.674705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:09.943000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:09.951628 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e38de32f-a839-477e-bb89-b2c5f203c28f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.293853 Aug 30 18:54:09.952319 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3060/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:09 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:09.973868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:09.974523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:09.982132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:09.983332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:09.983890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:09.984685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:09.985153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:09.985554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.142098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:10.150690 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9f7d4377-9d39-4a06-8abc-780e5c3275b8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.181732 Aug 30 18:54:10.151324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3206/6266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:09 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:10.214295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57e71d2a-c00e-4a13-8dd3-2b544897aec4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1382136630", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57e71d2a-c00e-4a13-8dd3-2b544897aec4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 492 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1382136630", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1382136630', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.220087 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.223356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57e71d2a-c00e-4a13-8dd3-2b544897aec4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:10.225816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57e71d2a-c00e-4a13-8dd3-2b544897aec4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014711 Aug 30 18:54:10.226722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3061/6267] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:10 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:10.235071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:10.235945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:10.244762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.245345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.245887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.246866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.247599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.248136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.398245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:10.406813 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8678c30-577b-437d-9907-4acde6c2b520 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.175708 Aug 30 18:54:10.407676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3207/6268] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:10 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:10.428842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:10.430201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:10.439382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.439872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.440353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.441305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.441935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.442480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.668121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:10.677504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1674f2a9-30a1-4f4e-863f-3bbfa5cf7599 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.252792 Aug 30 18:54:10.678493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3062/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:10 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:10.741030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ae1101a-1924-4e5b-8843-550556e139fb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ae1101a-1924-4e5b-8843-550556e139fb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 416 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.745592 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ae1101a-1924-4e5b-8843-550556e139fb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ae1101a-1924-4e5b-8843-550556e139fb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011964 Aug 30 18:54:10.749578 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3208/6270] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:10 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:10.759863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:10.760602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:10.769520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.770069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.770753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:10.771530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:10.772002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:10.772447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.412768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:11.421638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50ec8c60-ef61-4ab8-9311-90b47f94464e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.666024 Aug 30 18:54:11.422220 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3063/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:10 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:11.442802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:11.443427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:11.452036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.452558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.453022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.453833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.454298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.454751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.587935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:11.597179 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f77950f7-08b4-4ca4-85e4-679412b49a41 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.158172 Aug 30 18:54:11.598082 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3209/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:11 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:11.661093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-513a8b80-b46b-40f8-8fcf-082dc288577e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882343757", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": -1, "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:11.676655 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-513a8b80-b46b-40f8-8fcf-082dc288577e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Flavor -1 could not be found. Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-513a8b80-b46b-40f8-8fcf-082dc288577e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 205 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882343757", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": -1, "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: exception: Flavor -1 could not be found. Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-882343757', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': -1, 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:11.685539 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 30 18:54:11.690077 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:11.691373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-513a8b80-b46b-40f8-8fcf-082dc288577e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:11.692211 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-513a8b80-b46b-40f8-8fcf-082dc288577e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.035393 Aug 30 18:54:11.692912 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3064/6273] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:11 2022] POST /compute/v2.1/servers => generated 73 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 18:54:11.702201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:11.703436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:11.703756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:11.705830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:11.710065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.710709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.711360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.711934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.712441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.712569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.712898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.713178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.713632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.713850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.714105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.714572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.745999 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-60dad9d6-98da-4f83-b43d-386eb5e6c7bb tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046676 Aug 30 18:54:11.746620 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3065/6274] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:54:11 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:54:11.909636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:11.930581 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd8e4702-9bbd-4387-b2e2-b7754a3cff5e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.232988 Aug 30 18:54:11.932381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3210/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:11 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:11.945361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:11.945361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:11.950736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.951396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.952967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.953971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.954638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.955242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.957722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:11.958691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:11.970615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.971502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.972162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.973111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:11.973778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:11.974441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:11.990664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e1f108a-57a6-454a-949f-12d4a9f006a2 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055028 Aug 30 18:54:11.997507 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3066/6276] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 18:54:11 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 18:54:12.060720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.061250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.071277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.072182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.073011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.074034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.074877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.075550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.125758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:54:12.155233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:12.165079 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e830e2e-3097-48ee-b02d-a359271ba097 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.212914 Aug 30 18:54:12.183021 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3211/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:11 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:12.235486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6033f0f3-70a1-4fcd-aa45-4650aec4120d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-153401869", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6033f0f3-70a1-4fcd-aa45-4650aec4120d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 172 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-153401869", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-153401869', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi -1 Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:12.242383 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.246335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6033f0f3-70a1-4fcd-aa45-4650aec4120d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:12.247246 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6033f0f3-70a1-4fcd-aa45-4650aec4120d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015328 Aug 30 18:54:12.248336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3212/6278] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:12 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:12.261391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.263054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.271376 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7f2d89c-9e81-4380-acde-bbdbfb914044 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 204 len: 0 microversion: 2.1 time: 0.214076 Aug 30 18:54:12.273656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.274253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.274477 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3067/6279] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:12 2022] DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:54:12.275961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.277032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.278592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.279274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.289723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.291572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.300487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.301123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.301819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.302979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.303804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.304454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.435534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:12.447304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-52ec6991-78df-4bdd-9eef-63e184a07664 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.193576 Aug 30 18:54:12.448504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3213/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:12 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:12.471895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.473803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.492450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.493005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.493451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.494177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.494661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.495084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.501660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:12.540072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:12.552673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dce87b95-fa33-4b32-b38c-885c441663a4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1670 microversion: 2.1 time: 0.273071 Aug 30 18:54:12.553597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3068/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:12 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:12.654907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:12.665386 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a3080ac5-ac67-4d48-92df-887913098e1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.200030 Aug 30 18:54:12.666502 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3214/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:12 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:12.727165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9f4f70e-0e6b-4b49-bd63-a153ce111db4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1025468648", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:12.732250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c9f4f70e-0e6b-4b49-bd63-a153ce111db4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9f4f70e-0e6b-4b49-bd63-a153ce111db4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 216 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1025468648", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1025468648', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.733996 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9f4f70e-0e6b-4b49-bd63-a153ce111db4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9f4f70e-0e6b-4b49-bd63-a153ce111db4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012326 Aug 30 18:54:12.738408 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3069/6283] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:12 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:12.744732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.745371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.751849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.752130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.752566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.753337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.754101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.754299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.898293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:12.907217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a410a6da-7793-46d1-8a4f-e9f6b9a2f234 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.166424 Aug 30 18:54:12.908201 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3215/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:12 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:12.930093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:12.930765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:12.939354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.940091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.940717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.941635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:12.942274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:12.943028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:12.947599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:13.140773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:13.149220 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6b6120f-9a8a-48c7-8af1-77fb23baf222 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.224246 Aug 30 18:54:13.150268 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3070/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:12 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:13.228019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-309245582", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-key-1626301132", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:13.287116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] validate_networks() for [('a736d63b-5e7d-4499-88da-1d0757a0c6cc', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:54:13.579392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:13.580743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:13.597483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:13.600013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:13.601862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:13.606614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:13.607630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:13.608336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:13.840307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Invalid key_name provided. Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 246 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-309245582", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-key-1626301132", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid key_name provided. Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-309245582', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'key_name': 'tempest-key-1626301132', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1626301132 not found for user e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:13.842544 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid key_name provided. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27d7fb3d-3c81-474e-beba-45ad3337ceec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.620415 Aug 30 18:54:13.850432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3216/6286] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 622 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 30 18:54:13.857641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:13.858266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:13.866294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:13.866930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:13.867370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:13.868181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:13.868633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:13.869064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:13.924156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:13.952400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7d73b637-e145-4ec9-9079-7e2f87e28521 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1670 microversion: 2.1 time: 0.379094 Aug 30 18:54:13.953167 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3071/6287] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:13 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1670 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:14.069080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:14.078612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-419bc6c8-26fd-4589-90f6-2368873cf968 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.228424 Aug 30 18:54:14.079207 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3217/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:13 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:14.100024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:14.100993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:14.107831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.108607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.109112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.109840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.110312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.110795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.337169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:14.348355 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fcba169b-0f66-49c3-bade-b15452f9413e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.252439 Aug 30 18:54:14.349402 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3072/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:14.412133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1579443289", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:14.528364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.security_group_api [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Neutron security group does_not_exist not found {{(pid=122589) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 30 18:54:14.529222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 258 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1579443289", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1579443289', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 30 18:54:14.581897 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:14.585931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:14.592158 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25b0bcd0-d709-4348-9897-c408cda15139 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.175604 Aug 30 18:54:14.592158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3218/6290] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:14 2022] POST /compute/v2.1/servers => generated 106 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:14.596089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:14.596968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:14.606641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.607496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.608044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.608884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.609548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.610264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.839527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:14.852925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8b5fb1b-64f6-48b6-a332-0bedcf813655 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.262239 Aug 30 18:54:14.853592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3073/6291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:14.876363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:14.876988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:14.883502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.883994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.884431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.885139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.885791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.886218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.975908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:14.977616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:14.985101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.985608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.986958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:14.987102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:14.987499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:14.987929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.083775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f1d4d8eb44acb8a1cf28fad277c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a9d975528d4fc5a070323842500908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:15.102576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c1505cf0-e706-448c-a270-0d0524b87176 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 200 len: 1604 microversion: 2.1 time: 0.131647 Aug 30 18:54:15.105787 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3074/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:14 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:15.113818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:15.124318 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c888056c-ada3-48df-8f43-be4db3d00f1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.251955 Aug 30 18:54:15.140519 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3219/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:15.143685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a", "name": "network-vif-deleted", "tag": "bc70119b-d286-40ba-b2ca-55fa292bff6a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:15.147287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:15.148993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 4c0939ee-acf3-416e-bfd7-9ff838a6d939] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:15.155922 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/4c0939ee-acf3-416e-bfd7-9ff838a6d939 HTTP/1.1 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '4c0939ee-acf3-416e-bfd7-9ff838a6d939'} Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.158748 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. Aug 30 18:54:15.162485 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.163371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.164055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.164872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.165059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 4c0939ee-acf3-416e-bfd7-9ff838a6d939 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:15.166057 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-039c4cf8-1be4-41bf-8ac9-eb28a23ca244 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c0939ee-acf3-416e-bfd7-9ff838a6d939" status: 404 len: 111 microversion: 2.1 time: 0.023782 Aug 30 18:54:15.170061 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3220/6294] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:15 2022] DELETE /compute/v2.1/servers/4c0939ee-acf3-416e-bfd7-9ff838a6d939 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:15.176606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:15.177521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:15.182655 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] Creating event network-vif-deleted:bc70119b-d286-40ba-b2ca-55fa292bff6a for instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a on n-h1-854119-10 Aug 30 18:54:15.186468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.187560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.188204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.189153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.189812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.190085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-74664ffa-7be6-4e55-aac9-58698573e78e req-ae60f10b-72d4-4a36-a8d3-913c2d3fd854 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049982 Aug 30 18:54:15.190814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.191315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3075/6295] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:15.567249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:15.575764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a2b28ebf-5c37-4083-879b-c45c9df75b50 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.404274 Aug 30 18:54:15.576491 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3221/6296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:15 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:15.600483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:15.601368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:15.610193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.610906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.611426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.612423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.612993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.613502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.779168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:15.792997 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9707d084-f779-41cd-a64c-ceb50ef75b74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.197720 Aug 30 18:54:15.793833 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3076/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:15 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:15.826786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:15.827642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:54:15.828389 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 9223372036854775808 could not be found. Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '9223372036854775808'} Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:15.830466 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:15.834618 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:15.834618 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:15.834618 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:15.834618 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 30 18:54:15.834618 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:15.835815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:15.837515 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-260a96cf-2c4f-4134-aebe-eca329f36c7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023644 Aug 30 18:54:15.838738 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3222/6298] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Aug 30 18:54:15 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:54:15.847606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:15.848980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:15.856487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.857336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.858606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:15.860528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:15.861216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:15.861886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.126923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:16.130266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:16.130918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:16.137746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-49107df3-8a7b-4f5b-a114-d095ad446507 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.294672 Aug 30 18:54:16.139083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3077/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:15 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:16.140052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.140556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.141000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.141729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.142217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.144279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.162898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:16.163800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:16.170597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.171416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.172756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.173813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.174512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.175468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.181056 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a HTTP/1.1 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a'} Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:16.183784 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:16.187680 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.189768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:16.190931 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aaf9879e-0604-49b5-9a44-a79474226728 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 404 len: 111 microversion: 2.1 time: 0.064563 Aug 30 18:54:16.192073 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3223/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:16 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:16.201826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40d78331-558c-4030-b033-9ec8b3aee936 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '.version_select at 0x7f4e5694d4c0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:16.231574 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40d78331-558c-4030-b033-9ec8b3aee936 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315296765" status: 202 len: 0 microversion: 2.1 time: 0.034109 Aug 30 18:54:16.233247 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3224/6301] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 18:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315296765 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:16.521485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:16.539297 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-38f32c33-0bfc-4646-936d-0c9b4240775d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.380299 Aug 30 18:54:16.541348 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3078/6302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:16 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:16.561497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:16.562370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Failed to fetch instance by id -1 {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 18:54:16.563268 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance -1 could not be found. Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance -1 could not be found. Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '-1'} Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:16.564750 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:16.569034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:16.569034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:16.569034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 30 18:54:16.569034 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:16.569843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:16.570843 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4aea207e-1dc9-4c95-aace-b038aef673b9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013971 Aug 30 18:54:16.575954 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3225/6303] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 18:54:16 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:54:16.586389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:16.587058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:16.606701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.607223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.607685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:16.608434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:16.608966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:16.609415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.233143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:17.243230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50b520a8-a65a-4f61-8b92-9e4e5f46681e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.664683 Aug 30 18:54:17.244025 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3079/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:16 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:17.269798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:17.270537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:17.284008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.284749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.285544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.286929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.288608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.290158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.457559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:17.472138 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb3f2876-0b9c-4e48-a6d6-e54c8314bbe6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.209424 Aug 30 18:54:17.490514 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3226/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:17 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:17.497907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:17.499031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 56527645-1d54-44d2-8104-a0bda0cc15e8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:17.506410 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/56527645-1d54-44d2-8104-a0bda0cc15e8/action HTTP/1.1 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 19 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: {"forceDelete": {}} Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '56527645-1d54-44d2-8104-a0bda0cc15e8', 'body': {'forceDelete': {}}} Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:17.524950 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:17.529532 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:17.529532 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:17.529532 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. Aug 30 18:54:17.529532 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:17.536462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 56527645-1d54-44d2-8104-a0bda0cc15e8 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:17.537873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-65cbe7c6-ba2c-4d0e-8145-b2a1bd745d16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/56527645-1d54-44d2-8104-a0bda0cc15e8/action" status: 404 len: 111 microversion: 2.1 time: 0.044968 Aug 30 18:54:17.548127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:17.548708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:17.552403 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3080/6306] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:17 2022] POST /compute/v2.1/servers/56527645-1d54-44d2-8104-a0bda0cc15e8/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:54:17.555782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.556247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.556802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.557503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.558066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.558717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.771268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:17.779817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b12259e-f4fb-4cc5-bdfd-0df48159a8de tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.236465 Aug 30 18:54:17.780588 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3227/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:17 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:17.802321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:17.802971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:17.811666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.812358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.812816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:17.813555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:17.814019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:17.819812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:18.198038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:18.211101 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2c855a5-764f-405d-99c6-58a90ba45ef3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.412915 Aug 30 18:54:18.216153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3081/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:17 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:18.233631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:18.236343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: d9e96b1d-7b3f-48b2-b592-1e2eace1b424] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:18.243215 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/d9e96b1d-7b3f-48b2-b592-1e2eace1b424/action HTTP/1.1 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 39 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: {"os-getConsoleOutput": {"length": 10}} Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd9e96b1d-7b3f-48b2-b592-1e2eace1b424', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:18.253274 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. Aug 30 18:54:18.258240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:18.260652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance d9e96b1d-7b3f-48b2-b592-1e2eace1b424 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:18.261734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7461c9c-98ae-4f81-8b07-280da7dedac6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/d9e96b1d-7b3f-48b2-b592-1e2eace1b424/action" status: 404 len: 111 microversion: 2.1 time: 0.032493 Aug 30 18:54:18.266072 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3228/6309] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:18 2022] POST /compute/v2.1/servers/d9e96b1d-7b3f-48b2-b592-1e2eace1b424/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:18.271341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:18.272195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:18.280607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:18.281990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:18.282843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:18.284496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:18.285609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:18.286978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:18.529706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:18.539051 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ede6382-310d-4a94-825a-2c9e67cb629b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.271547 Aug 30 18:54:18.541347 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3082/6310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:18 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:18.563099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:18.563733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:18.571970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:18.572518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:18.572957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:18.573703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:18.574156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:18.574798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.001810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:19.011589 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5796d100-7dcc-466b-8118-67d001d5be60 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.452448 Aug 30 18:54:19.012337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3229/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:18 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:19.032688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:19.033509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: bfece5ac-d66f-4e39-a49f-feb346bd540f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:19.041145 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bfece5ac-d66f-4e39-a49f-feb346bd540f HTTP/1.1 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bfece5ac-d66f-4e39-a49f-feb346bd540f'} Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.042962 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:19.047523 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:19.047523 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:19.047523 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:19.047523 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. Aug 30 18:54:19.047523 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.049570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance bfece5ac-d66f-4e39-a49f-feb346bd540f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:19.051169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8972527-d2cf-45bb-aed8-b216b9fa606e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/bfece5ac-d66f-4e39-a49f-feb346bd540f" status: 404 len: 111 microversion: 2.1 time: 0.022792 Aug 30 18:54:19.055514 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3083/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:19 2022] GET /compute/v2.1/servers/bfece5ac-d66f-4e39-a49f-feb346bd540f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:54:19.063269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:19.064189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:19.070587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.071402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.072078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.073026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.073494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.073995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.218888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:19.227974 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bc3ad730-3e51-426c-ae18-b3f2f0776c22 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.171123 Aug 30 18:54:19.228795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3230/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:19.251101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:19.252150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:19.261410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.262145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.263465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.264359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.265096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.265901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.458739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:19.468791 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee2a18e0-87fd-481f-8b9e-a0f8c1b638af tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.222852 Aug 30 18:54:19.474432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3084/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:19.597185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7006d54-861b-4182-958f-7676d3980f69 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402932694", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7006d54-861b-4182-958f-7676d3980f69 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 238 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402932694", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1402932694', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.622230 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7006d54-861b-4182-958f-7676d3980f69 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:19.627202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7006d54-861b-4182-958f-7676d3980f69 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032162 Aug 30 18:54:19.632133 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3231/6315] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:19.637896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:19.638724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:19.645326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.646021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.646588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.647398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.647962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.648484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.794093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:19.806293 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e55401a8-4d9b-4225-a6c1-799d1fc266ee tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.173631 Aug 30 18:54:19.808639 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3085/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:19.831549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:19.832424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:19.836940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:19.842221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.842975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.844250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:19.845117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:19.845710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:19.846299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.044561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:20.054641 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f14b0ee8-d17e-4ca9-84a2-8acfb7199c55 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.227565 Aug 30 18:54:20.055608 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3232/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:20.206563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f526fc86-14ba-4444-a0ac-945452948410 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1950817286", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f526fc86-14ba-4444-a0ac-945452948410 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 235 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1950817286", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1950817286', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.213467 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 18:54:20.218382 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.222245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f526fc86-14ba-4444-a0ac-945452948410 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:20.223373 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f526fc86-14ba-4444-a0ac-945452948410 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022782 Aug 30 18:54:20.224186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3086/6318] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:20.233807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:20.247476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:20.254812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.255285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.255730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.256538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.257003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.257535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.425351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:20.436199 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9b3c5ca9-4ec5-4204-b7d5-076fea4700ac tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.207446 Aug 30 18:54:20.436970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3233/6319] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:20.460871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:20.462314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:20.471023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.471541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.472052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.472737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.473209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.473665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.726725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:20.738687 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbc02185-7530-4125-87d5-e83a8e751850 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.281885 Aug 30 18:54:20.740454 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3087/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:20.760416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:20.760960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 10b24068-2756-4bf5-b35e-4b1d5240c3ee] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:20.767504 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/10b24068-2756-4bf5-b35e-4b1d5240c3ee/action HTTP/1.1 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 13 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: {"pause": {}} Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '10b24068-2756-4bf5-b35e-4b1d5240c3ee', 'body': {'pause': {}}} Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:20.776482 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 10b24068-2756-4bf5-b35e-4b1d5240c3ee could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:20.781067 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ece18966-aac5-482e-982f-d2ef2c323442 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/10b24068-2756-4bf5-b35e-4b1d5240c3ee/action" status: 404 len: 111 microversion: 2.1 time: 0.022205 Aug 30 18:54:20.783995 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3234/6321] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:20 2022] POST /compute/v2.1/servers/10b24068-2756-4bf5-b35e-4b1d5240c3ee/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:20.787638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:20.788270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:20.790608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:20.796313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.796850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.797311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.798079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.798583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.799031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.940773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:20.950986 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f36eb23f-5130-4121-b255-c8587b763247 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.167369 Aug 30 18:54:20.951585 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3088/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:20.972429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:20.973018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:20.981767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.982264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.982716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:20.983843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:20.984552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:20.984959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:21.141928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:21.150935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fdee12c9-0631-4c38-8ff8-6765ebb9cc56 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.182502 Aug 30 18:54:21.151705 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3235/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:21.171886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:21.172459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:21.179341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:21.179814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:21.180284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:21.180975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:21.181575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:21.182244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:21.235836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:21.275616 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b46a34df-1409-447b-845e-da8eedbe4f20 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.107551 Aug 30 18:54:21.276722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3089/6324] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:21 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 18:54:21.286009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:21.287166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:21.294214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:21.295048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:21.295691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:21.297282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:21.297928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:21.298620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:21.445264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:21.456408 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bfc82738-ab50-4013-b0cf-ecc264223c67 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1509 microversion: 2.1 time: 0.174932 Aug 30 18:54:21.471808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3236/6325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:21 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:22.480975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:22.481692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:22.488758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.489253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.489705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.490443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.490908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.491332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.631439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:22.640078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cc36b6fe-a416-4ad7-91b6-fc01708cfc7b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1489 microversion: 2.1 time: 0.164441 Aug 30 18:54:22.640647 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3090/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:22 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1489 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:22.660383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:22.660913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:22.668021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.668511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.668941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.669642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.670086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.670558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.697309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'pause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state paused Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 13 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: {"pause": {}} Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'pause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state paused Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'pause': {}}} Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state paused. Cannot pause while the instance is in this state. Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state paused Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:22.698876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state paused Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'pause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state paused {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6ec88dba-9565-4c95-901a-7019d044715e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 143 microversion: 2.1 time: 0.043964 Aug 30 18:54:22.704222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3237/6327] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:22 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 143 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:54:22.710614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:22.711183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:22.717805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.719016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.719016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.719608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.720057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.720502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.797818 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96aeace5-c18f-4515-8d92-9d731d466f26 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.091239 Aug 30 18:54:22.802285 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3091/6328] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:22 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:22.807938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:22.808963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:22.816869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.817478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.817989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.818874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:22.819482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:22.820018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:22.971976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:22.980278 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-081a1284-c9f5-4a35-b5ca-70f4f2365957 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1496 microversion: 2.1 time: 0.176435 Aug 30 18:54:22.981158 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3238/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:22 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1496 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:23.870721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:23.871569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:23.879244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:23.879760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:23.880206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:23.880923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:23.881389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:23.881964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:23.896335 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a HTTP/1.1 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a'} Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:23.898013 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d70375f0-841a-4a33-a2ea-d9785cfd0446 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 404 len: 111 microversion: 2.1 time: 0.034281 Aug 30 18:54:23.905834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3092/6330] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:23 2022] DELETE /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:23.908421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:23.909065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:23.916499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:23.916996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:23.917437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:23.918149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:23.918641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:23.919094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:23.934059 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a HTTP/1.1 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a'} Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:23.935655 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance 6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4c8b96f-008a-4c16-951d-d29723d3f1c4 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a" status: 404 len: 111 microversion: 2.1 time: 0.032763 Aug 30 18:54:23.940576 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3239/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:23 2022] GET /compute/v2.1/servers/6398ac9a-7e2c-4f35-8ad8-85e7b1d3dc3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:24.005854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:24.006690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.014795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.015906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.016514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.017402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.018008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.018742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.167454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:24.177182 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-37938c98-9073-4a2d-a0d1-16cfd1136f64 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.175908 Aug 30 18:54:24.178058 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3093/6332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:23 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:24.201183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:24.201996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.209543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.210036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.210505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.211218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.211670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.212275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.355424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:24.364565 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65696706-21a0-4fc4-9913-5b37efa45090 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.167330 Aug 30 18:54:24.365418 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3240/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:24 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:24.386176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:24.389100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.396870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.397512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.398063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.399469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.400191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.400745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.416608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action HTTP/1.1 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 28 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: {"reboot": {"type": "SOFT"}} Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f1708c9b-f31d-4de0-9edc-65108a7fcc95', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:24.418460 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.423284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:24.425256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ffbfeeac-483e-441c-98b0-0d31ff612214 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action" status: 404 len: 111 microversion: 2.1 time: 0.043412 Aug 30 18:54:24.426450 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3094/6334] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:24 2022] POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 18:54:24.434866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:24.435959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.443404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.443960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.444410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.445135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.445973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.446468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.466920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:24.589297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:24.597638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7498295e-34d8-492a-9808-40b1b9c1af16 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.166731 Aug 30 18:54:24.598438 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3241/6335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:24 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:24.618903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:24.619523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.625962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.626493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.626944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.627675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.628142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.628587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.779285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:24.789542 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d84961c8-028a-4391-882e-1ddbe26ef16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.174548 Aug 30 18:54:24.790139 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3095/6336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:24 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:24.810295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:24.812834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 22b2a617-9937-4e53-a204-5d5f7014d9eb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.819007 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/22b2a617-9937-4e53-a204-5d5f7014d9eb/action HTTP/1.1 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 28 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: {"reboot": {"type": "SOFT"}} Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '22b2a617-9937-4e53-a204-5d5f7014d9eb', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. Aug 30 18:54:24.820598 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 22b2a617-9937-4e53-a204-5d5f7014d9eb could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:24.824896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ace7523-23d4-476a-9ba1-46ad74f56c1e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/22b2a617-9937-4e53-a204-5d5f7014d9eb/action" status: 404 len: 111 microversion: 2.1 time: 0.015790 Aug 30 18:54:24.826334 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3242/6337] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:24 2022] POST /compute/v2.1/servers/22b2a617-9937-4e53-a204-5d5f7014d9eb/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:24.832598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:24.833236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:24.839808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.840250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.840697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.841535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:24.841887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:24.842381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:24.987173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:24.996153 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9e4182f5-7eea-4e75-8639-3db5959cebe1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.168457 Aug 30 18:54:24.996757 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3096/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:24 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:25.022057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:25.023746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.033598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.034533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.035057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.035858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.036427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.036938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.193879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:25.202180 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-73f29dd2-fee1-44d0-bd3c-461be6c31275 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.188910 Aug 30 18:54:25.203008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3243/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:25 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:25.223211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:25.226155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.232753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.233720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.234990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.235787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.236338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.236845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.252555 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action HTTP/1.1 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 65 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f1708c9b-f31d-4de0-9edc-65108a7fcc95', 'body': {'rebuild': {'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292'}}} Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 18:54:25.254320 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:25.258989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2874a3cb-da04-4c55-85c4-f650d208ef07 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action" status: 404 len: 111 microversion: 2.1 time: 0.039080 Aug 30 18:54:25.260159 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3097/6340] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:25 2022] POST /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:25.268458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:25.269071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.275617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.276101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.276536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.277232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.277682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.278112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.415461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:25.424674 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4676ff93-2ceb-44b7-b501-e1d355b49ab3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.160705 Aug 30 18:54:25.425623 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3244/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:25 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:25.446883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:25.447529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.454808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.455321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.455775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.456518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.456991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.457437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.610146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:25.618457 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d68a86f8-ec37-4e16-8823-f1e27c48dd6f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.175567 Aug 30 18:54:25.618923 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3098/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:25 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:25.639644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:25.642785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 0ecd617c-2380-4fb8-8473-53c927d2ad16] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.648788 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/0ecd617c-2380-4fb8-8473-53c927d2ad16/action HTTP/1.1 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 65 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: {"rebuild": {"imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292"}} Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '0ecd617c-2380-4fb8-8473-53c927d2ad16', 'body': {'rebuild': {'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292'}}} Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 18:54:25.650503 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 0ecd617c-2380-4fb8-8473-53c927d2ad16 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8c410cb-e4e7-4383-abc7-58b3d38a4348 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/0ecd617c-2380-4fb8-8473-53c927d2ad16/action" status: 404 len: 111 microversion: 2.1 time: 0.016373 Aug 30 18:54:25.654261 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3245/6343] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:25 2022] POST /compute/v2.1/servers/0ecd617c-2380-4fb8-8473-53c927d2ad16/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:25.661376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:25.662014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.668452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.668964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.669428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.670156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.670697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.671376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.808522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:25.817346 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6687eb3e-720a-4681-8081-05730e10b22f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.160069 Aug 30 18:54:25.817931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3099/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:25 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:25.838172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:25.838808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:25.846310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.846872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.847302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.847979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:25.848426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:25.848839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:25.989059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:25.998812 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4b5c3b5-f6c0-4f41-9879-93efeba5a2ca tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.164504 Aug 30 18:54:25.999630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3246/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:25 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:26.020212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:26.020808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: de7c516c-7ffb-4b5c-a64a-c4bf165fa901] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.028227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/de7c516c-7ffb-4b5c-a64a-c4bf165fa901/action HTTP/1.1 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: {"restore": {}} Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'de7c516c-7ffb-4b5c-a64a-c4bf165fa901', 'body': {'restore': {}}} Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.029804 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance de7c516c-7ffb-4b5c-a64a-c4bf165fa901 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a669dfb-c4fc-4859-910f-20c09dc8bbfa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/de7c516c-7ffb-4b5c-a64a-c4bf165fa901/action" status: 404 len: 111 microversion: 2.1 time: 0.016354 Aug 30 18:54:26.033715 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3100/6346] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:26 2022] POST /compute/v2.1/servers/de7c516c-7ffb-4b5c-a64a-c4bf165fa901/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:26.041935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:26.042697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.050382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.051048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.051548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.052332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.052801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.053222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.196909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:26.205175 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f027d1d7-cfb0-4202-b795-e5dc5c9c0665 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.167284 Aug 30 18:54:26.205758 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3247/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:26 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:26.226211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:26.226880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.234688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.235196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.235657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.236385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.236884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.237317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.373797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:26.382189 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84a7e72b-da1d-4128-9f7a-8804983538c8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.159786 Aug 30 18:54:26.382696 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3101/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:26 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:26.402813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:26.403364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.410834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.411473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.412010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.412830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.413389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.413959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.440247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'restore' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 15 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: {"restore": {}} Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'restore' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'restore': {}}} Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state active. Cannot restore while the instance is in this state. Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.442184 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.447635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'restore' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:26.448172 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3635f673-a4e2-46db-b99a-a63489551685 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 145 microversion: 2.1 time: 0.046809 Aug 30 18:54:26.449002 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3248/6349] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:26 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 145 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:54:26.457550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:26.458198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.464729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.465239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.465722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.466552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.467037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.467487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.624414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:26.633808 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3192c23f-b811-4d71-a0d1-9c9543822d9a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.180095 Aug 30 18:54:26.634686 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3102/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:26 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:26.656837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:26.657689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.664753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.665255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.665686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.666478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.667113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.667540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.814027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:26.823458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43e79bc4-0203-4ddc-a25d-021eba53a964 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.170821 Aug 30 18:54:26.824259 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3249/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:26 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:26.844808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:26.845370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.851578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b/action HTTP/1.1 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 14 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: {"resume": {}} Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b', 'body': {'resume': {}}} Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:26.855379 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:26.860048 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:26.860048 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:26.860048 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. Aug 30 18:54:26.860048 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:26.860758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:26.861710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-556153bc-7ab5-4dd0-8b68-32ce34dc8d2a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b/action" status: 404 len: 111 microversion: 2.1 time: 0.021365 Aug 30 18:54:26.862603 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3103/6352] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:26 2022] POST /compute/v2.1/servers/f7de0b39-d9f9-4e56-ac09-ed2f40a1a72b/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:26.874283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:26.875082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:26.882486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.883089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.883584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:26.884483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:26.884896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:26.885314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.051076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:27.061062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d601ab4c-489b-41ff-a1fd-264fe26964bb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.190696 Aug 30 18:54:27.062043 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3250/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:26 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:27.083773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:27.084576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.094738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.095590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.096114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.096916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.097476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.097997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.220855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:27.221643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.228075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.228767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.229364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.230233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.231021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.231664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.247428 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 HTTP/1.1 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bfbda8ea-4642-479d-9f14-522a3cbcdc07'} Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:27.248991 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.254017 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.255324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:27.255476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:27.255476 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce3ca045-0234-4135-adc9-9eb5bd7aae8d tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 404 len: 111 microversion: 2.1 time: 0.033885 Aug 30 18:54:27.255476 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3251/6354] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:54:27 2022] DELETE /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:27.259492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:27.260106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] [instance: bfbda8ea-4642-479d-9f14-522a3cbcdc07] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.264942 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b4b9dec-ff97-48be-82d8-514bef2ca8e3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.185457 Aug 30 18:54:27.266493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.266721 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3104/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:27 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:27.267481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.267930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.268646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.269101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.269525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.285796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:27.286792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.289347 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] HTTP exception thrown: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Request method failure captured: Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 HTTP/1.1 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlt5LpMcKkmPM_jkxRIIzZxlGCp8qUg1PCRUEbNSjnKZ7ok4iuE9jSQxniMna0NDh15h6Ammtni_2Kjuc2SOIDEq2QkShm7DD7hijazglb_9O8O60SurvYj9yggLU_9SXE9TVY9NA71hTIi83JtqHvebonp394LFRzLlU0G_s2RhUbU Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e2a9d975528d4fc5a070323842500908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e2a9d975528d4fc5a070323842500908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e2a9d975528d4fc5a070323842500908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: e2a9d975528d4fc5a070323842500908 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2134394361 Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 504f1d4d8eb44acb8a1cf28fad277c0d Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-AttachVolumeTestJSON-2134394361-project Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bfbda8ea-4642-479d-9f14-522a3cbcdc07'} Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.290935 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] Returning 404 to user: Instance bfbda8ea-4642-479d-9f14-522a3cbcdc07 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:27.294756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6b45edf2-0d66-493b-81e5-acd82ce35884 tempest-AttachVolumeTestJSON-2134394361 tempest-AttachVolumeTestJSON-2134394361-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07" status: 404 len: 111 microversion: 2.1 time: 0.036615 Aug 30 18:54:27.297383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3252/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:27 2022] GET /compute/v2.1/servers/bfbda8ea-4642-479d-9f14-522a3cbcdc07 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:27.301189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.301885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.302552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.305335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.305913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.306261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.343159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'resume' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 14 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: {"resume": {}} Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'resume' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'resume': {}}} Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state active. Cannot resume while the instance is in this state. Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.345368 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:54:27.349515 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.351328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'resume' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:27.352419 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2513479e-202a-4eed-848b-459cf03e9005 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 144 microversion: 2.1 time: 0.070782 Aug 30 18:54:27.356973 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3105/6357] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:27 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 144 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 18:54:27.361989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:27.363079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.369569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.370140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.370676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.371458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.371979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.372487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.545273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:27.555421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-993111e2-0cc8-4ca5-bf57-c93ec0a49d46 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.197392 Aug 30 18:54:27.556011 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3253/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:27 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:27.576648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:27.577386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:27.590497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.591391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.592157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.594111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:27.594951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:27.595641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:27.852462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:27.861072 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-691b1059-30ee-4e77-8db2-980cca2bbdf1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.288366 Aug 30 18:54:27.862041 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3106/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:27 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:27.984585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b4527d3-4f8a-41bd-9b81-b48d1561d0bf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b4527d3-4f8a-41bd-9b81-b48d1561d0bf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 160 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "a736d63b-5e7d-4499-88da-1d0757a0c6cc"}]}} Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'body': {'server': {'name': '', 'imageRef': '56ee09fc-3dcc-4737-853e-2c27d4afd292', 'flavorRef': '452', 'networks': [{'uuid': 'a736d63b-5e7d-4499-88da-1d0757a0c6cc'}]}}} Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi '' Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:54:27.988286 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b4527d3-4f8a-41bd-9b81-b48d1561d0bf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b4527d3-4f8a-41bd-9b81-b48d1561d0bf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009245 Aug 30 18:54:27.995552 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3254/6360] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:54:27 2022] POST /compute/v2.1/servers => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:54:28.000199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:28.000907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.007778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.008633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.009285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.010025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.010538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.010991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.246116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:28.255079 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5dd8506-1df9-4aaa-bc0e-76f4f3a058f7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.260011 Aug 30 18:54:28.255663 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3107/6361] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:27 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:28.276463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:28.277035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.285298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.285775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.286250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.287023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.287469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.288030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.430616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:28.438823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e2d654f-ffb6-4afb-9c19-cc1361626b39 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.166730 Aug 30 18:54:28.439450 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3255/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:28 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:28.459674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:28.460133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.465862 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661/action HTTP/1.1 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 14 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: {"shelve": {}} Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661', 'body': {'shelve': {}}} Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:28.468235 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39d618ee-a270-453c-9e88-bdb16954ab5b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661/action" status: 404 len: 111 microversion: 2.1 time: 0.014557 Aug 30 18:54:28.472074 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3108/6363] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:28 2022] POST /compute/v2.1/servers/8d4a4ca5-8d6a-48c6-9a33-5134e7a2d661/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:54:28.478785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:28.479506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.486370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.486856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.487318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.488013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.488457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.489217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.623416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:28.631619 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3cae040-5016-400f-804a-7c0ee1b42a72 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.156708 Aug 30 18:54:28.632199 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3256/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:28 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:28.652733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:28.653340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.660955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.661469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.661948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.662776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.663191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.663637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.907772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:28.916245 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-615e01aa-a838-4676-b0ca-3fd505326cb9 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.267448 Aug 30 18:54:28.916814 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3109/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:28 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:28.941714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:28.942381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:28.949072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.949554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.949981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.950713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:28.951159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:28.951575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:28.978404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lazy-loading 'flavor' on Instance uuid ff33967c-2b83-48ac-833a-74ae23bc3bd2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:54:29.191736 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aadbbac6-53d4-497b-ac89-799f44d8f2e4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.253818 Aug 30 18:54:29.192410 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3257/6366] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:28 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:29.201203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:29.201844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:29.209891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:29.210742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:29.211738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:29.213148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:29.213847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:29.214812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:29.237483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:29.380980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:29.393476 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-06395351-1379-4c22-845b-2aab0107f1b1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.196263 Aug 30 18:54:29.394311 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3110/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:29 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:30.419614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:30.420978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:30.428883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.429713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.430245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.431075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:30.431725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:30.432214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:30.793996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:30.804221 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-76146995-be15-44e9-a2b8-345f278244d4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.390502 Aug 30 18:54:30.805130 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3258/6368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:30 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:31.828729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:31.830301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:31.840829 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:31.841402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:31.841855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:31.856055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:31.856756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:31.857358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:32.092450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:32.101061 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-26b5d51e-564c-4d4f-8acb-db26c4bd7c9e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.279030 Aug 30 18:54:32.106819 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3111/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:31 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:33.123638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:33.124311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:33.133580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:33.134072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:33.134552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:33.135263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:33.135722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:33.136147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:33.288947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:33.297823 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-48a13f13-4a45-4c5c-bac8-1b820d95d5e6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.178767 Aug 30 18:54:33.298442 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3259/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:33 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:34.306178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:34.306794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:34.316951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.317934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.318414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.319450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.320106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:34.320586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.320671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.320758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:34.332322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.332734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.333161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.333888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:34.334383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:34.334801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:34.354498 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-475543c2-87aa-4444-b3b0-145fe265a69e tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.052774 Aug 30 18:54:34.355771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3112/6371] 10.222.0.25 () {58 vars in 1293 bytes} [Tue Aug 30 18:54:34 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174/os-server-password => generated 116 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 18:54:34.490571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:34.495662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:34.502834 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7ed413a-f973-4883-b267-f023d8051297 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.186834 Aug 30 18:54:34.503431 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3260/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:34 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:35.527062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:35.527800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:35.536143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:35.536653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:35.537104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:35.537837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:35.538305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:35.538785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:35.676921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:35.685361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3760bad3-b91a-4c0e-8274-5ce0ee7f2b9c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.162666 Aug 30 18:54:35.685935 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3113/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:35 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:36.705997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:36.707402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:36.716348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:36.717082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:36.717514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:36.718215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:36.718689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:36.719109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:36.857603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:36.865816 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d4665c9-0903-4e77-9746-85a91f094437 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.163702 Aug 30 18:54:36.866512 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3261/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:36 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:37.887361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:37.888077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:37.896226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:37.896736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:37.897384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:37.898174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:37.898754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:37.899097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:38.049281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:38.057675 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-502cdcff-7c36-4b8e-b959-9039c7ef0ed3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.174314 Aug 30 18:54:38.058412 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3114/6375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:37 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:39.079973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:39.080591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:39.088342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:39.088830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:39.089258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:39.089956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:39.090427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:39.090852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:39.234234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:39.242996 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd27ea42-c172-48c4-bc72-e39b7cf9c16b tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.167130 Aug 30 18:54:39.243699 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3262/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:39 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:40.263489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:40.264953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:40.272516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:40.273017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:40.273476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:40.274241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:40.274925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:40.275391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:40.419557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:40.429263 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-702fa7ba-64b7-4461-9fb4-a8dc61f564a5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1531 microversion: 2.1 time: 0.169716 Aug 30 18:54:40.429866 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3115/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:40 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1531 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:41.452139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:41.452951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:41.460477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:41.461289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:41.461942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:41.463037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:41.463684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:41.464299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:41.611728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:41.627685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b2089e3c-5703-4066-9943-0c7d6dc66880 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1531 microversion: 2.1 time: 0.180613 Aug 30 18:54:41.628376 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3263/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:41 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1531 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:42.649698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:42.651221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:42.660066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:42.661042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:42.661730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:42.662769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:42.663452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:42.664250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:42.832181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:42.840652 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab21cf3f-ac70-4078-91ba-59ebe52538c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.195287 Aug 30 18:54:42.841413 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3116/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:42 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:43.532433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:43.557048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:43.558514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:43.559188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:43.574124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] Creating event network-vif-plugged:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:54:43.579693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0052e0e5-945e-4ba4-a8fe-a88dd5af7395 req-e18fbb19-e962-4685-8cae-1a84ded3b2f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051790 Aug 30 18:54:43.581749 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3264/6380] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:43.866721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:43.867979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:43.875303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:43.875811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:43.876272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:43.877002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:43.877739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:43.878385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:44.057421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:44.066330 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-188ff5b8-3451-43cf-8daf-20bf693f0261 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.205513 Aug 30 18:54:44.079534 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3117/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:43 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:45.089382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:45.090890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:45.097795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.098794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.099301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.100416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:45.101121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:45.101748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:45.279738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:45.294904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c1482fe4-e45e-4583-8f43-6f675bfd24e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.210516 Aug 30 18:54:45.306978 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3265/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:45 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:46.320430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:46.321934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:46.330677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:46.331586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:46.332101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:46.332977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:46.333552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:46.334092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:46.497947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:46.506928 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91218aae-d36b-425c-9449-0eaf0c375fcc tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.190812 Aug 30 18:54:46.510844 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3118/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:46 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:47.530643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:47.531788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:47.549079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:47.549781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:47.551120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:47.552220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:47.552809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:47.553490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:47.740293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:47.756069 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3450920b-930c-425a-af7f-692be00b29ea tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.229111 Aug 30 18:54:47.759165 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3266/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:47 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:48.780959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:48.782313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:48.790798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:48.791860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:48.792331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:48.793127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:48.793525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:48.794229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:48.976364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:48.990379 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-62ff5595-7fd7-4543-9810-aa3fd04b2f62 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.213775 Aug 30 18:54:48.990996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3119/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:48 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:54:50.012163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:50.012751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:50.015974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=68 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:50.022373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:50.023274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:50.023614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:50.024377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:50.025010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:50.025434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:50.206938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:50.231372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a22fce5f-3217-4620-ae39-edcea55ad861 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.222661 Aug 30 18:54:50.232788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3267/6386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:50 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:51.255845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:51.256423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:51.259306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=64 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:54:51.264701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:51.265353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:51.265744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:51.266500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:51.266970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:51.267411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:51.427265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:51.437081 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36135ed4-edc6-4841-9630-61db2cfd94ec tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.186875 Aug 30 18:54:51.445560 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3120/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:51 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:52.459614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:52.460249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:52.468250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:52.468753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:52.469191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:52.469927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:52.470435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:52.470868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:52.626897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:52.637159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f8f5dd4-4bcd-4345-813e-1e8570f68b73 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1526 microversion: 2.1 time: 0.181803 Aug 30 18:54:52.638673 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3268/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:52 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:53.663099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:53.663702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:53.671591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:53.672216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:53.672667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:53.673415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:53.673883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:53.674393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:53.821254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:53.829533 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c133cd24-8f11-4911-8ae9-2c81c2ae2068 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1508 microversion: 2.1 time: 0.170851 Aug 30 18:54:53.830117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3121/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:53 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:54.851322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:54.851871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:54.859324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:54.859823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:54.860259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:54.860971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:54.861425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:54.861850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:55.009006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:55.017489 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f6408bc-5c95-483d-9bc4-a1a4637f19cb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1508 microversion: 2.1 time: 0.170209 Aug 30 18:54:55.018099 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3269/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:54 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:55.484797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "name": "network-vif-unplugged", "status": "completed", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:55.497563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:55.498255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:55.498750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:55.513446 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] Creating event network-vif-unplugged:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:54:55.519999 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d5573c1b-342e-490d-8021-8846789928b1 req-6be6a83d-13ae-4da8-9af0-a38ede87a4cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039529 Aug 30 18:54:55.520634 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3122/6391] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:54:56.039793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:56.040415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.047990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.048491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.048931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.049755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.050601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.051033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.196570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:56.204818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b41fda2e-d555-4a3d-b843-12f98bfc1476 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1451 microversion: 2.1 time: 0.169008 Aug 30 18:54:56.205404 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3270/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:56 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:56.229201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:56.229932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.236838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.237432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.237887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.238671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.239146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.239591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.383840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:56.392147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e9eb9a9-cc1b-447f-b829-770c0d912dd3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1451 microversion: 2.1 time: 0.167306 Aug 30 18:54:56.392776 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3123/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:56 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:56.456026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:56.457240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.463926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.464391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.464826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.465537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.466007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.466455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.492970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lazy-loading 'flavor' on Instance uuid ff33967c-2b83-48ac-833a-74ae23bc3bd2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:54:56.507460 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'shelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state shelved_offloaded Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 14 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: {"shelve": {}} Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'shelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state shelved_offloaded Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'shelve': {}}} Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:54:56.509475 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state shelved_offloaded Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state shelved_offloaded Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'shelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state shelved_offloaded {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ef3d4bc6-4254-4402-a079-4facc141dfe0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 155 microversion: 2.1 time: 0.059215 Aug 30 18:54:56.513901 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3271/6394] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:56 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 155 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:54:56.521209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:54:56.521835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.529237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.529740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.530197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.530955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.531426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.531866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.579516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122590) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 18:54:56.662102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80b26108-f426-41a0-b504-76a9d11fd8be tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.145131 Aug 30 18:54:56.668247 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3124/6395] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:54:56 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:54:56.673744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:56.674528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:56.681949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.683105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.683105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.683941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:56.684466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:56.685023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:56.862686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:56.877480 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c79db89-ca2e-4539-83ce-21abb32ea092 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1459 microversion: 2.1 time: 0.207690 Aug 30 18:54:56.881451 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3272/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:56 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1459 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:57.906632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:57.907742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:57.918716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:57.919478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:57.920173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:57.921184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:57.921837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:57.922509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:58.106831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:58.119794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5954d5a1-b3a3-49b4-9680-0b4897d90480 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.221066 Aug 30 18:54:58.120409 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3125/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:57 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:54:59.143306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:54:59.144467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:54:59.155111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:59.155837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:59.156344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:59.157278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:54:59.157805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:54:59.158293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:54:59.413717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:54:59.428499 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ffc417d-3733-49d3-b2b4-8492c8ea3742 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.290010 Aug 30 18:54:59.429571 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3273/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:54:59 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:00.455072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:00.457101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:00.471155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:00.473558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:00.474460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:00.475832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:00.476641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:00.477370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:00.485406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:00.722576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:00.731595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6b4be6a-ba60-4ab9-94a0-a6fcf2b59548 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.281769 Aug 30 18:55:00.732310 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3126/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:00 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:01.756915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:01.760762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:01.765969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:01.766510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:01.766966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:01.767679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:01.768195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:01.768694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:01.952075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:01.965676 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd3fbae7-c22f-4958-a241-4cd925f10443 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.213173 Aug 30 18:55:01.984048 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3274/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:01 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:02.989696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:02.991137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:02.998937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:02.999529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:03.000051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:03.000788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:03.001263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:03.001700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:03.170441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:03.179875 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-019a97a6-8fa3-46fc-bbae-169c487399c3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.194659 Aug 30 18:55:03.180548 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3127/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:02 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:04.202988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:04.203611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:04.210563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:04.211110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:04.211552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:04.212263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:04.213032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:04.213411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:04.396189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:04.406368 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c435f69-0364-461a-9911-9972f05f1fb3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.207414 Aug 30 18:55:04.407091 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3275/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:04 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:05.430994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:05.431635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:05.439390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:05.439910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:05.440436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:05.441164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:05.441639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:05.442086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:05.594690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:05.603303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d355b605-0b88-4bc2-88b1-65b1f016e35c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.176255 Aug 30 18:55:05.604939 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3128/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:05 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:06.625213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:06.626061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:06.634151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:06.634671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:06.635107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:06.635813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:06.636535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:06.636939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:06.795463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:06.801789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=91 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:06.809950 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-344c7771-8a2a-48d2-b332-41247462ed74 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.188610 Aug 30 18:55:06.810691 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3276/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:06 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:07.832593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:07.833230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:07.840204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:07.840707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:07.841156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:07.841879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:07.842362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:07.842837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:07.997656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:08.007027 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c9727d1-91da-4c37-ad95-a77a911d358f tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.178678 Aug 30 18:55:08.007629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3129/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:07 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:09.028831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:09.029458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:09.037027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:09.037508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:09.037939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:09.038662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:09.039113 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:09.039533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:09.180054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:09.188637 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06f4ba94-eeb5-495b-92ce-6e1828c10a4d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.163893 Aug 30 18:55:09.189222 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3277/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:09 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:10.211343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:10.211968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:10.219626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:10.220131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:10.220585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:10.221308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:10.221768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:10.222201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:10.372188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:10.380530 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86eed8be-5053-4d4d-82da-8ea736ef0eb2 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.173903 Aug 30 18:55:10.381083 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3130/6407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:10 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:11.405001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:11.405639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:11.413771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:11.414264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:11.414727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:11.415443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:11.415901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:11.416309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:11.564499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:11.573125 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21221bb5-7c44-482d-80e0-3d36c7f4790d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.172894 Aug 30 18:55:11.574383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3278/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:11 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:11.607971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:11.620350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:11.620930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:11.621377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:11.634260 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] Creating event network-vif-plugged:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:55:11.639636 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ed2d3f98-c8ec-4bc1-8951-93db18762639 req-951a2aef-c7e0-4eae-a46f-d0061442d807 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036049 Aug 30 18:55:11.640315 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3131/6409] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:55:12.595461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:12.596121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:12.604306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:12.604810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:12.605248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:12.605997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:12.606487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:12.606914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:12.759651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:12.770699 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da08e312-be6a-43c7-adda-879c1e854a8c tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1517 microversion: 2.1 time: 0.179100 Aug 30 18:55:12.771765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3279/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:12 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:13.796429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:13.797162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:13.806073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:13.806605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:13.807053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:13.807791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:13.808412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:13.809000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:13.955921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:13.965362 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69764033-253f-4667-b76f-6867203576e7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.175882 Aug 30 18:55:13.965967 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3132/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:13 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:13.986396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:13.987006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:13.994935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:13.995450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:13.995878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:13.996792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:13.997243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:13.997704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.144428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:14.154301 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-019b6b7d-f426-4396-9f45-1d2663c6e492 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.171732 Aug 30 18:55:14.155010 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3280/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:13 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:14.182104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:14.182770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:14.189079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.189580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.190032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.190787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.191256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.191701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.385814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:14.394742 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-53742831-4d13-4555-b9ce-23b36160592a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.216524 Aug 30 18:55:14.395356 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3133/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:14.422132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c638c0f-ece6-41e3-8d0b-802443e5d56d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:14.429091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9c638c0f-ece6-41e3-8d0b-802443e5d56d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c638c0f-ece6-41e3-8d0b-802443e5d56d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/0ceb7a38-7bd0-47ce-a36b-260626c7cfe0/action HTTP/1.1 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 15 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: {"os-stop": {}} Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '0ceb7a38-7bd0-47ce-a36b-260626c7cfe0', 'body': {'os-stop': {}}} Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:14.441000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c638c0f-ece6-41e3-8d0b-802443e5d56d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 0ceb7a38-7bd0-47ce-a36b-260626c7cfe0 has no mapping to a cell. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c638c0f-ece6-41e3-8d0b-802443e5d56d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/0ceb7a38-7bd0-47ce-a36b-260626c7cfe0/action" status: 404 len: 117 microversion: 2.1 time: 0.024506 Aug 30 18:55:14.446281 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3281/6414] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:14 2022] POST /compute/v2.1/servers/0ceb7a38-7bd0-47ce-a36b-260626c7cfe0/action => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:14.452880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:14.453521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:14.460040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.460621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.461080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.461815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.462290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.462762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.600345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:14.608812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9dcc3c44-d7cd-4814-84cb-27d5d14bf963 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.160185 Aug 30 18:55:14.609397 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3134/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:14.629499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:14.630195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:14.637137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.637620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.638058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.638789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.639237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.640066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.784794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:14.801793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c8f38ca-3889-4141-9782-81371dc570b5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.176228 Aug 30 18:55:14.802604 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3282/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:14.828142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:14.828726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 95b06485-ebde-492e-8546-8dbd614f728f] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:14.837015 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/95b06485-ebde-492e-8546-8dbd614f728f/action HTTP/1.1 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: {"suspend": {}} Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '95b06485-ebde-492e-8546-8dbd614f728f', 'body': {'suspend': {}}} Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:14.838713 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 95b06485-ebde-492e-8546-8dbd614f728f could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4661a22-a91f-4460-8d35-f7d0d18af611 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/95b06485-ebde-492e-8546-8dbd614f728f/action" status: 404 len: 111 microversion: 2.1 time: 0.017804 Aug 30 18:55:14.843736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3135/6417] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:14 2022] POST /compute/v2.1/servers/95b06485-ebde-492e-8546-8dbd614f728f/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:14.849521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:14.850176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:14.856743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.857231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.857742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:14.858434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:14.859029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:14.859277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.003950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:15.011973 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c6b216a1-4dd0-401f-a256-4c642b6259d8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.166711 Aug 30 18:55:15.012558 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3283/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:14 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:15.033715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:15.034536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:15.043693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.044189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.044636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.045357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.045822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.046242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.188001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:15.197563 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1717dd09-7839-45ba-990e-ae6dad752c79 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.168220 Aug 30 18:55:15.198128 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3136/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:15 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:15.218628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:15.219176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:15.225819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.226305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.226775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.227487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.227937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.228369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.252956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lazy-loading 'flavor' on Instance uuid ff33967c-2b83-48ac-833a-74ae23bc3bd2 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:55:15.331052 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-36f03b29-ccab-4cb8-acb7-3658e4a0274e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.116131 Aug 30 18:55:15.331506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3284/6420] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:15 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:55:15.339856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:15.340756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:15.349680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.350234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.350712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.351548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:15.352189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:15.352537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:15.485259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:15.493981 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ef13297-e19d-4665-97fe-c796c5033960 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1512 microversion: 2.1 time: 0.157995 Aug 30 18:55:15.494583 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3137/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:15 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:16.518487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:16.519192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:16.526485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.526974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.527435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.528140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.528678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.528999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.670725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:16.680960 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d01140c-b8ab-42eb-83c0-052ae418cff0 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1495 microversion: 2.1 time: 0.168566 Aug 30 18:55:16.681729 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3285/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:16 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1495 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:55:16.702800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:16.703374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:16.710701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.711192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.711645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.712370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.712839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.713279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.738680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lazy-loading 'flavor' on Instance uuid ff33967c-2b83-48ac-833a-74ae23bc3bd2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:55:16.753572 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'suspend' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state suspended Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: {"suspend": {}} Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: exception: Cannot 'suspend' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state suspended Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'suspend': {}}} Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 30 18:55:16.755420 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state suspended Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state suspended Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'suspend' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state suspended {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7c0cf60-edd9-43ef-8c75-44f36dcdc465 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 148 microversion: 2.1 time: 0.059255 Aug 30 18:55:16.760352 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3138/6423] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:16 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 148 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:55:16.768359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:16.768897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:16.775936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.776441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.776882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.777586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.778037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.778492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.878878 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cba24595-467e-4cb3-aec2-3a13bdbb17b4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.113915 Aug 30 18:55:16.879622 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3286/6424] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:16 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:55:16.889289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:16.890021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:16.896724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.897419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.898065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:16.898955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:16.899610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:16.900134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:17.049895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:17.059066 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1012a53c-b333-4076-9037-04cfbdb9e429 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1501 microversion: 2.1 time: 0.173722 Aug 30 18:55:17.060084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3139/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:16 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:18.083931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:18.084646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:18.092423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:18.092908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:18.093342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:18.094028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:18.094508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:18.094926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:18.246396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:18.254812 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b90aadd1-1c0f-429c-a68a-c0a0507505d1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1501 microversion: 2.1 time: 0.177444 Aug 30 18:55:18.266567 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3287/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:18 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:19.277628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:19.278247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:19.288091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.289648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.290299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.291214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.292062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.292654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.446746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:19.455460 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0158c493-f867-4e62-a008-83249be0a9ae tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.182444 Aug 30 18:55:19.456048 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3140/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:19.480261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:19.480870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:19.487861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.488349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.488784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.489494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.490088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.490425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.656553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:19.665524 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5002309d-f0a0-432e-b9a8-a313468dfbbf tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.189721 Aug 30 18:55:19.666127 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3288/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:19.687005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:19.687561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 36cde73c-fe04-4c26-a430-18ac544727e6] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:19.693683 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/36cde73c-fe04-4c26-a430-18ac544727e6/action HTTP/1.1 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 15 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: {"unpause": {}} Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '36cde73c-fe04-4c26-a430-18ac544727e6', 'body': {'unpause': {}}} Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:19.695615 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 36cde73c-fe04-4c26-a430-18ac544727e6 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-496f2556-d1e8-49f8-8e5a-7bbbbc27c440 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/36cde73c-fe04-4c26-a430-18ac544727e6/action" status: 404 len: 111 microversion: 2.1 time: 0.014274 Aug 30 18:55:19.700767 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3141/6429] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:19 2022] POST /compute/v2.1/servers/36cde73c-fe04-4c26-a430-18ac544727e6/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:19.711301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:19.711913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:19.718011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.718501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.718924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.719647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.720058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.720454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.866396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:19.874978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ee5777e-c013-428d-b9d6-bbc17cb397e1 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.167504 Aug 30 18:55:19.875517 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3289/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:19.900061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:19.900698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:19.910001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.910538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.910992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:19.911720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:19.912271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:19.912931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.053633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:20.062213 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-90d2de6c-9175-4596-8306-1a3601c23147 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.167883 Aug 30 18:55:20.062846 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3142/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:19 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:20.083429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:20.084066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.086287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=46 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:20.092621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.093144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.093658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.094574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.095149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.095626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.121057 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'unpause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 15 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: {"unpause": {}} Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'unpause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'unpause': {}}} Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state active. Cannot unpause while the instance is in this state. Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.122831 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'unpause' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ef8af359-9a4e-48e1-9455-ad2427d3d5f5 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 145 microversion: 2.1 time: 0.045454 Aug 30 18:55:20.128073 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3290/6432] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:20 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 145 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:55:20.133636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:20.134263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.140448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.140938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.141390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.142117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.142609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.143076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.295479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:20.305233 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-72584389-ed33-4aef-a1bc-7fbaff65f3f4 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.174894 Aug 30 18:55:20.305872 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3143/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:55:20.327597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:20.328202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.334306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.334726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.335213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.336004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.336363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.337072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.479078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:20.488465 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-725258d5-e012-441f-bb59-7fc2149814e8 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.164837 Aug 30 18:55:20.490022 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3291/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:55:20.510795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:20.511421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: 9c7ba559-21f7-4c1c-85d1-773750d1605e] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.517672 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/9c7ba559-21f7-4c1c-85d1-773750d1605e/action HTTP/1.1 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 18 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: {"unshelve": null} Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '9c7ba559-21f7-4c1c-85d1-773750d1605e', 'body': {'unshelve': None}} Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.519243 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance 9c7ba559-21f7-4c1c-85d1-773750d1605e could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c088c96a-43b5-4706-83d8-01bf8bbd6123 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/9c7ba559-21f7-4c1c-85d1-773750d1605e/action" status: 404 len: 111 microversion: 2.1 time: 0.015069 Aug 30 18:55:20.523545 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3144/6435] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:20 2022] POST /compute/v2.1/servers/9c7ba559-21f7-4c1c-85d1-773750d1605e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:20.530695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:20.531401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.537494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.538051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.538646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.539606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.540057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.540481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.543271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:20.688147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:20.696313 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2cdd3b45-0338-4a5d-b0f3-52ca77a30be3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.169594 Aug 30 18:55:20.696904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3292/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:20.717577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:20.718210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.730758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.731299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.731727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.732468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.732942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.733360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.888200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:20.918733 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d82e112e-c668-4354-9602-192935f2ecfb tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.204594 Aug 30 18:55:20.920827 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3145/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:20 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:20.945357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:20.946074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:20.953080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.953920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.954382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:20.955100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:20.955555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:20.956020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.111207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Cannot 'unshelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action HTTP/1.1 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 18 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: {"unshelve": null} Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: exception: Cannot 'unshelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'unshelve': None}} Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 in vm_state active. Cannot unshelve while the instance is in this state. Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 18:55:21.112823 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 409 to user: Cannot 'unshelve' instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 while it is in vm_state active {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:21.118164 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9d0c8aff-6521-420d-bce6-2ac6a69a3811 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action" status: 409 len: 146 microversion: 2.1 time: 0.174285 Aug 30 18:55:21.124137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:21.124761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:21.126651 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3293/6438] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 18:55:20 2022] POST /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2/action => generated 146 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 18:55:21.131739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.132672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.133212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.134027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.134623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.135154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.151043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=100 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:21.289957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:21.298576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e7e577e-dd75-4a90-b7d0-12ca0f13d06e tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.178226 Aug 30 18:55:21.299223 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3146/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:21 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:21.418414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:21.419345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:21.426131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.426658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.427095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.427804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.428311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.428738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.590907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:21.599075 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b0077c1-9162-4460-b446-afe615b94536 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.184995 Aug 30 18:55:21.599638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3294/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:21 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:21.620612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1168333751_updated"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:21.623333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: d5460225-fa81-4aed-8fb8-dc1309dc822a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:21.625267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:55:21.630273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/servers/d5460225-fa81-4aed-8fb8-dc1309dc822a HTTP/1.1 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 81 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1168333751_updated"}} Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'd5460225-fa81-4aed-8fb8-dc1309dc822a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1168333751_updated'}}} Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 18:55:21.632061 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance d5460225-fa81-4aed-8fb8-dc1309dc822a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4282efcf-9b80-4796-9014-aed91dbb7809 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "PUT /compute/v2.1/servers/d5460225-fa81-4aed-8fb8-dc1309dc822a" status: 404 len: 111 microversion: 2.1 time: 0.018069 Aug 30 18:55:21.636817 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3147/6441] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:55:21 2022] PUT /compute/v2.1/servers/d5460225-fa81-4aed-8fb8-dc1309dc822a => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:21.642754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:21.643396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:21.653642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.654156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.654613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.655316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.655784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.656204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.792738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:21.801042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4b73cd5-3b7c-43f1-9cce-70982e258def tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.162135 Aug 30 18:55:21.801704 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3295/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:21 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:21.822198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:21.822791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:21.831381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.831885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.832339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.833066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:21.833540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:21.834040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:21.974934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:21.983338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c7f05d8-e937-4cf2-84af-c25f9e848b33 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.165272 Aug 30 18:55:21.984100 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3148/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:21 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:22.003535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d81b697-60a3-4d6c-8165-064e3c624a7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d81b697-60a3-4d6c-8165-064e3c624a7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: request: PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 HTTP/1.1 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 280 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.007461 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d81b697-60a3-4d6c-8165-064e3c624a7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d81b697-60a3-4d6c-8165-064e3c624a7a tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 400 len: 619 microversion: 2.1 time: 0.009375 Aug 30 18:55:22.011735 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3296/6444] 10.222.0.25 () {60 vars in 1257 bytes} [Tue Aug 30 18:55:21 2022] PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 18:55:22.017669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:22.018309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:22.024678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.025189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.025643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.026528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.026968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.027464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.173639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:22.182096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f992ae7-5bd2-4bfc-bc78-7285e4e999ce tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.168344 Aug 30 18:55:22.182736 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3149/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:22 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:22.203585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:22.204188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:22.211149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.211636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.212068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.212764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.213225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.213640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.371278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:22.379678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8bfbaed-10f5-4c4a-b80e-0f6bf934fbe3 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.179888 Aug 30 18:55:22.380362 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3297/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:22 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:22.401472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86102ac0-fa40-4ab4-a08b-3ff58a4d291d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86102ac0-fa40-4ab4-a08b-3ff58a4d291d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: request: PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 HTTP/1.1 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 24 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: {"server": {"name": ""}} Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2', 'body': {'server': {'name': ''}}} Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi '' Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 18:55:22.405166 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86102ac0-fa40-4ab4-a08b-3ff58a4d291d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86102ac0-fa40-4ab4-a08b-3ff58a4d291d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 400 len: 108 microversion: 2.1 time: 0.009869 Aug 30 18:55:22.409595 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3150/6447] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 18:55:22 2022] PUT /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 18:55:22.419671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:22.420384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:22.427783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.428277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.429305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.430002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:22.430488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:22.430915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:22.640138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:22.649156 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89747e51-0195-47d3-80a2-e2c89b240bbe tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1504 microversion: 2.1 time: 0.233624 Aug 30 18:55:22.649766 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3298/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:22 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:27.130242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:27.130915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:27.141636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.142531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.143420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.144479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.145103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.145695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.164205 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 HTTP/1.1 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f1708c9b-f31d-4de0-9edc-65108a7fcc95'} Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:27.166219 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.170147 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.173388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:27.174301 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ccf6ee79-1403-450a-9ef9-a93f4622d064 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 404 len: 111 microversion: 2.1 time: 0.049325 Aug 30 18:55:27.174921 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3151/6449] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:55:27 2022] DELETE /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:27.184312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:27.185502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: f1708c9b-f31d-4de0-9edc-65108a7fcc95] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:27.194042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.194864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.195457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.196351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.196989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.197598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.216146 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 HTTP/1.1 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f1708c9b-f31d-4de0-9edc-65108a7fcc95'} Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:27.218000 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. Aug 30 18:55:27.222625 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:27.224907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance f1708c9b-f31d-4de0-9edc-65108a7fcc95 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:27.226092 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55969862-fe31-4077-8550-7a5d8856484d tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95" status: 404 len: 111 microversion: 2.1 time: 0.046159 Aug 30 18:55:27.227302 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3299/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:27 2022] GET /compute/v2.1/servers/f1708c9b-f31d-4de0-9edc-65108a7fcc95 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:55:27.235679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:27.236529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:27.243872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.245020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.245686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.246771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.247740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.248939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.279946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:55:27.384073 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-27889ade-6596-4e86-b039-85d06078e491 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 204 len: 0 microversion: 2.1 time: 0.150912 Aug 30 18:55:27.386182 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3152/6451] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:55:27 2022] DELETE /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 18:55:27.396430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:27.397299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:27.432625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.433183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.433630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.434538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:27.435208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:27.435809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:27.615011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:27.623458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5aefdc5f-58d5-4e38-be44-a498a6d7a9c7 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.232494 Aug 30 18:55:27.624039 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3300/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:27 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:28.645864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:28.646879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:28.655083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:28.655612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:28.656098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:28.657372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:28.657642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:28.658095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:28.873436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:28.883279 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5315ee2-c785-45c4-abca-2a7f2e2fb8a6 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1510 microversion: 2.1 time: 0.240378 Aug 30 18:55:28.883873 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3153/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:28 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:55:29.904987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:29.906380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:29.915690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:29.916513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:29.917155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:29.918104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:29.918766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:29.919364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:29.920853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33967c-2b83-48ac-833a-74ae23bc3bd2", "name": "network-vif-deleted", "tag": "c2272d07-3877-4642-aba3-dd57817c09f7"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:55:29.949120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:29.949352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:29.949777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:29.958718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:29.959440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:29.960835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:29.962493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lazy-loading 'fault' on Instance uuid ff33967c-2b83-48ac-833a-74ae23bc3bd2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:55:29.971864 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] Creating event network-vif-deleted:c2272d07-3877-4642-aba3-dd57817c09f7 for instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 on n-h2-854119-10 Aug 30 18:55:29.980321 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7ed63499-cfab-4caf-a3d7-9aa5253ddf48 req-b50d85aa-f1a0-4f8e-81a2-1d22ac244f6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260221 Aug 30 18:55:29.980943 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3301/6454] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:55:30.013667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bc7574f65541369d8fca3aa7292329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728ab02b517b4a4e8459726c69162d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:55:30.022099 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-479f7d3b-f858-4210-8a2f-6a15357cfd23 tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 200 len: 1307 microversion: 2.1 time: 0.121855 Aug 30 18:55:30.022986 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3154/6455] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:29 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:55:31.045644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:55:31.046498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] [instance: ff33967c-2b83-48ac-833a-74ae23bc3bd2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:55:31.053920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:31.054447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:31.055509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:31.055772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:55:31.056230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:55:31.056654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:55:31.071960 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] HTTP exception thrown: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Request method failure captured: Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 HTTP/1.1 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyjObwziSSEUpqlA6KdnOseS-j7RKAZBSQekdrVI8Y5FhzJI0-u8R73R2HqCLn4yH-ZlxPayLfyrj2jqDQo4YkpByrgKwGC8O_dzy3M7ozHhO8k6MIcQO4M4s6FRiYc46O_HQe6vWLTm_W0ubO89F42S6kpdTz1MfGTV_lrDcMMTMc Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/728ab02b517b4a4e8459726c69162d06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_728ab02b517b4a4e8459726c69162d06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 728ab02b517b4a4e8459726c69162d06 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1920646797 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e2bc7574f65541369d8fca3aa7292329 Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1920646797-project Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'ff33967c-2b83-48ac-833a-74ae23bc3bd2'} Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:55:31.073552 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] Returning 404 to user: Instance ff33967c-2b83-48ac-833a-74ae23bc3bd2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b92c06db-7d80-4980-bdab-aeb2c70248aa tempest-ServersNegativeTestJSON-1920646797 tempest-ServersNegativeTestJSON-1920646797-project] 10.222.0.25 "GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2" status: 404 len: 111 microversion: 2.1 time: 0.034779 Aug 30 18:55:31.077610 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3302/6456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:55:31 2022] GET /compute/v2.1/servers/ff33967c-2b83-48ac-833a-74ae23bc3bd2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:57:52.694729 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:57:52.696319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:57:52.697635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:57:52.699150 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:57:52.699532 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 18:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.25) !!! Aug 30 18:57:52.700870 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:57:52.701185 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 18:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.25) !!! Aug 30 18:57:52.885291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85097460-96ca-48f3-b232-48476ca359b1 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-864367552", "availability_zone": "foo_zone"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:52.908501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.aggregate [None req-85097460-96ca-48f3-b232-48476ca359b1 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Generated uuid 115f7402-2703-4868-8d1e-967d1b4e1046 for aggregate {{(pid=122590) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 18:57:52.972409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85097460-96ca-48f3-b232-48476ca359b1 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.283721 Aug 30 18:57:52.975704 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3155/6457] 10.222.0.25 () {60 vars in 1164 bytes} [Tue Aug 30 18:57:52 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:52.985740 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 18:57:52.986657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=23 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:57:52.988761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=45 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:57:52.990694 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 18:57:52.990851 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 18:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.25) !!! Aug 30 18:57:52.992801 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 18:57:52.992945 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 18:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.25) !!! Aug 30 18:57:52.999314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e31e6104-9060-4f8b-ab17-5a6ad385d975 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:53.045665 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e31e6104-9060-4f8b-ab17-5a6ad385d975 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.062149 Aug 30 18:57:53.061996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:57:53.067628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3303/6458] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:57:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.067988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:57:53.068526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:57:53.068989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:57:53.069831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:57:53.070526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:57:53.071163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:57:53.101414 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0d58c037-1aee-435f-b466-989f258fe4b6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044750 Aug 30 18:57:53.114267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6926dcc1-b90e-4c1e-9949-42bc00f96b46 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:57:53.121230 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3156/6459] 10.222.0.25 () {58 vars in 1176 bytes} [Tue Aug 30 18:57:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.123744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6926dcc1-b90e-4c1e-9949-42bc00f96b46 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013549 Aug 30 18:57:53.136582 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3304/6460] 10.222.0.25 () {58 vars in 1143 bytes} [Tue Aug 30 18:57:53 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.137789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ff23076-2b49-4e56-a673-67d5cd5ca464 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854119-10"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:53.150197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ff23076-2b49-4e56-a673-67d5cd5ca464 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:57:53.151034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ff23076-2b49-4e56-a673-67d5cd5ca464 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:57:53.151726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ff23076-2b49-4e56-a673-67d5cd5ca464 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:57:53.588071 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ff23076-2b49-4e56-a673-67d5cd5ca464 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.454875 Aug 30 18:57:53.592091 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3157/6461] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:57:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.601984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec701fbc-f7f0-4dc1-ab9c-c11ad4dd7c2f tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:57:53.613113 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec701fbc-f7f0-4dc1-ab9c-c11ad4dd7c2f tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016387 Aug 30 18:57:53.632769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96bde5ce-db33-4ef4-9ce4-6afbf25f196a tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-543358581", "availability_zone": "foo_zone"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:53.636710 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3305/6462] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:57:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.807462 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54944. Aug 30 18:57:53.906283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96bde5ce-db33-4ef4-9ce4-6afbf25f196a tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.284152 Aug 30 18:57:53.909994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3158/6463] 10.222.0.25 () {60 vars in 1173 bytes} [Tue Aug 30 18:57:53 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.921260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8b99b09-da15-42dd-b50c-bcfa13c2350d tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:53.964434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8b99b09-da15-42dd-b50c-bcfa13c2350d tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.046388 Aug 30 18:57:53.966410 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3306/6464] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:57:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:53.978445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d462581c-68f9-4645-810d-3444e59c50be tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:57:53.997472 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d462581c-68f9-4645-810d-3444e59c50be tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.016938 Aug 30 18:57:53.999407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3159/6465] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Aug 30 18:57:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:54.012111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3c21da4-bc02-4772-ae39-5e787e888aa6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854119-10"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:57:54.043807 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54952. Aug 30 18:57:54.049316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c21da4-bc02-4772-ae39-5e787e888aa6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:57:54.051959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c21da4-bc02-4772-ae39-5e787e888aa6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:57:54.053671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3c21da4-bc02-4772-ae39-5e787e888aa6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:57:54.390104 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3c21da4-bc02-4772-ae39-5e787e888aa6 tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.383006 Aug 30 18:57:54.391596 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3307/6466] 10.222.0.25 () {60 vars in 1194 bytes} [Tue Aug 30 18:57:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:57:54.403622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-137aeead-6952-4beb-8595-1d6482f01daf tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:57:54.442469 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-137aeead-6952-4beb-8595-1d6482f01daf tempest-TestAggregatesBasicOps-1204871121 tempest-TestAggregatesBasicOps-1204871121-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.043202 Aug 30 18:57:54.443930 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3160/6467] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 18:57:54 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 18:58:37.788409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:37.789644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:38.073028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:38.075699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:38.089050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:38.089936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:38.090745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:38.092008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:38.092833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:38.093604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:38.131938 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:58:38.231008 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [62babd2a-9e46-43a1-a733-26f8e466de8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:58:39.240282 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [62babd2a-9e46-43a1-a733-26f8e466de8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55430. Aug 30 18:58:39.266747 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-098ac91b-21b0-4b39-849a-f174f63e3c80 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 204 len: 0 microversion: 2.1 time: 1.482597 Aug 30 18:58:39.267993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3308/6468] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:58:37 2022] DELETE /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 0 bytes in 1485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:58:39.275675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:39.277396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:39.278024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:58:39.283135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:39.283769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:39.295422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:39.295931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:39.296378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:39.297108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:39.297582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:39.298019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:39.486360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:58:39.498264 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbb5aa6d-816f-4f86-a337-2008801742fa tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1731 microversion: 2.1 time: 0.224542 Aug 30 18:58:39.498801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3161/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:58:39 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:58:40.521779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:40.523230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:40.532715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:40.533535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:40.534516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:40.535528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:40.536167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:40.536779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:40.732028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:58:40.743334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6a9708e0-48b6-4fbc-bc2b-a14d63f16897 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1731 microversion: 2.1 time: 0.226707 Aug 30 18:58:40.744544 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3309/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:58:40 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:58:41.797514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:41.798213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:41.828856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:41.829106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:41.833062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:41.834083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:41.834961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:41.836036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:41.997223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbf64d66f9d412aaf33eb66c4438ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '118b28e48f2e4ec7b8496ee5dd6829bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:58:42.023816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c0f9dc31-0dfe-4ff1-ab98-f15d758886a5 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 200 len: 1384 microversion: 2.1 time: 0.240448 Aug 30 18:58:42.024962 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3162/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:58:41 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 1384 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:58:42.219909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf33bde1-b04a-4be1-aefa-b5955fb8e174", "name": "network-vif-deleted", "tag": "2b443b93-e8d7-48f2-a419-815664f26781"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:58:42.231072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:42.231912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:42.232521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:42.246746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] Creating event network-vif-deleted:2b443b93-e8d7-48f2-a419-815664f26781 for instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 on n-h1-854119-10 Aug 30 18:58:42.254287 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8d89261d-3054-4317-b638-9be1dbf060fe req-10ef264f-bac9-426f-9f63-334fb0b0c0a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.470826 Aug 30 18:58:42.256274 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3310/6472] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:58:43.045662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:43.046312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:43.057871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.058569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.059031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.059786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.060262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.060714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.078175 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] HTTP exception thrown: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Request method failure captured: Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 HTTP/1.1 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyZJx8_TQ04SzAAQyZ6JJ48h9ahN3bl9EBXn9LpQIiInDY3p0DpgHxrRAn8INkNWSA8NqsvQgbAH9TAupdlgYbN8SVVud7mE6RgAEQ-jWHOGQCSvVTzU0_6rG8iOipEgIjb0eyhtTj9Jrwap73JyuBmh7W_ukk6zqiJMS190pr_-Y4 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ebbf64d66f9d412aaf33eb66c4438ab2 Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bf33bde1-b04a-4be1-aefa-b5955fb8e174'} Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.080019 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Returning 404 to user: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a1f8f9f-ab86-4615-bc09-80bdf8d669e6 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 404 len: 111 microversion: 2.1 time: 0.040221 Aug 30 18:58:43.088800 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3163/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:58:43 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:58:43.634967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:43.635692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:43.642366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.642868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.643515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.644362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.644987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.645419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.660535 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] HTTP exception thrown: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Request method failure captured: Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 HTTP/1.1 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDlyZJx8_TQ04SzAAQyZ6JJ48h9ahN3bl9EBXn9LpQIiInDY3p0DpgHxrRAn8INkNWSA8NqsvQgbAH9TAupdlgYbN8SVVud7mE6RgAEQ-jWHOGQCSvVTzU0_6rG8iOipEgIjb0eyhtTj9Jrwap73JyuBmh7W_ukk6zqiJMS190pr_-Y4 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ebbf64d66f9d412aaf33eb66c4438ab2 Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bf33bde1-b04a-4be1-aefa-b5955fb8e174'} Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:58:43.662227 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Returning 404 to user: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0fbac95d-ca67-491b-b286-1df2ea4dffeb tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 404 len: 111 microversion: 2.1 time: 0.034473 Aug 30 18:58:43.667580 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3311/6474] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:58:43 2022] DELETE /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:58:43.672793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:43.673430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] [instance: bf33bde1-b04a-4be1-aefa-b5955fb8e174] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:58:43.679978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.680481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.680933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.681741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:58:43.682236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:58:43.682687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:58:43.697976 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] HTTP exception thrown: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Request method failure captured: Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 HTTP/1.1 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDlyZJx8_TQ04SzAAQyZ6JJ48h9ahN3bl9EBXn9LpQIiInDY3p0DpgHxrRAn8INkNWSA8NqsvQgbAH9TAupdlgYbN8SVVud7mE6RgAEQ-jWHOGQCSvVTzU0_6rG8iOipEgIjb0eyhtTj9Jrwap73JyuBmh7W_ukk6zqiJMS190pr_-Y4 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_118b28e48f2e4ec7b8496ee5dd6829bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 118b28e48f2e4ec7b8496ee5dd6829bf Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestServerBasicOps-1356773433 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: ebbf64d66f9d412aaf33eb66c4438ab2 Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestServerBasicOps-1356773433-project Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bf33bde1-b04a-4be1-aefa-b5955fb8e174'} Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:58:43.699600 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Returning 404 to user: Instance bf33bde1-b04a-4be1-aefa-b5955fb8e174 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:58:43.704264 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f653bbea-828f-4a23-bc19-8d0ed05cf79d tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174" status: 404 len: 111 microversion: 2.1 time: 0.032242 Aug 30 18:58:43.705126 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3164/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:58:43 2022] GET /compute/v2.1/servers/bf33bde1-b04a-4be1-aefa-b5955fb8e174 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 18:58:43.913372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e791c27-f3af-49e0-83bc-83efac72c3e7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] Calling method '.version_select at 0x7f4e55b83c10>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:58:43.939992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e791c27-f3af-49e0-83bc-83efac72c3e7 tempest-TestServerBasicOps-1356773433 tempest-TestServerBasicOps-1356773433-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1063097857" status: 202 len: 0 microversion: 2.1 time: 0.031501 Aug 30 18:58:43.941318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3312/6476] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 18:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1063097857 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 18:59:20.231730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:20.232494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:20.394853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-574644654", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "0c74b829-b286-4aab-bcdc-4dbe01097128"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:20.599818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] validate_networks() for [('0c74b829-b286-4aab-bcdc-4dbe01097128', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 18:59:21.103985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 18:59:21.104449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 18:59:21.104930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 18:59:21.105348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 18:59:21.105804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 18:59:21.114992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:21.115489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:21.115942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:21.116676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:21.117135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:21.117570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:21.135910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Getting quotas for project e11d97168f6143afb1efb7d762638031. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 18:59:21.141704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Getting quotas for user 40cf3c8d463b4c51b51d57125de0d8ab and project e11d97168f6143afb1efb7d762638031. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 18:59:21.156750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 18:59:21.159147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 18:59:21.211632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17db1ad4-7598-4d01-973d-66be94ddded6 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985200 Aug 30 18:59:21.212463 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3165/6477] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 18:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 18:59:21.221713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:21.222472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:21.226994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-49c21f9d-d2d8-4b47-af8c-d6a9cf37849d tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:21.227610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-49c21f9d-d2d8-4b47-af8c-d6a9cf37849d tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:21.291824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-49c21f9d-d2d8-4b47-af8c-d6a9cf37849d tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:21.299350 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-49c21f9d-d2d8-4b47-af8c-d6a9cf37849d tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1213 microversion: 2.1 time: 0.079672 Aug 30 18:59:21.299910 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3313/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:21 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:22.325282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:22.325905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:22.334956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:22.335455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:22.335902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:22.336612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:22.337075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:22.337544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:22.405092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:22.416673 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a92c037d-c0fc-440e-8f6c-a16c750aaaf1 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1265 microversion: 2.1 time: 0.098646 Aug 30 18:59:22.417257 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3166/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:22 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:23.437884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:23.438544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:23.445836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:23.446327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:23.446846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:23.447630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:23.448069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:23.448492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:23.668830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:23.677617 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-becf67e1-2547-4c19-a2ac-c139e2a016ef tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.243558 Aug 30 18:59:23.678205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3314/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:23 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:24.209777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f04bb19-8b59-4d04-81a4-03ae4399d781", "tag": "179d2c20-0b59-4c05-bc8e-68e5c401b524"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:24.224488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:24.225375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:24.225928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:24.239049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] Creating event network-changed:179d2c20-0b59-4c05-bc8e-68e5c401b524 for instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 on n-h2-854119-10 Aug 30 18:59:24.244655 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] [eebdd681-5ccd-4a1d-8718-5f793cf2347f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 18:59:24.699947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:24.700543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:24.707447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:24.707929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:24.708355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:24.709039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:24.709480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:24.709903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:24.846316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:24.854533 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44074e33-181e-406c-a53e-4569d4e669e3 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.158912 Aug 30 18:59:24.855109 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3315/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:24 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:25.253426 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] [eebdd681-5ccd-4a1d-8718-5f793cf2347f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56108. Aug 30 18:59:25.257979 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1e20d09a-e731-4de5-8da9-2f535fbce8fe req-156a681c-48b0-469d-ac5d-159113e8de0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.052911 Aug 30 18:59:25.258795 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3167/6482] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:25.876814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:25.877401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:25.885717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:25.886223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:25.886740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:25.887468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:25.887926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:25.888393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:26.212937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:26.221330 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d548ac2-e9ff-46fa-b429-b17a4b1b8abd tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.348752 Aug 30 18:59:26.221936 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3316/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:25 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:27.244456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:27.245888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:27.252766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:27.253281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:27.253723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:27.254489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:27.254956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:27.255394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:27.398026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:27.406595 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a283689-9d60-4cb6-b6fa-5a216b8b49dc tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.167456 Aug 30 18:59:27.407150 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3168/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:27 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:28.433176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:28.433810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:28.441502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:28.442003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:28.442481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:28.443167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:28.443654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:28.444091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:28.587861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:28.596995 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-78629cb9-4d93-4f6e-93e0-de8b4a8bf247 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.172096 Aug 30 18:59:28.597644 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3317/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:28 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:28.677865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04bb19-8b59-4d04-81a4-03ae4399d781", "name": "network-vif-plugged", "status": "completed", "tag": "179d2c20-0b59-4c05-bc8e-68e5c401b524"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:28.688137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:28.688669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:28.689121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:28.700836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] Creating event network-vif-plugged:179d2c20-0b59-4c05-bc8e-68e5c401b524 for instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 on n-h2-854119-10 Aug 30 18:59:28.706163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-9f132bd1-5317-4ffa-b466-af1fbcafc81d req-6ef36533-be1e-4c9d-bdee-9af164596508 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102215 Aug 30 18:59:28.706996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3169/6486] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:29.619494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:29.620442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:29.629267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:29.629796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:29.630377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:29.631328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:29.631845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:29.632450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:29.777081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:29.785740 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-934b3df8-af94-458b-8228-66eba6b1f8b5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1313 microversion: 2.1 time: 0.170620 Aug 30 18:59:29.786336 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3318/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:29 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:30.810274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:30.811053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:30.817760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:30.818317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:30.818763 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:30.819492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:30.819959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:30.820396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:30.959886 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:30.968442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0e3d13ba-c1f3-4d20-96d1-03851a860b16 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1497 microversion: 2.1 time: 0.163356 Aug 30 18:59:30.969038 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3170/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:30 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:33.372000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:33.374134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:33.377104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:33.383924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:33.384702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:33.384847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:33.385558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:33.386556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:33.386556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:33.416600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 18:59:33.505516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac73b6b0-93ee-440c-a835-a6383f5e694f tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 204 len: 0 microversion: 2.1 time: 0.139996 Aug 30 18:59:33.506378 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3319/6489] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 18:59:33 2022] DELETE /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 18:59:33.516276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:33.517075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:33.519026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:33.519717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 18:59:33.528445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:33.528942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:33.529469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:33.530359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:33.530752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:33.531413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:33.690031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:33.700306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36951d9b-6683-4138-8985-13b0c48ecdf5 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1503 microversion: 2.1 time: 0.188437 Aug 30 18:59:33.701107 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3171/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:33 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:34.727558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:34.728410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:34.736344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:34.736862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:34.737298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:34.738010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:34.738556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:34.738998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:34.972146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:34.981006 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-88191305-d603-4d67-84c6-e9c8410add91 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1503 microversion: 2.1 time: 0.257732 Aug 30 18:59:34.981687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3320/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:34 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 18:59:35.490768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04bb19-8b59-4d04-81a4-03ae4399d781", "name": "network-vif-deleted", "tag": "179d2c20-0b59-4c05-bc8e-68e5c401b524"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 18:59:35.502022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:35.502548 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:35.502995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:35.515211 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] Creating event network-vif-deleted:179d2c20-0b59-4c05-bc8e-68e5c401b524 for instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 on n-h2-854119-10 Aug 30 18:59:35.520688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-224183de-e501-4bb1-a620-896103fef352 req-43a3f8cc-0db2-4ff2-827a-c851f895244c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 Aug 30 18:59:35.521367 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3172/6492] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 18:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 18:59:36.003954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:36.004659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:36.012151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:36.012646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:36.013083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:36.013998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:36.014361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:36.014817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:36.049079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:36.049563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:36.049986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:36.050831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lazy-loading 'fault' on Instance uuid 6f04bb19-8b59-4d04-81a4-03ae4399d781 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 18:59:36.094466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cf3c8d463b4c51b51d57125de0d8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11d97168f6143afb1efb7d762638031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 18:59:36.102182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23f8d7dc-c08e-4547-a8fb-1984ed3fc624 tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 200 len: 1303 microversion: 2.1 time: 0.102807 Aug 30 18:59:36.102763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3321/6493] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:35 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 18:59:37.128348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 18:59:37.129383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] [instance: 6f04bb19-8b59-4d04-81a4-03ae4399d781] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 18:59:37.136837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:37.137349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:37.137832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:37.138922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 18:59:37.139731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 18:59:37.140205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 18:59:37.157644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] HTTP exception thrown: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Request method failure captured: Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 HTTP/1.1 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl4GgasKxvkTeC6Gtn6eFaoskR6EwIaZCLNr2oOOG5jE9JpVCgEqiqo-607ngM1vmkZ15a44adIIkaoV1TZy7cUQawOMFJw0etMTa0eJC7DgVx0s8nU2nAgftwHCwrESJiDRrpRaPUGmisyT_amOf7T2eWiS8OIsyqVfoUkVL6f6QEc Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: e11d97168f6143afb1efb7d762638031 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-VolumesActionsTest-1391329916 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e11d97168f6143afb1efb7d762638031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e11d97168f6143afb1efb7d762638031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e11d97168f6143afb1efb7d762638031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e11d97168f6143afb1efb7d762638031"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-VolumesActionsTest-1391329916 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: e11d97168f6143afb1efb7d762638031 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-VolumesActionsTest-1391329916 Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-VolumesActionsTest-1391329916-project Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 40cf3c8d463b4c51b51d57125de0d8ab Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-VolumesActionsTest-1391329916-project Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '6f04bb19-8b59-4d04-81a4-03ae4399d781'} Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 18:59:37.159428 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] Returning 404 to user: Instance 6f04bb19-8b59-4d04-81a4-03ae4399d781 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a4a10f6a-b471-43f2-baca-ebb27b14c36c tempest-VolumesActionsTest-1391329916 tempest-VolumesActionsTest-1391329916-project] 10.222.0.25 "GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781" status: 404 len: 111 microversion: 2.1 time: 0.040125 Aug 30 18:59:37.165178 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3173/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 18:59:37 2022] GET /compute/v2.1/servers/6f04bb19-8b59-4d04-81a4-03ae4399d781 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:02:39.423279 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:02:39.424396 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:02:39.425369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:39.426184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:39.427180 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:02:39.427332 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.25) !!! Aug 30 19:02:39.428605 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:02:39.428706 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.25) !!! Aug 30 19:02:39.429608 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:02:39.429717 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.25) !!! Aug 30 19:02:39.584494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:39.586178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:39.586697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:39.587131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:39.587966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:39.588342 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:39.588763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:39.612783 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-85de206f-b2a4-4692-a733-75fdf6a6233e tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.191957 Aug 30 19:02:39.613409 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3322/6495] 10.222.0.25 () {58 vars in 1185 bytes} [Tue Aug 30 19:02:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:02:39.728171 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:02:39.729051 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:02:39.729898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:39.730722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=34 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:39.732582 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:02:39.732709 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:02:39.734671 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:02:39.734782 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:02:39.736603 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:02:39.736716 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:02:39.741339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-226595895", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "availability_zone": "nova:n-h1-854119-10", "networks": [{"uuid": "67b1526a-2561-4f0a-8302-83235a600d08"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:02:39.825648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] validate_networks() for [('67b1526a-2561-4f0a-8302-83235a600d08', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:02:40.249499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:02:40.249945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:02:40.250481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:02:40.251375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:02:40.252161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:02:40.262112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:40.262653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:40.263110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:40.263841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:40.264328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:40.264772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:40.286002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Getting quotas for project 569f60ffed94472497a9be97842b81f7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:02:40.292502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Getting quotas for user 90966cd294884508ab2e26e938295981 and project 569f60ffed94472497a9be97842b81f7. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:02:40.311916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:02:40.314743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:02:40.373744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-efcad69d-9f32-471a-a59b-62ef88c98b57 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647525 Aug 30 19:02:40.374476 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3174/6496] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:02:40.385365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b4137a94-344b-449f-a9f3-d8563f16ffca tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:40.385975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b4137a94-344b-449f-a9f3-d8563f16ffca tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:40.455100 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59132. Aug 30 19:02:40.464922 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59130. Aug 30 19:02:40.502001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b4137a94-344b-449f-a9f3-d8563f16ffca tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1328 microversion: 2.1 time: 0.120010 Aug 30 19:02:40.502943 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3323/6497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:40 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:41.529399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:41.530693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:41.555023 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59148. Aug 30 19:02:41.566698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:41.567257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:41.568726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:41.569935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:41.570666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:41.574679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:41.575724 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59146. Aug 30 19:02:41.702684 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0cc2140-67a7-4d99-b8af-28f73ba0ebf5 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1417 microversion: 2.1 time: 0.180645 Aug 30 19:02:41.705021 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3175/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:41 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1417 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:42.733659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:42.735470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:42.745064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:42.745954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:42.746981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:42.747775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:42.748443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:42.748927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:42.919182 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9ca9b6d-c77c-45c7-a941-c8089642f895 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.195848 Aug 30 19:02:42.919780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3324/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:42 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:43.487051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a", "tag": "357558e7-c62b-4550-a356-56f776d28398"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:02:43.506311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:43.506874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:43.507579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:43.521794 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] Creating event network-changed:357558e7-c62b-4550-a356-56f776d28398 for instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a on n-h1-854119-10 Aug 30 19:02:43.536713 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-763fa6dc-2f6e-45ee-b49c-b14cac119700 req-f27f8a6a-c3c8-4b2d-a1c8-6a798f4ae49f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057617 Aug 30 19:02:43.537348 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3176/6500] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:02:43.949354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:43.950636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:43.961514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:43.962041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:43.963159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:43.963885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:43.964395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:43.964779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:44.097064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f762281a-99d5-42e5-afa7-4170e12597c4 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.151674 Aug 30 19:02:44.097664 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3325/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:43 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:45.121138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:45.121863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:45.128728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:45.129557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:45.130072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:45.130849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:45.131318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:45.131766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:45.331180 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4387f9d-6415-40b1-9e59-7fe13b9b79ad tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.215029 Aug 30 19:02:45.331786 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3177/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:45 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:46.352270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:46.352860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:46.360388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:46.360876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:46.361301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:46.361982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:46.362482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:46.362889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:46.502765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-64848f53-63a7-448f-907b-bc675b0b9b4a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.154101 Aug 30 19:02:46.503373 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3326/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:46 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:47.532530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:47.533167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:47.541576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:47.542090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:47.542592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:47.543318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:47.543792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:47.544236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:47.681194 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4964b1fb-9b6a-4e67-a33b-62ac40e603c2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.155649 Aug 30 19:02:47.681853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3178/6504] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:47 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:48.703207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:48.703820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:48.710467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:48.710969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:48.711438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:48.712175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:48.712663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:48.713092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:48.844076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5e18772-187e-4dd2-8a0e-1cc681ac46f9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.146349 Aug 30 19:02:48.844759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3327/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:48 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:48.875939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a", "name": "network-vif-plugged", "status": "completed", "tag": "357558e7-c62b-4550-a356-56f776d28398"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:02:48.887279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:48.887817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:48.888261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:48.900492 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] Creating event network-vif-plugged:357558e7-c62b-4550-a356-56f776d28398 for instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a on n-h1-854119-10 Aug 30 19:02:48.905816 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4648ea2a-9590-4f74-87e3-d64961630c2c req-f7799ce7-ac80-4323-8134-4569b8ae7cb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034189 Aug 30 19:02:48.906589 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3179/6506] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:02:49.865529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:49.866158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:49.868168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:49.874974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:49.875455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:49.875880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:49.876634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:49.877455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:49.877889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:50.024486 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1ea3eb3-c0a6-4e8a-aa03-66313c5fe670 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1465 microversion: 2.1 time: 0.162906 Aug 30 19:02:50.025070 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3328/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:49 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:51.043803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:51.044679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:51.049198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:51.050273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:51.057658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.058156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.058630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.059334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.059798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.060228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.194306 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7f7860e-ba3d-4277-b171-922d84e038da tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1650 microversion: 2.1 time: 0.152361 Aug 30 19:02:51.194907 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3180/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:51 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1650 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:51.214540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:51.215171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:51.217070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:02:51.223618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.224117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.224542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.225230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.225664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.226077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.369329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4612259b-99e2-49f5-a10b-3b1dc5b59334 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1650 microversion: 2.1 time: 0.158505 Aug 30 19:02:51.369972 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3329/6509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:51 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1650 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:51.389520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:51.390069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:51.397027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.397613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.398092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.398876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:51.399346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:51.399822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:51.535899 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-76418fc6-15fd-4535-877c-d2a5991d06e9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1650 microversion: 2.1 time: 0.150151 Aug 30 19:02:51.536475 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3181/6510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:51 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:02:51.604015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1132932222", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "availability_zone": "nova:n-h2-854119-10", "networks": [{"uuid": "67b1526a-2561-4f0a-8302-83235a600d08"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:02:51.665457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] validate_networks() for [('67b1526a-2561-4f0a-8302-83235a600d08', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:02:52.439128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:02:52.439865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:02:52.440087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:02:52.440617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:02:52.441055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:02:52.450422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:52.450919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:52.451358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:52.452090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:52.452548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:52.452969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:52.470618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Getting quotas for project 569f60ffed94472497a9be97842b81f7. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:02:52.476109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Getting quotas for user 90966cd294884508ab2e26e938295981 and project 569f60ffed94472497a9be97842b81f7. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:02:52.489847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:02:52.492298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:02:52.542567 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b8d09c17-a6ee-46bb-b488-b4661f16316a tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942223 Aug 30 19:02:52.543226 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3330/6511] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:02:52.557182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6befb86f-a1d5-4d3c-bc34-3cc0f48fbdfc tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:52.558095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6befb86f-a1d5-4d3c-bc34-3cc0f48fbdfc tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:52.625890 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6befb86f-a1d5-4d3c-bc34-3cc0f48fbdfc tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1329 microversion: 2.1 time: 0.074591 Aug 30 19:02:52.626469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3182/6512] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:52 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1329 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:53.649405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:53.650206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:53.658932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:53.659540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:53.659960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:53.660663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:53.661110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:53.661598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:53.776852 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6542babc-3e9f-4e55-a958-9582c6e71408 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1426 microversion: 2.1 time: 0.132390 Aug 30 19:02:53.777666 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3331/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:53 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:54.798732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:54.799281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:54.811425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:54.811955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:54.812445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:54.813297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:54.813842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:54.814787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:54.944739 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-173c4365-1e0b-4610-b343-e6a16d36ec16 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.149934 Aug 30 19:02:54.945432 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3183/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:54 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:55.036692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afada5aa-cc27-4713-8e24-cec59f4ef209", "tag": "7c6fa84c-0e03-4935-b363-4c171f2ad9ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:02:55.046318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:55.046843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:55.047277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:55.059373 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] Creating event network-changed:7c6fa84c-0e03-4935-b363-4c171f2ad9ba for instance afada5aa-cc27-4713-8e24-cec59f4ef209 on n-h2-854119-10 Aug 30 19:02:55.065525 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b0540627-78c9-45fa-8f64-339641b84496 req-237341a2-9b6e-4bff-96fb-07f2b3a33275 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103201 Aug 30 19:02:55.066149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3332/6515] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:02:55.967512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:55.968154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:55.979071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:55.979722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:55.980198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:55.981206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:55.981823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:55.982416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:56.120275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91036fe3-9970-4680-ba0a-3eb94d3833a6 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.157001 Aug 30 19:02:56.120901 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3184/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:55 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:57.143097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:57.143716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:57.150819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:57.151313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:57.151749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:57.152457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:57.152908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:57.153337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:57.297431 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c9f4b59-bb1c-468d-a9d0-30aa1c0bba98 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.159132 Aug 30 19:02:57.298506 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3333/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:57 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:58.319151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:58.319747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:58.327560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:58.328049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:58.328502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:58.329271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:58.329735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:58.330168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:58.469732 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23f59aff-0fe0-4cf9-889d-b6d64620530f tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.154656 Aug 30 19:02:58.470419 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3185/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:58 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:02:59.490949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:02:59.501066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:02:59.501655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:59.502149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:59.502589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:59.503326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:02:59.504008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:02:59.504719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:02:59.636357 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-388b0e9a-ce73-4c22-b4fb-ab7b9ce7ef45 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.149276 Aug 30 19:02:59.636945 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3334/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:02:59 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:00.657670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:00.658200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:00.666110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:00.666615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:00.667096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:00.667809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:00.668285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:00.668725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:00.812131 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-23c0b460-89f1-4858-a5be-e542cbe68342 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.158077 Aug 30 19:03:00.812913 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3186/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:00 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:01.736804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afada5aa-cc27-4713-8e24-cec59f4ef209", "name": "network-vif-plugged", "status": "completed", "tag": "7c6fa84c-0e03-4935-b363-4c171f2ad9ba"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:01.748399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:01.748925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:01.749401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:01.761750 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] Creating event network-vif-plugged:7c6fa84c-0e03-4935-b363-4c171f2ad9ba for instance afada5aa-cc27-4713-8e24-cec59f4ef209 on n-h2-854119-10 Aug 30 19:03:01.767267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7a16371f-f115-4a73-89eb-b490dea45f1c req-bff856e0-19a3-46a9-bab3-16b2bdc9289b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034615 Aug 30 19:03:01.767875 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3335/6521] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:01.833453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:01.834407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:01.841684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:01.842186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:01.842676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:01.843441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:01.843883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:01.844326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:01.978872 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8c92171-eedf-498e-a37d-8d0cc7e975d9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.149224 Aug 30 19:03:01.979467 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3187/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:01 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:02.998531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:02.999343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:03.005115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:03.005827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:03.013285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:03.013783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:03.014222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:03.014959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:03.015412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:03.015840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:03.158335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d17e2f4-42a1-4330-91f7-3d6b2a791e66 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1466 microversion: 2.1 time: 0.160721 Aug 30 19:03:03.158975 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3336/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:02 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:04.181057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:04.181860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:04.183858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:04.190568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.191197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.191919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.192532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.193031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.193450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.341542 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ee6b361-38d2-4c32-9a81-029bd80232a2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1651 microversion: 2.1 time: 0.164273 Aug 30 19:03:04.342148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3188/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:04 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1651 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:04.361900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:04.362543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:04.371616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.372334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.374271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.374271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.374815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.375531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.515314 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6339e39b-8a80-4ab4-986d-6f9fcf2f9175 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1651 microversion: 2.1 time: 0.156806 Aug 30 19:03:04.516094 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3337/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:04 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1651 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:04.545327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:04.546266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:04.555734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.556296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.556816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.557902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.558731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.559325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.707249 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-25540842-95b9-48fa-bbbf-9a839aab9326 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1651 microversion: 2.1 time: 0.167979 Aug 30 19:03:04.707756 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3189/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:04 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1651 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:04.728241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:04.728747 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:04.735228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.735709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.736146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.736840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.737291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.737712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.763038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:03:04.846491 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-71b7660d-a3e6-4ade-883a-f20dd4e9dc50 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 204 len: 0 microversion: 2.1 time: 0.122105 Aug 30 19:03:04.847168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3338/6527] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:03:04 2022] DELETE /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:03:04.855931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:04.856635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:04.863133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.863628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.864085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:04.865306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:04.865796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:04.866246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:05.010316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4c4827f8-64fc-4219-8725-b784ab0d4821 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1657 microversion: 2.1 time: 0.158110 Aug 30 19:03:05.010944 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3190/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:04 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:06.035348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:06.036058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:06.043611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:06.044131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:06.044546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:06.045255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:06.045713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:06.046136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:06.184103 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41289e64-0685-400e-b97c-8c4e946e5b2d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1657 microversion: 2.1 time: 0.152655 Aug 30 19:03:06.184920 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3339/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:06 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:06.791162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afada5aa-cc27-4713-8e24-cec59f4ef209", "name": "network-vif-deleted", "tag": "7c6fa84c-0e03-4935-b363-4c171f2ad9ba"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:06.805190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:06.805713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:06.806168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:06.824284 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] Creating event network-vif-deleted:7c6fa84c-0e03-4935-b363-4c171f2ad9ba for instance afada5aa-cc27-4713-8e24-cec59f4ef209 on n-h2-854119-10 Aug 30 19:03:06.832044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f2f43a45-5522-4a81-9cbf-521b63154def req-7cd1c9e8-2e07-4db5-8138-c82adf8e80c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046074 Aug 30 19:03:06.833382 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3191/6530] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:07.206215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:07.206843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:07.215003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:07.215489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:07.215922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:07.216613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:07.217060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:07.217475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:07.236951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:07.253181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:07.253548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:07.253981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:07.254520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lazy-loading 'fault' on Instance uuid afada5aa-cc27-4713-8e24-cec59f4ef209 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:03:07.306206 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c4ffb2f0-3104-4491-89ce-0528fe113119 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 200 len: 1456 microversion: 2.1 time: 0.103524 Aug 30 19:03:07.307084 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3340/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:07 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 1456 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:08.329915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:08.330666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: afada5aa-cc27-4713-8e24-cec59f4ef209] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:08.338148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.338641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.339113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.339818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.340277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.340711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.354873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] HTTP exception thrown: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Request method failure captured: Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 HTTP/1.1 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl7PBusHNBvV5q9WVAM_gY0rPS-Eb9OKzIAMyk1epfOqJomLzInQX-8tmsVsjbCTlNoLnMfRbbgU48HckrFi7ZYoMizophqZyQLRX93F7efYMTOwumDbAZONPvqJ5WhMXAC0TCTv9qSWPVWRV-AEhP6084KN9JQH5L_Yo5G1W8R5gvQ Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 569f60ffed94472497a9be97842b81f7 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestServerMultinode-1963287810 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/569f60ffed94472497a9be97842b81f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/569f60ffed94472497a9be97842b81f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/569f60ffed94472497a9be97842b81f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_569f60ffed94472497a9be97842b81f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestServerMultinode-1963287810 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 569f60ffed94472497a9be97842b81f7 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestServerMultinode-1963287810 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestServerMultinode-1963287810-project-admin Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 90966cd294884508ab2e26e938295981 Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestServerMultinode-1963287810-project-admin Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'afada5aa-cc27-4713-8e24-cec59f4ef209'} Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:08.356541 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Returning 404 to user: Instance afada5aa-cc27-4713-8e24-cec59f4ef209 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc2ccf13-6ec5-4d3c-a375-4a58741b3780 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209" status: 404 len: 111 microversion: 2.1 time: 0.032294 Aug 30 19:03:08.363596 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3192/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:08 2022] GET /compute/v2.1/servers/afada5aa-cc27-4713-8e24-cec59f4ef209 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:03:08.372527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:08.373030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:08.383215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.383709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.384126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.384830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.385283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.385705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.413240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:03:08.504268 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7c618a04-15a5-43a9-bbf8-2786df1c12a9 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 204 len: 0 microversion: 2.1 time: 0.140682 Aug 30 19:03:08.504809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3341/6533] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:03:08 2022] DELETE /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:03:08.515285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:08.516209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:08.523852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.524360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.524816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.525533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:08.526006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:08.526488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:08.666677 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85262771-a4e3-4652-915c-a97e0ed2214d tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1656 microversion: 2.1 time: 0.156786 Aug 30 19:03:08.667244 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3193/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:08 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:09.688948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:09.689638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:09.692474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:09.699301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:09.699692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:09.700126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:09.701966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:09.701966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:09.701966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:09.840042 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-91655de1-31a9-4cd5-91ef-6b44d955846b tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1656 microversion: 2.1 time: 0.155224 Aug 30 19:03:09.840665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3342/6535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:09 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:10.572971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a", "name": "network-vif-deleted", "tag": "357558e7-c62b-4550-a356-56f776d28398"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:10.579518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:10.585617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:10.586182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:10.586674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:10.589997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:10.602251 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] Creating event network-vif-deleted:357558e7-c62b-4550-a356-56f776d28398 for instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a on n-h1-854119-10 Aug 30 19:03:10.607711 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-16d2d9a7-70af-435d-8a3f-5b2747cc959a req-12870a47-0f4c-4ff3-bb9f-f6969aa0a867 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Aug 30 19:03:10.608417 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3194/6536] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:10.862313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:10.862879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:10.869613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:10.870109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:10.870584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:10.871297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:10.871812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:10.872154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:10.905763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:10.906247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:10.906709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:10.907155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lazy-loading 'fault' on Instance uuid 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:03:10.962815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4e792e9-88b5-4482-b5e6-65e6acb13925 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 200 len: 1455 microversion: 2.1 time: 0.104705 Aug 30 19:03:10.963415 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3343/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:10 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:11.986561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:11.987386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] [instance: 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:11.994184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:11.994705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:11.995151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:11.995855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:11.996321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:11.996761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:12.010380 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] HTTP exception thrown: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Request method failure captured: Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a HTTP/1.1 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl7PBusHNBvV5q9WVAM_gY0rPS-Eb9OKzIAMyk1epfOqJomLzInQX-8tmsVsjbCTlNoLnMfRbbgU48HckrFi7ZYoMizophqZyQLRX93F7efYMTOwumDbAZONPvqJ5WhMXAC0TCTv9qSWPVWRV-AEhP6084KN9JQH5L_Yo5G1W8R5gvQ Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 569f60ffed94472497a9be97842b81f7 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestServerMultinode-1963287810 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/569f60ffed94472497a9be97842b81f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/569f60ffed94472497a9be97842b81f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/569f60ffed94472497a9be97842b81f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_569f60ffed94472497a9be97842b81f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestServerMultinode-1963287810 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 569f60ffed94472497a9be97842b81f7 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestServerMultinode-1963287810 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestServerMultinode-1963287810-project-admin Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 90966cd294884508ab2e26e938295981 Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestServerMultinode-1963287810-project-admin Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a'} Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:12.012089 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] Returning 404 to user: Instance 7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-51fbccb0-b1ee-46fd-b380-904c5387d1f2 tempest-TestServerMultinode-1963287810 tempest-TestServerMultinode-1963287810-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a" status: 404 len: 111 microversion: 2.1 time: 0.032280 Aug 30 19:03:12.015500 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3195/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:11 2022] GET /compute/v2.1/servers/7d2ec258-8fe3-4f2d-8565-3348c9a3fe3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:03:31.163507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=5 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:31.164375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:31.284460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-126441916", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:31.341825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] validate_networks() for None {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:03:31.651853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:03:31.652497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:03:31.653231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:03:31.653986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:03:31.654962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:03:31.665223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:31.665687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:31.666119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:31.666876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:31.667328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:31.667724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:31.687765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Getting quotas for project aa980343a20848349e059318b7eed842. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:03:31.693211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Getting quotas for user d1c56768e6944125a6abe65057936f4d and project aa980343a20848349e059318b7eed842. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:03:31.706578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:03:31.708911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:03:31.757793 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa920b29-bf12-40be-a392-eb647df70528 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599949 Aug 30 19:03:31.759752 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3344/6539] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:03:31.771012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59dd69fa-9893-4bf2-82fc-4f09c4b1d287 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:31.771647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59dd69fa-9893-4bf2-82fc-4f09c4b1d287 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:31.775587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:31.776254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:31.832711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59dd69fa-9893-4bf2-82fc-4f09c4b1d287 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:31.840675 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59dd69fa-9893-4bf2-82fc-4f09c4b1d287 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1221 microversion: 2.1 time: 0.073599 Aug 30 19:03:31.841501 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3196/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:31 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:32.862050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:32.862696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:32.870066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:32.870604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:32.871070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:32.871774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:32.872218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:32.872847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:32.943040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:32.955098 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dea2ea65-2903-4ed4-bd32-f57f9dc7af63 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1273 microversion: 2.1 time: 0.097392 Aug 30 19:03:32.955708 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3345/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:32 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:33.982557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:33.983348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:33.990671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:33.991213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:33.991664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:33.999232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:33.999930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:34.000603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:34.153369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:34.162557 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c04d9e76-f84b-44b9-8e62-60f596936195 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.188991 Aug 30 19:03:34.163237 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3197/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:33 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:34.650026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f18461a-9794-44b3-a257-d41706252433", "tag": "ce88aaa6-aef1-43ad-925a-e349c7a68d8a"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:34.661479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:34.662317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:34.662990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:34.675764 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] Creating event network-changed:ce88aaa6-aef1-43ad-925a-e349c7a68d8a for instance 7f18461a-9794-44b3-a257-d41706252433 on n-h2-854119-10 Aug 30 19:03:34.681451 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-24afb86f-34b0-4025-b881-81f88802c5bf req-0d472581-1549-4810-8371-74c7ac25e5a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035512 Aug 30 19:03:34.682269 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3346/6543] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:35.184686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:35.185383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:35.192968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:35.193475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:35.193965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:35.194732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:35.195197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:35.195663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:35.342238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:35.351488 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d8d2b99-868e-4361-abc8-d4e90e26c164 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.170795 Aug 30 19:03:35.352091 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3198/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:35 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:36.374818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:36.375522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:36.382253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:36.382769 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:36.383179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:36.383904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:36.384353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:36.384774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:36.587027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:36.596003 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9e0b1c32-5119-4205-8b37-7c65c6e42f54 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.226258 Aug 30 19:03:36.596653 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3347/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:36 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:37.617801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:37.618375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:37.625767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:37.626271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:37.626783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:37.627600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:37.628050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:37.628593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:37.765961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:37.774456 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a9e40236-f66c-479d-ba43-8386c38f10ac tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.160838 Aug 30 19:03:37.775040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3199/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:37 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:38.796388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:38.797026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:38.805350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:38.805829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:38.806288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:38.807010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:38.807456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:38.807874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:38.958002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:38.966326 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ddc7e48a-c410-4922-a17d-806b45aeb5a7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.173814 Aug 30 19:03:38.966957 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3348/6547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:38 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:39.988640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:39.989323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:39.996923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:39.997406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:39.997884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:40.002961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:40.003692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:40.004167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:40.142974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:40.151390 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-59817a75-8d32-4949-8fe6-c8cddce47494 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.167040 Aug 30 19:03:40.151976 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3200/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:39 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:41.173108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:41.173690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:41.181288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:41.181778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:41.182246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:41.182941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:41.183447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:41.183855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:41.347318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:41.358423 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1acdf8d-421a-4374-a04e-9c12917c2a95 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.189261 Aug 30 19:03:41.359122 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3349/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:41 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:41.731824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f18461a-9794-44b3-a257-d41706252433", "name": "network-vif-plugged", "status": "completed", "tag": "ce88aaa6-aef1-43ad-925a-e349c7a68d8a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:41.743361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:41.743981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:41.744433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:41.757487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] Creating event network-vif-plugged:ce88aaa6-aef1-43ad-925a-e349c7a68d8a for instance 7f18461a-9794-44b3-a257-d41706252433 on n-h2-854119-10 Aug 30 19:03:41.763583 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-86c8a287-2530-4832-bb55-e37d8710959d req-8290c3b3-e5f4-4538-bb63-33719d3a9e6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035705 Aug 30 19:03:41.764401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3201/6550] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:42.390979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:42.391688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:42.394239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:42.394936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:42.403501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:42.403984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:42.404445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:42.405232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:42.405685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:42.406101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:42.557376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:42.565866 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-07e84972-c525-4fb5-be1d-ea5f06a50ff6 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1321 microversion: 2.1 time: 0.186820 Aug 30 19:03:42.566477 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3350/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:42 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:43.584802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:43.590187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:43.590941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:43.597794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:43.598301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:43.598791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:43.599510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:43.599975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:43.600399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:43.739465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:43.748104 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0b6457f2-2c57-4b02-ac52-2046dc72c35d tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1470 microversion: 2.1 time: 0.164526 Aug 30 19:03:43.748681 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3202/6552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:43 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:43.851472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8408f43a-b7b8-488a-b89a-f36612619469 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '.version_select at 0x7f4e559890d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:43.923188 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8408f43a-b7b8-488a-b89a-f36612619469 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d18fbb05765249f691f08cf7c88ca9c6" status: 200 len: 371 microversion: 2.1 time: 0.155704 Aug 30 19:03:43.923763 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3351/6553] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 19:03:43 2022] GET /compute/v2.1/os-quota-sets/d18fbb05765249f691f08cf7c88ca9c6 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:43.937912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-31e16956-2203-4c26-b700-39d4cbf524c7 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1852408457", "id": 637705937, "os-flavor-access:is_public": "True"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:43.962169 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-31e16956-2203-4c26-b700-39d4cbf524c7 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.029224 Aug 30 19:03:43.962811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3203/6554] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:03:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:43.974800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "637705937"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:43.977065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:43.983945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:43.984394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:43.984858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:43.985516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:43.985963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:43.986397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.077272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6542d1f4025b452692873cd7de8eede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18fbb05765249f691f08cf7c88ca9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:44.084335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] [instance: 7f18461a-9794-44b3-a257-d41706252433] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1852408457 {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:03:44.091725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.092129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.092590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.093310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.093760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.094180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.115878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Getting quotas for project aa980343a20848349e059318b7eed842. Resources: {'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:03:44.121617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Getting quotas for user d1c56768e6944125a6abe65057936f4d and project aa980343a20848349e059318b7eed842. Resources: {'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:03:44.134882 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.compute.api [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] ram quota exceeded for d18fbb05765249f691f08cf7c88ca9c6, tried to resize instance. Aug 30 19:03:44.135426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Request method failure captured: Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action HTTP/1.1 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 38 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl8Cco3za9n-CiM8MH1OEqYl_TM5TUF1KidpkJp6pfX0OE6iXnbLHnFC2CTsu-nuiJr81VYrX0qWREI5P5akireCfJj8A-DqxzJbnSB6EHkPyE_0hju5YMyg1DVHiV9UmGDubhwCrPkS2YTibqptO3UhA9Stpk7B4PGUjYlPD1Z6JNU Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: d18fbb05765249f691f08cf7c88ca9c6 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member,admin Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member,admin Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: d18fbb05765249f691f08cf7c88ca9c6 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersAdminNegativeTestJSON-1723794296-project-admin Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 6542d1f4025b452692873cd7de8eede8 Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1723794296-project-admin Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: {"resize": {"flavorRef": "637705937"}} Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '7f18461a-9794-44b3-a257-d41706252433', 'body': {'resize': {'flavorRef': '637705937'}}} Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.137481 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-44998565-0e4d-43fc-9942-ae399fe8f01b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action" status: 403 len: 118 microversion: 2.1 time: 0.168100 Aug 30 19:03:44.141832 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3352/6555] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:03:43 2022] POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action => generated 118 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:03:44.148473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8a40920-949d-444b-9633-a24147f1dd50 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.171261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8a40920-949d-444b-9633-a24147f1dd50 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/637705937" status: 202 len: 0 microversion: 2.1 time: 0.026284 Aug 30 19:03:44.172025 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3204/6556] 10.222.0.25 () {58 vars in 1158 bytes} [Tue Aug 30 19:03:44 2022] DELETE /compute/v2.1/flavors/637705937 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 19:03:44.184176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5e18841a-81c3-4193-9959-93d2be097a9b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.207262 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5e18841a-81c3-4193-9959-93d2be097a9b tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028627 Aug 30 19:03:44.208002 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3353/6557] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 19:03:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:44.228147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2199b5f7-44c5-4b85-ab60-eb2a31693647 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '.version_select at 0x7f4e56c2fc10>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.320925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2199b5f7-44c5-4b85-ab60-eb2a31693647 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d18fbb05765249f691f08cf7c88ca9c6" status: 200 len: 371 microversion: 2.1 time: 0.096574 Aug 30 19:03:44.321511 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3205/6558] 10.222.0.25 () {58 vars in 1242 bytes} [Tue Aug 30 19:03:44 2022] GET /compute/v2.1/os-quota-sets/d18fbb05765249f691f08cf7c88ca9c6 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:44.333052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-542a0964-1e1e-4321-8a94-4e8dc1f0e736 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1185486734", "id": 1404184362, "os-flavor-access:is_public": "True"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:44.355516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-542a0964-1e1e-4321-8a94-4e8dc1f0e736 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.026093 Aug 30 19:03:44.355948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3354/6559] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:03:44 2022] POST /compute/v2.1/flavors => generated 437 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:03:44.368607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1404184362"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:44.371021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:44.377319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.377814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.378267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.379569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.380030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.380475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.475942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6542d1f4025b452692873cd7de8eede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18fbb05765249f691f08cf7c88ca9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:44.482770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] [instance: 7f18461a-9794-44b3-a257-d41706252433] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1185486734 {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:03:44.490426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.490951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.491398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.492130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.492588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.493022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.522188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Getting quotas for project aa980343a20848349e059318b7eed842. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:03:44.527726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Getting quotas for user d1c56768e6944125a6abe65057936f4d and project aa980343a20848349e059318b7eed842. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:03:44.542305 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] cores quota exceeded for d18fbb05765249f691f08cf7c88ca9c6, tried to resize instance. Aug 30 19:03:44.542882 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Request method failure captured: Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action HTTP/1.1 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 39 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl8Cco3za9n-CiM8MH1OEqYl_TM5TUF1KidpkJp6pfX0OE6iXnbLHnFC2CTsu-nuiJr81VYrX0qWREI5P5akireCfJj8A-DqxzJbnSB6EHkPyE_0hju5YMyg1DVHiV9UmGDubhwCrPkS2YTibqptO3UhA9Stpk7B4PGUjYlPD1Z6JNU Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: d18fbb05765249f691f08cf7c88ca9c6 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member,admin Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member,admin Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d18fbb05765249f691f08cf7c88ca9c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: d18fbb05765249f691f08cf7c88ca9c6 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1723794296 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-1723794296-project-admin Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 6542d1f4025b452692873cd7de8eede8 Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1723794296-project-admin Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: {"resize": {"flavorRef": "1404184362"}} Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '7f18461a-9794-44b3-a257-d41706252433', 'body': {'resize': {'flavorRef': '1404184362'}}} Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.544980 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-927ca59e-a6b7-4976-a238-5bba45350634 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action" status: 403 len: 113 microversion: 2.1 time: 0.181949 Aug 30 19:03:44.548490 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3206/6560] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:03:44 2022] POST /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433/action => generated 113 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:03:44.556450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d5a65d44-200a-4ab7-b1d9-f6b92567ecdd tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.578934 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d5a65d44-200a-4ab7-b1d9-f6b92567ecdd tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1404184362" status: 202 len: 0 microversion: 2.1 time: 0.026329 Aug 30 19:03:44.579730 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3355/6561] 10.222.0.25 () {58 vars in 1161 bytes} [Tue Aug 30 19:03:44 2022] DELETE /compute/v2.1/flavors/1404184362 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 19:03:44.589005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e33a08cc-b0e6-4717-b6e0-c13160e4a790 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.610357 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e33a08cc-b0e6-4717-b6e0-c13160e4a790 tempest-ServersAdminNegativeTestJSON-1723794296 tempest-ServersAdminNegativeTestJSON-1723794296-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025468 Aug 30 19:03:44.610903 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3207/6562] 10.222.0.25 () {58 vars in 1146 bytes} [Tue Aug 30 19:03:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:44.633127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.633637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:44.640010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.640560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.641111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.641995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.642688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.643109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.671170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:03:44.755734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d0e17f8-5639-4b9b-99bf-06d5c8e14db3 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 204 len: 0 microversion: 2.1 time: 0.126858 Aug 30 19:03:44.756445 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3356/6563] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:03:44 2022] DELETE /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:03:44.765027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:44.765661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:44.772232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.772730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.773179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.773885 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:44.774360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:44.774799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:44.922242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:44.931470 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e907f0e-5508-4efe-afec-498a5b752321 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1476 microversion: 2.1 time: 0.170513 Aug 30 19:03:44.932064 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3208/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:44 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:45.953503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:45.954195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:45.961826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:45.962331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:45.962821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:45.963538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:45.963988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:45.964419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:46.123250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:46.134554 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e1c0b836-1f78-435b-ac3b-341cffd3334b tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1476 microversion: 2.1 time: 0.185018 Aug 30 19:03:46.135348 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3357/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:45 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:46.737837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f18461a-9794-44b3-a257-d41706252433", "name": "network-vif-deleted", "tag": "ce88aaa6-aef1-43ad-925a-e349c7a68d8a"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:46.752130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:46.753466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:46.754029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:46.769209 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] Creating event network-vif-deleted:ce88aaa6-aef1-43ad-925a-e349c7a68d8a for instance 7f18461a-9794-44b3-a257-d41706252433 on n-h2-854119-10 Aug 30 19:03:46.776988 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a855587b-18cc-47f4-a274-1fbff8954d73 req-bc2989a7-f3fc-441c-8f58-dfee819069cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044152 Aug 30 19:03:46.777605 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3209/6566] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:47.161818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:47.162447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:47.169996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:47.170518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:47.170958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:47.171665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:47.172120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:47.172547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:47.209488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:47.210000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:47.210539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:47.210985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lazy-loading 'fault' on Instance uuid 7f18461a-9794-44b3-a257-d41706252433 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:03:47.258666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c56768e6944125a6abe65057936f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa980343a20848349e059318b7eed842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:47.266752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8fb60611-60be-400d-8f8f-aa4f20537cd7 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 200 len: 1311 microversion: 2.1 time: 0.110676 Aug 30 19:03:47.267325 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3358/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:47 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:48.289915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:48.290677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] [instance: 7f18461a-9794-44b3-a257-d41706252433] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:48.300510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:48.301381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:48.302140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:48.302963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:48.303438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:48.303878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:48.318854 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] HTTP exception thrown: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Request method failure captured: Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 HTTP/1.1 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl8CMrjh_kxAKUsEEJtIbS4C3yz_ZWlaIB-nQS2zdvPFm1BdZirQhx2KJXPUHbKvE-FgW2WCkXdKjaJuKoPxMy_62cqhp8tp1P6b24R9gAz9sED9O_Hn7CwrqFKth9KFeduRhLqRhWE7DgFLpihkbBdoXx-4AkCZ7cNmPqTRTkkPtRw Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: aa980343a20848349e059318b7eed842 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1225365859 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa980343a20848349e059318b7eed842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa980343a20848349e059318b7eed842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa980343a20848349e059318b7eed842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa980343a20848349e059318b7eed842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1225365859 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: aa980343a20848349e059318b7eed842 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1225365859 Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersAdminNegativeTestJSON-1225365859-project Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d1c56768e6944125a6abe65057936f4d Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1225365859-project Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '7f18461a-9794-44b3-a257-d41706252433'} Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:48.320580 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] Returning 404 to user: Instance 7f18461a-9794-44b3-a257-d41706252433 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-848a9a44-a875-493f-bf0d-e99feb799139 tempest-ServersAdminNegativeTestJSON-1225365859 tempest-ServersAdminNegativeTestJSON-1225365859-project] 10.222.0.25 "GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433" status: 404 len: 111 microversion: 2.1 time: 0.037321 Aug 30 19:03:48.323994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3210/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:48 2022] GET /compute/v2.1/servers/7f18461a-9794-44b3-a257-d41706252433 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:03:55.078879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:55.079669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:55.245492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1940624497", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "579384a4-3687-4f2d-99eb-3127cadbe841"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:55.313518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] validate_networks() for [('579384a4-3687-4f2d-99eb-3127cadbe841', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:03:55.753119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:03:55.753546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:03:55.754042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:03:55.754488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:03:55.754906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:03:55.765420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:55.765920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:55.766373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:55.767107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:55.767561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:55.767992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:55.788502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Getting quotas for project b720b68b89be4c06a66186104fc4766f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:03:55.794481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Getting quotas for user d5613c54cf9343e7b9833d333623ebc4 and project b720b68b89be4c06a66186104fc4766f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:03:55.809950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:03:55.812382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:03:55.860213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd65b2a0-eabe-4e0b-9bc8-c81673652e3d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786921 Aug 30 19:03:55.860900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3359/6569] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:03:55.873132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f3df3c6-890d-4ef9-9c7d-e25642879a9d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:55.873743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f3df3c6-890d-4ef9-9c7d-e25642879a9d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:55.878233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:55.879013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:03:55.938610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0f3df3c6-890d-4ef9-9c7d-e25642879a9d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:55.949055 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f3df3c6-890d-4ef9-9c7d-e25642879a9d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1215 microversion: 2.1 time: 0.080193 Aug 30 19:03:55.962456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3211/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:55 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:56.972866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:56.973513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:56.982758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:56.983336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:56.984028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:56.984950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:56.985640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:56.986098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:57.066077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:57.075591 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c9eebfa-684d-47e6-b62d-711bf658a110 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1267 microversion: 2.1 time: 0.106813 Aug 30 19:03:57.076161 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3360/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:56 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:58.104570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:58.106778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:58.116075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:58.117179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:58.118029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:58.119059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:58.119752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:58.120428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:58.329172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:58.339575 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66426d99-027a-43f0-bce9-4e726e917e9e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.243142 Aug 30 19:03:58.341158 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3212/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:58 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:03:58.823189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:03:58.839223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:58.839824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:58.840259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:58.853535 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] Creating event network-changed:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h2-854119-10 Aug 30 19:03:58.859289 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-90c4187d-7514-471e-bcf3-18196f6e4cb7 req-3cfe030d-4b6c-4762-bcbb-ef482c19192a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046247 Aug 30 19:03:58.859907 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3361/6573] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:03:59.369044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:03:59.370074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:03:59.381044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:59.381844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:59.382562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:59.383681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:03:59.384455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:03:59.385160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:03:59.535225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:03:59.544405 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a368f3ff-f64d-4625-8714-4a780e7ef4e8 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.182443 Aug 30 19:03:59.544989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3213/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:03:59 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:00.570365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:00.571107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:00.577814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:00.578329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:00.578789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:00.579504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:00.580566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:00.580566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:00.797285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:00.808076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-013b79df-b2a0-4a5c-8878-b4b80c7e035d tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.243279 Aug 30 19:04:00.808698 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3362/6575] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:00 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:01.832914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:01.833520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:01.836631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:01.842869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:01.843411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:01.843871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:01.844927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:01.845406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:01.845849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:01.850120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=68 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:02.029938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:02.040182 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-054242a3-0a59-433b-80eb-ee60cdb82bd7 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.211970 Aug 30 19:04:02.040795 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3214/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:01 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:03.069659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:03.070262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:03.073441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:03.078610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:03.079104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:03.079542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:03.080276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:03.080737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:03.081165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:03.084703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:03.234800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:03.246473 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cc31999f-db21-42db-a7ef-cda4964a03fa tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.180418 Aug 30 19:04:03.247116 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3363/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:03 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:04.268004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:04.268631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:04.276052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:04.276553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:04.276998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:04.277714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:04.278173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:04.278637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:04.424419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:04.433594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cbf3bdcd-c467-4651-ad82-12f76c70c8e4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.169506 Aug 30 19:04:04.434175 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3215/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:04 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:05.456431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:05.456963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:05.464716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:05.465211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:05.465644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:05.466361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:05.466826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:05.467252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:05.609778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:05.620817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca394a81-19ef-4d76-82a4-c0a55e1a33bb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.168502 Aug 30 19:04:05.621424 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3364/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:05 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:05.812157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "name": "network-vif-plugged", "status": "completed", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:05.826004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:05.826558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:05.826999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:05.839776 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] Creating event network-vif-plugged:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h2-854119-10 Aug 30 19:04:05.845724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0e5e73fb-2a33-4dcf-961a-90b9beb23744 req-8748b3d3-deac-4b8e-a1da-69e26eaefcdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Aug 30 19:04:05.846552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3216/6580] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:04:06.643055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:06.643620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:06.645412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:06.646083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:06.653564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:06.654060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:06.654555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:06.655337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:06.655845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:06.656275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:06.813555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:06.824163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-19eccd5b-4b41-41f9-b2a5-f25ba4766638 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1315 microversion: 2.1 time: 0.185093 Aug 30 19:04:06.824824 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3365/6581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:06 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:07.846299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:07.847062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:07.849333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:07.856076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:07.856622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:07.857077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:07.857803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:07.858278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:07.858764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:08.011211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:08.019767 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-811a40fb-f318-4cb2-bd07-9d6c76689e05 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1501 microversion: 2.1 time: 0.177871 Aug 30 19:04:08.020342 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3217/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:07 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:08.042358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:08.044808 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:08.052089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:08.052661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:08.053285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:08.054132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:08.055076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:08.055730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:08.091436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:08.098038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:04:08.106448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:04:08.106822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:04:08.107322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:04:08.107727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:04:08.108142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:04:08.187656 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8c09bc0-3f8d-472c-84c6-4a9ac11bba16 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "POST /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2/action" status: 202 len: 0 microversion: 2.1 time: 0.150964 Aug 30 19:04:08.188633 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3366/6583] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:04:08 2022] POST /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:04:08.197789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:08.198615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:08.205876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:08.206549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:08.207082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:08.207816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:08.208283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:08.209438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:08.364923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:08.374266 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33361194-6e74-4e54-8641-6ee224e66466 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1510 microversion: 2.1 time: 0.181349 Aug 30 19:04:08.374995 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3218/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:08 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:09.403883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:09.404816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:09.410966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:09.411431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:09.411857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:09.412547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:09.413011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:09.413499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:09.569712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:09.580381 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-69eaa740-50e0-4b04-9716-fc3846b4c580 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1510 microversion: 2.1 time: 0.181144 Aug 30 19:04:09.582967 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3367/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:09 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:10.604176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:10.604984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:10.613079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:10.613589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:10.614081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:10.614841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:10.615347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:10.615791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:10.763088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:10.771829 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c8217842-15c1-4cd1-932b-e5efc845c37b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.172040 Aug 30 19:04:10.772624 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3219/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:10 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:11.794840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:11.795478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:11.802486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:11.802978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:11.803417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:11.804175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:11.804728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:11.805153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:11.942375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:11.951222 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2f5fe802-1cc4-4d83-b2f7-e2d0bfe7939c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.160576 Aug 30 19:04:11.951810 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3368/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:11 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:12.973547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:12.974181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:12.981974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:12.982568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:12.983035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:12.983820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:12.984314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:12.984752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:13.161116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:13.172656 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d153c20a-1103-4438-a663-0d037c5f547c tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.203377 Aug 30 19:04:13.173311 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3220/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:12 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:14.197270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:14.198097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:14.206610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:14.207228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:14.207759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:14.208575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:14.209050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:14.209472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:14.353415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:14.362672 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca0bdb02-738f-428c-8240-fe712e647f20 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.169898 Aug 30 19:04:14.363232 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3369/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:14 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:15.388781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:15.389401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:15.397201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:15.398289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:15.398896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:15.399648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:15.400126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:15.400572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:15.545634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:15.555109 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5476e674-86d8-47eb-aa84-4c3e09ca34af tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.170247 Aug 30 19:04:15.555707 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3221/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:15 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:16.579905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:16.580456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:16.590235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:16.590988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:16.591466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:16.592476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:16.593047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:16.593652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:16.743924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:16.752083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e31b420-8ef1-4a7c-8075-fa6781de62a5 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.178208 Aug 30 19:04:16.752675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3370/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:16 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:17.775820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:17.776518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:17.785115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:17.785632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:17.786098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:17.786989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:17.787462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:17.787907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:17.948636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:17.957463 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-124a0a51-1668-4cb6-bff4-e5d037d710a1 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.186536 Aug 30 19:04:17.958107 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3222/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:17 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:18.979876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:18.980466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:18.987788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:18.988278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:18.988719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:18.989425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:18.989876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:18.990302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:19.140068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:19.150325 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89dcab2a-39f1-4417-9345-c0afa90280dc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.174304 Aug 30 19:04:19.150972 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3371/6593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:18 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:20.173079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:20.173727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:20.182933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:20.183445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:20.183902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:20.184646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:20.185093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:20.185570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:20.401890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:20.410189 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-84a6dae8-b6e6-4afb-8d91-cb2276990f0b tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.241276 Aug 30 19:04:20.410812 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3223/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:20 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:21.432282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:21.432898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:21.440859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:21.441331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:21.441830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:21.442571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:21.443020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:21.443440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:21.584242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:21.592453 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcab9d3a-0703-4c19-9b0b-f2d08d4cd9c0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.164146 Aug 30 19:04:21.593054 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3372/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:21 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:22.616762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:22.617337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:22.628388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:22.629132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:22.629708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:22.630686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:22.631408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:22.632181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:22.771441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:22.780049 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-efe2804a-bbd6-40e9-acf2-f2457a6b7aff tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.168242 Aug 30 19:04:22.780640 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3224/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:22 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:23.805352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:23.806266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:23.817168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:23.817801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:23.818447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:23.819410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:23.820077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:23.820464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:23.962930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:23.971284 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-86b6976e-98ea-4a49-9d61-f5234bfb3f35 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.172498 Aug 30 19:04:23.971907 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3373/6597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:23 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:24.996700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:24.997289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:25.007201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:25.007843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:25.008359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:25.009065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:25.009541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:25.009987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:25.179389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:25.187361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d2cdacf-74a8-40d5-803c-e4d45afd42f3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.195303 Aug 30 19:04:25.188179 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3225/6598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:24 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:26.210696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:26.211345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:26.218678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:26.219173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:26.219606 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:26.220369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:26.220742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:26.221153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:26.359244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:26.367959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b7c0827-46b4-414d-9787-1ea526ddcc76 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.161247 Aug 30 19:04:26.368556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3374/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:26 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:27.389573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:27.390133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:27.397739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:27.398254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:27.398743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:27.399476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:27.400092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:27.400881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:27.557269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:27.565903 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fe01d050-5072-4b85-b918-124655470546 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.180393 Aug 30 19:04:27.566515 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3226/6600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:27 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:28.588400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:28.589000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:28.596393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:28.596874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:28.597300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:28.597991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:28.598466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:28.598968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:28.740439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:28.748651 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0d9ccc7-e39a-44d0-9f7f-91d708e4cfc0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.164738 Aug 30 19:04:28.749237 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3375/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:28 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:29.771482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:29.772162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:29.783287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:29.784102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:29.784833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:29.786009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:29.786787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:29.787573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:29.945136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:29.954270 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-686ae7f1-aea1-4e7c-9d73-90b47fa07439 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.187037 Aug 30 19:04:29.954896 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3227/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:29 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:30.977382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:30.977968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:30.985655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:30.986152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:30.986730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:30.987525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:30.987981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:30.988566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:31.135839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:31.146155 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1195b1c-3676-4243-955e-71a7d217c722 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.173673 Aug 30 19:04:31.146826 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3376/6603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:30 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:32.169408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:32.170148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:32.173154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=28 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:32.179459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:32.179948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:32.180402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:32.181119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:32.181570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:32.181999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:32.184965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=80 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:32.334101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:32.342516 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-89053a24-aff8-4a3d-a5f4-3f5a81cd41d4 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.177435 Aug 30 19:04:32.343104 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3228/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:32 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:33.366622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:33.367751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:33.372196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:33.380778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:33.381958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:33.382435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:33.383148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:33.383607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:33.384032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:33.386896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:33.531142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:33.539422 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c49518de-38c0-4733-9f62-3d8a518d288a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.177400 Aug 30 19:04:33.540008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3377/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:33 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:34.561513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:34.562061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:34.569331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:34.569875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:34.570321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:34.571074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:34.571539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:34.572000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:34.718961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:34.727744 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2e2888b-5170-4661-9bca-e46da8e267cc tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.170244 Aug 30 19:04:34.728369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3229/6606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:34 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:35.749732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:35.750515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:35.758215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:35.758771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:35.759215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:35.759952 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:35.760405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:35.760838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:35.967005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:35.976355 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1830fe05-7cfc-4046-8a60-f09e1d2f325e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.230621 Aug 30 19:04:35.976944 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3378/6607] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:35 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:36.999018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:36.999711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:37.007398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:37.007932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:37.008362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:37.009088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:37.009563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:37.010007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:37.152067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:37.160199 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6fe8f24e-e0e9-4288-8886-027d3d1a9265 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1515 microversion: 2.1 time: 0.165490 Aug 30 19:04:37.160772 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3230/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:36 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:38.182455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:38.183194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:38.191227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:38.192031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:38.192654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:38.193720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:38.194516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:38.195236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:38.213259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "name": "network-vif-unplugged", "status": "completed", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:38.230427 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:38.231107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:38.231707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:38.245256 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Creating event network-vif-unplugged:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h1-854119-10 Aug 30 19:04:38.250948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:04:38.262911 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4414b1fc-10ca-436d-a83a-351184f21b53 req-c4c1a80a-5e96-46fc-ade6-8ecf1d2cf2d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126297 Aug 30 19:04:38.263678 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3379/6609] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:04:38.423554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:38.432282 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dbd0478f-c6de-49f9-b482-c5804c1d2ddb tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1514 microversion: 2.1 time: 0.254308 Aug 30 19:04:38.443192 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3231/6610] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:38 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:39.458704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:39.459292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:39.465703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:39.466193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:39.466679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:39.467379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:39.467809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:39.468261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:39.611786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:39.621426 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fd049316-396a-4831-9a72-ac040df8fd65 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1512 microversion: 2.1 time: 0.168040 Aug 30 19:04:39.622268 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3380/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:39 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:40.286182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:40.298032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:40.298547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:40.299008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:40.311847 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Creating event network-changed:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h1-854119-10 Aug 30 19:04:40.317671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:04:40.329571 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-33933262-c962-4a14-8516-e29e872ec4f8 req-7d492284-132f-4103-9636-66b0d91f1805 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047091 Aug 30 19:04:40.330512 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3232/6612] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:04:40.647346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:40.648134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:40.656284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:40.656783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:40.657250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:40.657956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:40.658504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:40.658863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:41.177672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:41.186451 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47486e83-eb5f-48e0-bd3e-502af29c45e3 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1512 microversion: 2.1 time: 0.545747 Aug 30 19:04:41.187046 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3381/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:40 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1512 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:42.211722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:42.212451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:42.220276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:42.220821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:42.221291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:42.222069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:42.222553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:42.223021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:42.380775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:42.390495 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a7ea0358-e249-4833-8bd3-d25b3502520e tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1509 microversion: 2.1 time: 0.184040 Aug 30 19:04:42.391397 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3233/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:42 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:42.413837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:42.414452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:42.421200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:42.421697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:42.422128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:42.422854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:42.423302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:42.423719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:42.461501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:04:42.807511 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.compute.api [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Found an unconfirmed migration during delete, id: 16, status: finished Aug 30 19:04:43.509630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "name": "network-vif-plugged", "status": "completed", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:43.519871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:43.521308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:43.522036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:43.535647 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Creating event network-vif-plugged:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h1-854119-10 Aug 30 19:04:43.542607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:04:43.555704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1d640dab-3fc1-464c-849c-50b830b30333 req-c2e8b825-ba20-40b9-a212-51caa406c0b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137160 Aug 30 19:04:43.556350 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3234/6615] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:04:44.499292 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-04f0da15-368f-4e3c-9c4b-eb8deebfd786 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "DELETE /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 204 len: 0 microversion: 2.1 time: 2.090372 Aug 30 19:04:44.506472 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3382/6616] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:04:42 2022] DELETE /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 0 bytes in 2093 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:04:44.512278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:44.512997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:44.519842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:44.520346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:44.520809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:44.521573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:44.522114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:44.522625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:44.674541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:44.687010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-86b4965c-558f-4874-8f4f-9ebd12711fce tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1501 microversion: 2.1 time: 0.179750 Aug 30 19:04:44.687803 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3235/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:44 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:45.710993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:45.711847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:45.720458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:45.720987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:45.721625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:45.722366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:45.722798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:45.723255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:45.874653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5613c54cf9343e7b9833d333623ebc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b720b68b89be4c06a66186104fc4766f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:45.883207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-27e05d75-194d-4bc1-8f26-a44b49b4941a tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 200 len: 1501 microversion: 2.1 time: 0.177332 Aug 30 19:04:45.883817 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3383/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:45 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:46.438219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08412bd1-9c40-4691-a50f-c286de30e7d2", "name": "network-vif-deleted", "tag": "81846b53-c79d-4991-928d-f87328adaecd"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:46.449132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:46.449643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:46.450083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:46.462100 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] Creating event network-vif-deleted:81846b53-c79d-4991-928d-f87328adaecd for instance 08412bd1-9c40-4691-a50f-c286de30e7d2 on n-h1-854119-10 Aug 30 19:04:46.467096 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3a5c0bfc-e7a8-4a42-98d0-58f2635b0918 req-2848e978-12a2-456b-bdc8-6b0e08797cbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Aug 30 19:04:46.467720 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3236/6619] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:04:46.905556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:46.906207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:46.914680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:46.915343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:46.915887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:46.916589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:46.917041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:46.917461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:46.935170 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] HTTP exception thrown: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Request method failure captured: Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 HTTP/1.1 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl8aZA-TiK7onQhTCO5PTqdGaNA1WvFbZyWka24jItbPGtxExKbVDZ8KPHlgGSxks1oFN3VinAytj4Px837ykMnrxp7uoDyhWz-KBBOylWc06ETozVHRxw_8Tuw8HsdrUjqViU_QNUHD1rviEQsz1WB8_OBvzmzT2yrtKhFdJBzngeE Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b720b68b89be4c06a66186104fc4766f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d5613c54cf9343e7b9833d333623ebc4 Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '08412bd1-9c40-4691-a50f-c286de30e7d2'} Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:46.937282 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Returning 404 to user: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4a1ff6a-eb4d-4dff-91df-2754bdb3fdf0 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 404 len: 111 microversion: 2.1 time: 0.037316 Aug 30 19:04:46.941507 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3384/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:46 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:04:46.959013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:46.959595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:46.967003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:46.967678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:46.968132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:46.969242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:46.969926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:46.970545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:46.986101 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] HTTP exception thrown: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Request method failure captured: Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 HTTP/1.1 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl8aZA-TiK7onQhTCO5PTqdGaNA1WvFbZyWka24jItbPGtxExKbVDZ8KPHlgGSxks1oFN3VinAytj4Px837ykMnrxp7uoDyhWz-KBBOylWc06ETozVHRxw_8Tuw8HsdrUjqViU_QNUHD1rviEQsz1WB8_OBvzmzT2yrtKhFdJBzngeE Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b720b68b89be4c06a66186104fc4766f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: d5613c54cf9343e7b9833d333623ebc4 Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '08412bd1-9c40-4691-a50f-c286de30e7d2'} Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:04:46.987851 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Returning 404 to user: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2fb13a13-4c46-40e6-9a16-c2a90e118c45 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "DELETE /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 404 len: 111 microversion: 2.1 time: 0.035944 Aug 30 19:04:46.991781 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3237/6621] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:04:46 2022] DELETE /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 19:04:46.998906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:46.999513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] [instance: 08412bd1-9c40-4691-a50f-c286de30e7d2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:47.005941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:47.006450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:47.006931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:47.007618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:47.008050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:47.008479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:47.023199 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] HTTP exception thrown: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Request method failure captured: Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 HTTP/1.1 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl8aZA-TiK7onQhTCO5PTqdGaNA1WvFbZyWka24jItbPGtxExKbVDZ8KPHlgGSxks1oFN3VinAytj4Px837ykMnrxp7uoDyhWz-KBBOylWc06ETozVHRxw_8Tuw8HsdrUjqViU_QNUHD1rviEQsz1WB8_OBvzmzT2yrtKhFdJBzngeE Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b720b68b89be4c06a66186104fc4766f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b720b68b89be4c06a66186104fc4766f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: b720b68b89be4c06a66186104fc4766f Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-DeleteServersTestJSON-2094293881 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: d5613c54cf9343e7b9833d333623ebc4 Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-DeleteServersTestJSON-2094293881-project Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '08412bd1-9c40-4691-a50f-c286de30e7d2'} Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:04:47.024722 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] Returning 404 to user: Instance 08412bd1-9c40-4691-a50f-c286de30e7d2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cfbf489c-cd2f-47bc-8438-930825a0c4d2 tempest-DeleteServersTestJSON-2094293881 tempest-DeleteServersTestJSON-2094293881-project] 10.222.0.25 "GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2" status: 404 len: 111 microversion: 2.1 time: 0.031201 Aug 30 19:04:47.028198 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3385/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:46 2022] GET /compute/v2.1/servers/08412bd1-9c40-4691-a50f-c286de30e7d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:04:56.256803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-403334054", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "0ae6c056-45db-4411-b791-91721b6266b9"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:56.325809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] validate_networks() for [('0ae6c056-45db-4411-b791-91721b6266b9', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:04:56.819717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:04:56.820144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:04:56.820848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:04:56.821321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:04:56.821745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:04:56.831568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:56.832032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:56.832481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:56.833222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:56.833682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:56.834115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:56.851405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:04:56.857611 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for user a2154099776c4848bdc82810dfdcc7f4 and project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:04:56.870893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:04:56.873546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:04:56.923828 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46c0a221-3e70-455f-8470-c95230d5ddd8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798894 Aug 30 19:04:56.925142 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3238/6623] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:04:56.935867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8b3a006-edba-40bc-90e0-461897270b12 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:56.937065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8b3a006-edba-40bc-90e0-461897270b12 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:57.004185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8b3a006-edba-40bc-90e0-461897270b12 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:57.011634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8b3a006-edba-40bc-90e0-461897270b12 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1217 microversion: 2.1 time: 0.079589 Aug 30 19:04:57.012219 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3386/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:56 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:58.033959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:58.035280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:58.043847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:58.044454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:58.044894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:58.045643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:58.046106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:58.046566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:58.116082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:58.125332 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5e324c7b-8e06-4b20-8f54-d919f1a6002a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1269 microversion: 2.1 time: 0.096582 Aug 30 19:04:58.126362 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3239/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:58 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:59.153580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:04:59.154323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:04:59.165237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:04:59.168663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:59.169401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:59.170100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:59.171009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:59.171956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:59.172529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:59.462537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:04:59.474845 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5ff7035-f343-4ec6-b4a7-bc2f510295e4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.325899 Aug 30 19:04:59.475780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3387/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:04:59 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:04:59.919672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:04:59.932646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:04:59.933140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:04:59.933590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:04:59.948695 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] Creating event network-changed:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h2-854119-10 Aug 30 19:04:59.955710 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-dbf4fad5-05c7-4b9d-a6da-688c46a554bb req-337f7f48-84c4-41b6-b0b9-41fa25f8c31c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039859 Aug 30 19:04:59.956503 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3240/6627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:00.497830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:00.498625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:00.506466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:00.507005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:00.507431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:00.508346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:00.508830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:00.509412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:00.653855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:00.661844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1db4f7e6-57f0-4a95-9d39-0476a2c8c4aa tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.168377 Aug 30 19:05:00.662440 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3388/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:00 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:01.684101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:01.684832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:01.692094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:01.692609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:01.693066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:01.693824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:01.694301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:01.695099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:01.853132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:01.861904 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7df13cc-9518-4597-84d3-6b035fd147c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.182065 Aug 30 19:05:01.862560 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3241/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:01 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:02.884386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:02.884926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:02.892326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:02.892857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:02.893332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:02.894106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:02.894698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:02.895131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:03.063255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:03.074887 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-644498ad-f091-4855-b683-739c9b06116c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.194528 Aug 30 19:05:03.075557 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3389/6630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:02 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:04.100830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:04.101860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:04.104960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:04.110998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:04.111437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:04.111923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:04.112712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:04.113216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:04.113709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:04.117649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=64 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:04.276729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:04.285538 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0269812-7588-4595-9f13-bc41fdd68d92 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.188653 Aug 30 19:05:04.286199 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3242/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:04 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:05.309933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:05.310698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:05.314583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:05.322165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:05.322907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:05.323381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:05.324377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:05.324939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:05.325414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:05.484282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:05.495307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-793ab942-6324-4c55-b7bf-3dbd8161daf2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.191597 Aug 30 19:05:05.495923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3390/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:05 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:06.042671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "name": "network-vif-plugged", "status": "completed", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:06.055161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:06.055671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:06.056125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:06.071277 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] Creating event network-vif-plugged:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h2-854119-10 Aug 30 19:05:06.076771 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d239b518-44d0-41eb-92d0-45fa0e1ed0cc req-cbc6e77c-f436-4ab1-9039-f60c0760104d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Aug 30 19:05:06.077386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3243/6633] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:06.519031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:06.519649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:06.527033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:06.527524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:06.527961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:06.528670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:06.529127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:06.529550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:06.671430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:06.683835 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-551b10d5-6692-4f8c-abfd-1ee276132807 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1317 microversion: 2.1 time: 0.168916 Aug 30 19:05:06.684641 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3391/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:06 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:07.702736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:07.703525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:07.709149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:07.709875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:07.717835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:07.718390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:07.718891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:07.719610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:07.720085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:07.720530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:07.875425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:07.886596 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14581607-7d62-401e-90a0-1d3ddd9acef9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1508 microversion: 2.1 time: 0.184654 Aug 30 19:05:07.887274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3244/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:07 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:07.911371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:07.912099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:07.914055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:07.921517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:07.922046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:07.922553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:07.923328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:07.923846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:07.924330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.070856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:08.080796 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c274409c-c858-4a1a-8a5f-c116a58fedb0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1508 microversion: 2.1 time: 0.173423 Aug 30 19:05:08.081480 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3392/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:07 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:08.105346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:08.109034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:08.117729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.118370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.119062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.120140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.120709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.121279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.205649 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16f5f7dc-7589-4f1b-a585-bc6940557abf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "PUT /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1080 microversion: 2.1 time: 0.105227 Aug 30 19:05:08.206566 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3245/6637] 10.222.0.25 () {60 vars in 1256 bytes} [Tue Aug 30 19:05:08 2022] PUT /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1080 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:05:08.228103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:08.228750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:08.235194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.235693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.236132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.236836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.237295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.237724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.382696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:08.392238 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2fa02c7c-1214-4ae0-9cdd-4b4eecf2c587 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1506 microversion: 2.1 time: 0.168839 Aug 30 19:05:08.392841 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3393/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:08 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:08.413102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:08.413742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:08.420904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.421408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.421971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.422847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.423372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.423811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.584522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:08.596537 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-737111a3-09ac-4b80-b1d7-067c5f6375b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1506 microversion: 2.1 time: 0.187181 Aug 30 19:05:08.597491 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3246/6639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:08 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:08.630697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:08.633657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:08.643231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.644008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.644624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.645731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.646452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.647019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.683590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:08.690676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:05:08.697889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:05:08.698335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:05:08.698870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:05:08.699254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:05:08.699666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:05:08.776950 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38233477-feb7-414a-aa9f-173bfc98e6ce tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87/action" status: 202 len: 0 microversion: 2.1 time: 0.151399 Aug 30 19:05:08.777617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3394/6640] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:05:08 2022] POST /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:05:08.786185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:08.786833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:08.794051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.794615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.795048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.795859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:08.796447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:08.796913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:08.956753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:08.971448 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6cdacb65-9e7f-40bf-a5df-4990739f4fa4 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1517 microversion: 2.1 time: 0.189277 Aug 30 19:05:08.972296 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3247/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:08 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:09.997201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:09.997832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:10.004347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:10.004835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:10.005268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:10.005967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:10.006447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:10.006872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:10.169337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:10.178377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7697e4e7-8d51-4d2c-b252-818e9a1145cf tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1517 microversion: 2.1 time: 0.186959 Aug 30 19:05:10.179008 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3395/6642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:09 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:11.206649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:11.207293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:11.217488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:11.218107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:11.218604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:11.219463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:11.220067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:11.220644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:11.372715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:11.384542 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05fffee0-26aa-493c-8601-b811d5a72e93 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.183844 Aug 30 19:05:11.385250 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3248/6643] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:11 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:12.408538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:12.409220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:12.419076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:12.419829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:12.420422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:12.421449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:12.422151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:12.422686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:12.582876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:12.597433 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2358c760-4ff7-418b-9c68-ccc35470b1c6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.194612 Aug 30 19:05:12.598478 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3396/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:12 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:13.624273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:13.625207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:13.633684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:13.634372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:13.634961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:13.635845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:13.636417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:13.636965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:13.791295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:13.801010 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-15c18f80-c61a-4081-97b5-6428ec0f344d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.183088 Aug 30 19:05:13.801675 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3249/6645] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:13 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:14.827457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:14.828100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:14.840010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:14.840755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:14.841401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:14.842369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:14.843088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:14.843682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:15.001161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:15.010387 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf919cd8-6716-44da-b144-6ab8090f3b11 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.188637 Aug 30 19:05:15.011001 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3397/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:14 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:05:16.033440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:16.034206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:16.042208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:16.042821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:16.043399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:16.044130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:16.044600 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:16.045040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:16.206393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:16.214726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e7f11f0-6ee0-4c45-be48-786b4c88d265 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.185914 Aug 30 19:05:16.215314 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3250/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:16 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:17.245121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:17.245765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:17.253546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:17.254039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:17.254515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:17.255241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:17.255702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:17.256129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:17.396245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:17.406366 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4ce5fdad-6386-4a23-b2f6-70eac941b154 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.165454 Aug 30 19:05:17.407015 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3398/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:17 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:18.429586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:18.430196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:18.439310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:18.439912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:18.440504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:18.441356 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:18.441949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:18.442488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:18.601756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:18.610213 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f50a97d-c405-4a5b-907f-e1a9f4025a55 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.184746 Aug 30 19:05:18.610843 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3251/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:18 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:19.638950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:19.639865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:19.647715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:19.648205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:19.648644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:19.649346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:19.649798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:19.650221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:19.796180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:19.812076 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8a1a4dc-8efe-497c-8a21-4b5eb2054ff5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.177869 Aug 30 19:05:19.812802 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3399/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:19 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:05:20.838624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:20.839179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:20.848704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:20.849215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:20.849677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:20.850430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:20.850906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:20.851349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:21.003773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:21.015451 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a85eceb4-8d46-49f1-afb5-54da9aa2e949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.182452 Aug 30 19:05:21.016037 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3252/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:20 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:22.038590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:22.039243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:22.047031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:22.047633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:22.047969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:22.048681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:22.049144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:22.049968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:22.203540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:22.214718 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0396608b-30d2-4804-b3a4-33e5ecea4dc9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.180209 Aug 30 19:05:22.215458 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3400/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:22 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:23.240222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:23.240989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:23.249633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:23.249970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:23.250546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:23.251435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:23.251995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:23.252542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:23.400559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:23.408848 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d2a0dd58-b5a2-47b3-a8a6-a9e1685ae453 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.173801 Aug 30 19:05:23.409453 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3253/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:23 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:24.436802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:24.437413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:24.444673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:24.445158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:24.445635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:24.446389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:24.446841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:24.447263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:24.590007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:24.598493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eac4cf8e-1fcc-43e9-92d3-8dd3e8930cba tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.165621 Aug 30 19:05:24.599066 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3401/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:24 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:25.621574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:25.622270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:25.629180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:25.629666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:25.630119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:25.630855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:25.631317 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:25.631755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:25.773909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:25.782241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5610052e-af33-4c55-b878-5237f1b14e45 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.165864 Aug 30 19:05:25.782867 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3254/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:25 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:26.805786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:26.806403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:26.813907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:26.814409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:26.814874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:26.815585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:26.816048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:26.816487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:26.820582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:26.958082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:26.967717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9d576fd-61a3-4b99-8536-842c0cabe269 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.165884 Aug 30 19:05:26.968316 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3402/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:26 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:27.989689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:27.990254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:27.997750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:27.998252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:27.998733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:27.999449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:27.999914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:28.000339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:28.148647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:28.160307 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c794c17-e236-4e6d-a067-d99f04f461f3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.174497 Aug 30 19:05:28.161040 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3255/6657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:27 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:29.183619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:29.184292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:29.191478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:29.191972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:29.192411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:29.193157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:29.193614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:29.194041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:29.331526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:29.339781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0863ea7-98c8-4cbc-9314-655b45aa1b8d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.161270 Aug 30 19:05:29.340372 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3403/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:29 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:30.362158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:30.362783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:30.370307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:30.370882 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:30.371315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:30.372063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:30.372534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:30.372977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:30.515497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:30.528132 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e31c522c-6613-4e2a-8a12-2992a4c840d5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.169764 Aug 30 19:05:30.528949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3256/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:30 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:31.552294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:31.553094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:31.561377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:31.561857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:31.562301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:31.563051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:31.563515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:31.563947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:31.710689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:31.722015 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9e75b59f-c6f6-4d70-9935-24c6b170bc57 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.175747 Aug 30 19:05:31.722987 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3404/6660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:31 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:32.745542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:32.746164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:32.753966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:32.754490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:32.754938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:32.755666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:32.756126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:32.756590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:32.901996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:32.910117 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-58d0d820-6106-402f-98cc-88b36d7d2977 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.168624 Aug 30 19:05:32.910953 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3257/6661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:32 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:33.932135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:33.932699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:33.940241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:33.940735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:33.941175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:33.941906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:33.942376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:33.942830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:34.088092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:34.100789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-331757e8-0e3e-4288-a980-67c864950b59 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.172509 Aug 30 19:05:34.101737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3405/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:33 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:35.124031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:35.124591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:35.127497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=32 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:35.133216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:35.133612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:35.134323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:35.135107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:35.136055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:35.136533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:35.139907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:35.278703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:35.292573 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46d3299f-0869-4a9f-ad2b-6790fbedd027 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.172223 Aug 30 19:05:35.293357 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3258/6663] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:35 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:36.322623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:36.323559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:36.326319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=36 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:36.332212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:36.332699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:36.333140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:36.333849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:36.334309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:36.334765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:36.474874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:36.483531 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f17bd8b0-18f4-4c58-8ccd-701ad413cb87 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.167183 Aug 30 19:05:36.484118 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3406/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:36 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:37.505458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:37.506065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:37.514744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:37.515251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:37.515704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:37.516531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:37.517054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:37.517448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:37.660511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:37.669678 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0f0fe57b-f201-4489-8448-2e027c0c108c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1522 microversion: 2.1 time: 0.168236 Aug 30 19:05:37.670489 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3259/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:37 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:38.314288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "name": "network-vif-unplugged", "status": "completed", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:38.326452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:38.327015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:38.327501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:38.341063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Creating event network-vif-unplugged:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h1-854119-10 Aug 30 19:05:38.347118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:05:38.358931 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-56112427-60bd-4506-b0e1-588b4acabb9b req-58ac1f13-9812-4a16-9f32-f6242ec2e606 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048336 Aug 30 19:05:38.359411 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3407/6666] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:38.691858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:38.692449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:38.700146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:38.700641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:38.701077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:38.701803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:38.702276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:38.702754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:38.947031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:38.957304 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5cdc1be4-1350-42bd-acdc-e7f49875df1a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1521 microversion: 2.1 time: 0.269150 Aug 30 19:05:38.958011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3260/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:38 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:39.983530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:39.984276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:39.991211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:39.991702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:39.992158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:39.992858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:39.993329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:39.993730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:40.143498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:40.151618 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb6c81c3-8840-4a1f-bb0f-77742cb598d9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1519 microversion: 2.1 time: 0.175365 Aug 30 19:05:40.152315 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3408/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:39 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:40.379395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:40.390135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:40.390646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:40.391085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:40.403261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Creating event network-changed:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h1-854119-10 Aug 30 19:05:40.409021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:05:40.420671 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-208bd683-9113-47c6-9b28-3ac0e706f182 req-a0260962-f0c3-4aa7-a6eb-9b6fa2f65071 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045043 Aug 30 19:05:40.421324 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3261/6669] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:41.177038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:41.177641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:41.185490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.185983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.186444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.188121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.188121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.188121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.341111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:41.349322 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c80d24c5-53b6-46cf-ba1b-8080e304e794 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1516 microversion: 2.1 time: 0.178797 Aug 30 19:05:41.349887 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3409/6670] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:41 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:41.374531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:41.375434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:41.383995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.384702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.384999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.386048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.386686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.387126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.452285 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c4d65424-591b-4e08-bd6a-5d9bba21942c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87/action" status: 204 len: 0 microversion: 2.1 time: 0.084284 Aug 30 19:05:41.452851 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3262/6671] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:05:41 2022] POST /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 19:05:41.461656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:41.462269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:41.469288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.469811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.470252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.470993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:41.471446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:41.471872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:41.624482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:41.634102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5d5ea38b-71be-49b3-b661-991464b11839 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1516 microversion: 2.1 time: 0.176621 Aug 30 19:05:41.634746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3410/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:41 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:42.657753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:42.659381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:42.665901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:42.666395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:42.666855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:42.667891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:42.668367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:42.668809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:42.811901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:42.820157 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4ef9bc46-e37f-4987-bb8d-2f6ff21b2a53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1516 microversion: 2.1 time: 0.168236 Aug 30 19:05:42.821078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3263/6673] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:42 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:43.844327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:43.845106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:43.854412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:43.855099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:43.855575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:43.856297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:43.856778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:43.857208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:44.360379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:44.371232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5ae52d5-2f9b-464f-96e1-4a24abf0ff40 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1508 microversion: 2.1 time: 0.532312 Aug 30 19:05:44.371825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3411/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:43 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:44.395220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:44.395804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:44.403345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:44.403910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:44.404348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:44.405044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:44.405504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:44.405917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:44.556535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:44.566830 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e4a76100-d890-4949-b2f9-07aeaf34de37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1508 microversion: 2.1 time: 0.175636 Aug 30 19:05:44.567420 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3264/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:44 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:44.592565 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'create', calling method: .version_select at 0x7f4e55a41310>, body: {"keypair": {"name": "tempest-keypair-1038088456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq41M3KDZAkfg1qKrDZABaiaV2BO6/j98E/INgObW8TGh4uGnrckjTUJf2b++FkURs3jY9PO3RVUT9Ac50ag+dKzsZwXg8CK/o02SqCaUfMorwAaho5nhfT/sfl7eTYrQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:44.608703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:05:44.614136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for user a2154099776c4848bdc82810dfdcc7f4 and project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:05:44.628102 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:05:45.637076 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [bbfc438a-5678-4391-b4c3-751eef9ec1e1] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59842. Aug 30 19:05:45.656124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-82fa2d7e-3270-4857-8760-be7b6d114367 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.067725 Aug 30 19:05:45.662989 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3412/6676] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:05:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:45.722693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "name": "network-vif-plugged", "status": "completed", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:45.733959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:45.734558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:45.735263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:45.750046 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] Creating event network-vif-plugged:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h1-854119-10 Aug 30 19:05:45.755692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c9e07969-7815-45ca-aac8-9f3affb359c5 req-96d296b8-0d9a-43b2-bc28-325a44483e0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037721 Aug 30 19:05:45.756916 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3265/6677] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:46.920453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:46.921065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:46.932521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:46.933105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:46.933466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:46.934260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:46.934911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:46.935337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:47.081488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:47.090134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8d00031-2e27-4c93-8881-d0e44ae48ae6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 200 len: 1508 microversion: 2.1 time: 0.175436 Aug 30 19:05:47.090797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3413/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:46 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:47.112373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:47.112928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:47.119672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:47.120153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:47.120607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:47.121377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:47.121844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:47.122282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:47.148512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:05:47.234657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2b9bac4-1b01-4a79-ab7f-eb68c8085f84 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 204 len: 0 microversion: 2.1 time: 0.127012 Aug 30 19:05:47.235331 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3266/6679] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:05:47 2022] DELETE /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:05:47.297032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1328027990", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "0ae6c056-45db-4411-b791-91721b6266b9"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:47.357548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] validate_networks() for [('0ae6c056-45db-4411-b791-91721b6266b9', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:05:47.766250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:05:47.766714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:05:47.767226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:05:47.767593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:05:47.768001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:05:47.777399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:47.777883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:47.778317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:47.779072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:47.779531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:47.779945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:47.796406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:05:47.801953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Getting quotas for user a2154099776c4848bdc82810dfdcc7f4 and project 63c7dc4c409b4c39a85d1bfc24459249. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:05:47.814174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:05:47.816534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:05:47.866615 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-29efd283-0a40-4553-bb23-8ba6579eeb53 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573843 Aug 30 19:05:47.870867 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3414/6680] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:05:47.879560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7e2f9d2-6a53-4a31-8c53-36a16f6219b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:47.880292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7e2f9d2-6a53-4a31-8c53-36a16f6219b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:47.938817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7e2f9d2-6a53-4a31-8c53-36a16f6219b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:47.946389 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7e2f9d2-6a53-4a31-8c53-36a16f6219b6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1218 microversion: 2.1 time: 0.071078 Aug 30 19:05:47.946985 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3267/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:47 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:48.969052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:48.972123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:48.981421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:48.981421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:48.982233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:48.983133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:48.983601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:48.984031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:49.047906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd774837-d1c9-42ef-821e-68cdebbe6f87", "name": "network-vif-deleted", "tag": "08d52902-a16b-458d-b734-d9500856762e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:49.060469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:49.065852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:49.066640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:49.067472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:49.069390 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e6420627-202b-4323-8780-76106d57b6cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1270 microversion: 2.1 time: 0.104668 Aug 30 19:05:49.070020 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3415/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:48 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:49.080445 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] Creating event network-vif-deleted:08d52902-a16b-458d-b734-d9500856762e for instance bd774837-d1c9-42ef-821e-68cdebbe6f87 on n-h1-854119-10 Aug 30 19:05:49.085484 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7931900c-a6bd-43c3-9d36-4328084ab87d req-9ac1635a-cc03-42b5-939d-9dd8f169486a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041457 Aug 30 19:05:49.086099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3268/6683] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:50.092919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:50.093570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:50.102757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:50.103387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:50.103838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:50.104699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:50.105129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:50.105589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:50.322105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:50.331065 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7cd0dfe5-cc56-49fd-906c-92a436b19e5e tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.242359 Aug 30 19:05:50.331928 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3416/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:50 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:50.657591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:50.682058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:50.682936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:50.683700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:50.705136 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] Creating event network-changed:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h2-854119-10 Aug 30 19:05:50.710240 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7a447878-33e4-4ad0-98e7-8a1c89d1cf50 req-1cd16165-9f33-48fd-9dc7-0255145b602a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063532 Aug 30 19:05:50.711310 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3269/6685] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:51.354978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:51.355693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:51.363323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:51.363855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:51.364280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:51.364993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:51.365451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:51.365883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:51.513272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:51.525635 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-523be080-a53e-411a-9f44-20f01c75b1a3 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.175821 Aug 30 19:05:51.526511 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3417/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:51 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:52.548707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:52.550032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:52.557449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:52.557942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:52.558401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:52.559526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:52.559662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:52.560069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:52.707781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:52.720686 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6748adc-1e7a-460e-a866-79363ade7508 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.176042 Aug 30 19:05:52.721593 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3270/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:52 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:53.742845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:53.743477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:53.751188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:53.751682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:53.752124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:53.752822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:53.753288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:53.753721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:53.895689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:53.906298 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3ec4ba12-ff89-4ed8-9084-2b92c9ce0118 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.167634 Aug 30 19:05:53.906911 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3418/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:53 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:54.928498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:54.929175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:54.936822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:54.937327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:54.937819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:54.938590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:54.939069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:54.939512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:55.076643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:55.085291 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c0a7dbf-ee44-409b-94fc-a8bdbc6ce80a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.161093 Aug 30 19:05:55.085893 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3271/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:54 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:56.106491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:56.107122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:56.114525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:56.114979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:56.115473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:56.116149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:56.116601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:56.117024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:56.264034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:56.273144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-06c54352-0230-45f0-ae9e-c3a97b5d66d8 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.170648 Aug 30 19:05:56.275753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:56.287212 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3419/6690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:56 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:56.288430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:56.288837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:56.289259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:56.302022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] Creating event network-vif-plugged:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h2-854119-10 Aug 30 19:05:56.307466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-68597ad1-d920-4305-97b8-4ba1e3a0a2c0 req-abe7483b-f145-473b-8c9e-f3591ce32ee7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036165 Aug 30 19:05:56.308103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3272/6691] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:05:57.296021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:57.296640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:57.304702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:57.305187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:57.305618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:57.306323 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:57.306807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:57.307229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:57.310091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=95 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:57.455244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:57.465553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0cc9c141-b269-45e7-bcc4-ef890d03e48a tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1318 microversion: 2.1 time: 0.173907 Aug 30 19:05:57.466256 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3420/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:57 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:58.484823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:58.489083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:58.489873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:58.497115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.497890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.498494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.499234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.499730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.500171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.640589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:58.648985 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-203da3a0-48c4-4a09-849a-43b3e23cf8eb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1508 microversion: 2.1 time: 0.166418 Aug 30 19:05:58.649581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3273/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:58 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:58.670464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:58.671088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:58.673022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:58.673851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:58.680705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.681203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.681691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.682436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.682898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.683333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.823206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:58.832228 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c1635bd-a6e0-4abb-a649-9f4829d0afbb tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1508 microversion: 2.1 time: 0.165872 Aug 30 19:05:58.832834 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3421/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:58 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:05:58.852443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:05:58.854747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:58.861383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.861878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.862329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.863093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:58.863547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:58.863979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:58.942234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:58.949008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:05:58.956761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:05:58.957192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:05:58.957684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:05:58.958113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:05:58.958568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:05:59.046892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:05:59.083774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ddce7eb0-c6e3-4283-b3bc-3edc4e2a26b2 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5/action" status: 202 len: 0 microversion: 2.1 time: 0.235277 Aug 30 19:05:59.084420 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3274/6695] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:05:58 2022] POST /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:05:59.093801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:05:59.094476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:05:59.101180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:59.101688 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:59.102133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:59.102935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:05:59.103408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:05:59.103876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:05:59.283041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:05:59.291853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0afe9e3-3fba-415b-9d9a-50a97b2afdfc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1515 microversion: 2.1 time: 0.202960 Aug 30 19:05:59.292435 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3422/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:05:59 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:06:00.314900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:00.315634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:00.320323 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:06:00.320488 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:06:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 (ip 10.222.0.25) !!! Aug 30 19:06:00.330758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:00.331370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:00.331950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:00.332549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:00.333037 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:00.333498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:00.479895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:00.488993 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eba17c46-4f77-4b64-8a91-fe693e3d094f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1515 microversion: 2.1 time: 0.179488 Aug 30 19:06:00.489578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3275/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:00 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:01.510942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:01.511720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:01.519686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:01.520177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:01.520613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:01.521317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:01.521776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:01.522201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:01.663306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:01.671947 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c06a66d-4dbb-4b05-82b3-654d4a24bbf6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.165389 Aug 30 19:06:01.672514 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3423/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:01 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:02.705462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:02.706083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:02.713204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:02.713677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:02.714130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:02.714852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:02.715314 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:02.715742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:02.854256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:02.862579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0bc3891d-3ffc-44cc-8729-adf2fba6969c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.162863 Aug 30 19:06:02.863072 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3276/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:02 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:03.884564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:03.885207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:03.892615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:03.893097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:03.893530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:03.894229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:03.894709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:03.895139 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:04.043276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:04.054132 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1011e670-95f2-41f1-a182-42948242321f tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.173651 Aug 30 19:06:04.054983 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3424/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:03 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:05.081114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:05.081852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:05.091967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:05.092575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:05.093233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:05.094259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:05.094776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:05.095227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:05.238844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:05.250151 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b615a814-0604-4467-8f10-cdad90ca4ad5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.175060 Aug 30 19:06:05.250780 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3277/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:05 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:06.274116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:06.275083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:06.283306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:06.283810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:06.284245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:06.285119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:06.285759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:06.286412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:06.438980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:06.447497 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d402e717-9ca0-46ec-9e08-1c0334a89c37 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.179506 Aug 30 19:06:06.448131 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3425/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:06 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:07.469853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:07.470470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:07.473333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:07.479168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:07.479672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:07.480124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:07.480849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:07.481323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:07.481765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:07.629398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:07.637391 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-89a61083-4322-4459-8748-8f9cc7008107 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.171841 Aug 30 19:06:07.637959 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3278/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:07 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:08.660009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:08.660553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:08.663344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:08.669273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:08.669765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:08.670211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:08.670974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:08.671455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:08.671891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:08.835944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:08.844782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7e742008-d6a2-43df-8ba4-c48c4779264c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.188854 Aug 30 19:06:08.845383 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3426/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:08 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:09.874873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:09.876125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:09.886003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:09.886762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:09.887333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:09.888401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:09.888972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:09.889583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:10.038130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:10.046902 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-afc2b312-26e0-44d2-a364-2bcc384e6d75 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.178118 Aug 30 19:06:10.047509 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3279/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:09 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:11.070596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:11.071203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:11.078004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:11.078595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:11.079229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:11.079954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:11.080411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:11.080843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:11.214783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:11.223694 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2cad6d1a-c217-4ba1-b568-574428419a98 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.157437 Aug 30 19:06:11.224291 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3427/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:11 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:12.245223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:12.245830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:12.252918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:12.253420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:12.253872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:12.254622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:12.255095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:12.255536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:12.394744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:12.403028 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7656802c-d8ae-47b8-ae99-b84332539089 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.162040 Aug 30 19:06:12.403613 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3280/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:12 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:06:13.425922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:13.427317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:13.434923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:13.435470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:13.435877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:13.436586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:13.437037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:13.437470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:13.592984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:13.601465 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d149781-ea48-4886-bfc0-2694a3ff1942 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.179968 Aug 30 19:06:13.602058 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3428/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:13 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:14.624098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:14.624668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:14.632428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:14.632968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:14.633385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:14.634101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:14.634609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:14.635054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:14.777532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:14.786249 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fa9757fb-835a-4fa1-aa07-df43fd53231c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.166223 Aug 30 19:06:14.786864 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3281/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:14 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:15.810700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:15.811305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:15.821454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:15.822141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:15.822760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:15.823689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:15.824338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:15.825054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:15.967404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:15.979231 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bfe339f4-cf1a-49b7-8f38-04e5a76617cc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.174384 Aug 30 19:06:15.979998 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3429/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:15 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:17.007158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:17.007743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:17.015587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:17.016088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:17.016541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:17.017255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:17.017724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:17.018163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:17.156839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:17.169130 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3285b75-78c2-423c-892a-81411b94089c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.167133 Aug 30 19:06:17.169863 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3282/6711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:17 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:18.194814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:18.195502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:18.203006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:18.203489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:18.203922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:18.204629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:18.205079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:18.205498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:18.353297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:18.361631 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d4adae4d-5b5b-4332-a531-be0f8f6d973d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.170909 Aug 30 19:06:18.362216 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3430/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:18 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:19.389684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:19.390329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:19.400906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:19.401550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:19.402221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:19.403301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:19.403909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:19.404483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:19.568646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:19.578090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-caaec0e7-3bee-49bb-b55c-dd13061a3b8c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.193515 Aug 30 19:06:19.578697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3283/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:19 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:20.606978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:20.606978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:20.614101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:20.614860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:20.615575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:20.616609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:20.617319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:20.618071 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:20.773772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:20.783485 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3000dae7-846e-4f74-8fdf-bd9c3dd26818 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.185722 Aug 30 19:06:20.784063 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3431/6714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:20 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:06:21.806493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:21.807373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:21.814909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:21.815410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:21.815865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:21.816583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:21.817056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:21.817498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:22.257569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:22.269166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f3ba4bc7-0f9d-4214-896f-b2d344949a89 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.466600 Aug 30 19:06:22.269900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3284/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:21 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:23.296473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:23.297292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:23.307142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:23.307802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:23.308465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:23.309420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:23.310006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:23.310720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:23.463320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:23.475840 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0e9c8525-200b-49fd-ab09-b0b560279ded tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.185066 Aug 30 19:06:23.476656 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3432/6716] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:23 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:24.500429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:24.501052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:24.509912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:24.510438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:24.510898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:24.511634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:24.512099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:24.512537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:24.658816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:24.667652 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bdf4d013-bfdb-4604-8048-8e72c94c9ed5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.171263 Aug 30 19:06:24.668322 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3285/6717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:24 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:25.692114 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:25.692788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:25.703039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:25.703625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:25.704090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:25.704817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:25.705274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:25.705709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:25.857513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:25.866224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68445b2f-1520-41d1-a98b-fbf4f485b5b5 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.180402 Aug 30 19:06:25.866832 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3433/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:25 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:26.890602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:26.891245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:26.900904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:26.901598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:26.902121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:26.903056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:26.903681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:26.904288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:27.049638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:27.057759 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3eae3774-c398-46d3-8985-3e7e5f66c2a6 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.172785 Aug 30 19:06:27.058380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3286/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:26 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:28.081161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:28.081760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:28.089138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:28.089636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:28.090084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:28.090858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:28.091294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:28.091755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:28.094363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=84 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:28.250708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:28.258808 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ce343416-4544-43c0-a97b-593675948c88 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.183004 Aug 30 19:06:28.259405 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3434/6720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:28 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:29.283483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:29.284195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:29.292201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:29.292708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:29.293157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:29.293887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:29.294380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:29.294852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:29.298011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:29.436840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:29.449385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8d730a8c-40d3-4e6f-9a8a-bf55436fd15b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.171456 Aug 30 19:06:29.450229 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3287/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:29 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:30.473118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:30.473716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:30.481203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:30.481791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:30.482248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:30.483001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:30.483451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:30.483893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:30.631444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:30.643767 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af59b79e-5ceb-4ad0-b805-83e1034b3f78 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.174627 Aug 30 19:06:30.644556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3435/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:30 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:31.665435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:31.666048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:31.673541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:31.674046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:31.674855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:31.675576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:31.676049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:31.676492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:31.812263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:31.823919 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5b9775b-44f6-4266-b2d1-fb4feb756716 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.162160 Aug 30 19:06:31.824690 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3288/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:31 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:32.847569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:32.848150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:32.855371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:32.855893 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:32.856314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:32.857013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:32.857467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:32.857887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:33.002378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:33.010665 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-be7f0707-bf7c-4691-a90c-f11b579203f7 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1520 microversion: 2.1 time: 0.167217 Aug 30 19:06:33.011244 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3436/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:32 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:33.491377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "name": "network-vif-unplugged", "status": "completed", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:33.502288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:33.502810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:33.503248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:33.516504 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Creating event network-vif-unplugged:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h1-854119-10 Aug 30 19:06:33.522361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:06:33.534953 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0b05a5d1-0e8e-4054-a158-3c71622c75b6 req-758b00d5-5245-481b-9cc8-85516b9de0f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048534 Aug 30 19:06:33.536020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3289/6725] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:06:34.032963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:34.033477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:34.041088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:34.041602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:34.042022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:34.042756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:34.043207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:34.043625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:34.183408 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:34.191946 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3169356b-3837-452a-9ef2-326672a8ff60 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1519 microversion: 2.1 time: 0.163228 Aug 30 19:06:34.205154 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3437/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:34 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:35.214050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:35.214777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:35.223615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:35.224108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:35.224552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:35.225265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:35.225723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:35.226184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:35.380249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:35.392454 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0430dc03-c84b-4896-9a9d-d538f5ad678b tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1517 microversion: 2.1 time: 0.182724 Aug 30 19:06:35.393017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3290/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:35 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:35.553032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:35.564557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:35.565049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:35.565491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:35.578009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Creating event network-changed:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h1-854119-10 Aug 30 19:06:35.584383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:06:35.606354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-047d326b-d2b2-4d59-bee9-47a160b67423 req-4c9f6301-c057-4ed4-b47e-17fb64d294e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057051 Aug 30 19:06:35.607811 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3438/6728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:06:36.420778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:36.421367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:36.428860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.429355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.429794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.430525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.430992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.431426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.575495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:36.583883 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-94977e08-f145-4625-9f3e-0f009b028f7d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1514 microversion: 2.1 time: 0.167016 Aug 30 19:06:36.584473 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3291/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:36 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:36.605993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:36.606809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:36.614053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.614581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.615019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.615753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.616204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.616719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.680939 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00791860-398c-46e2-bb7b-b58233b35ea0 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "POST /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5/action" status: 204 len: 0 microversion: 2.1 time: 0.079293 Aug 30 19:06:36.682258 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3439/6730] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:06:36 2022] POST /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:06:36.691416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:36.692047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:36.698648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.699272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.699815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.700603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:36.701092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:36.701518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:36.848472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:36.856613 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9e68f83-a9b3-42e9-8439-9dd8720e8413 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1514 microversion: 2.1 time: 0.169231 Aug 30 19:06:36.857401 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3292/6731] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:36 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:37.879657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:37.880509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:37.890524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:37.891133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:37.891966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:37.892929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:37.893750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:37.894311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:38.046438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:38.056266 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b2b7fbf0-bc1a-4150-a01e-9becbf457949 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1514 microversion: 2.1 time: 0.181125 Aug 30 19:06:38.056871 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3440/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:37 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:39.078515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.079401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.082323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=30 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:39.088134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.088636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.089091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.089819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.090311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.090781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.232654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:39.243191 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5958bf15-909e-47aa-9286-c8b9f6954991 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1506 microversion: 2.1 time: 0.169169 Aug 30 19:06:39.243764 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3293/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:39 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:39.263931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.264549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.268313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=30 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:39.274363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.274859 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.275294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.276004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.276460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.276894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.415738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:39.424630 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-221543c6-6cbb-48e7-8162-9bcc5a1395be tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1506 microversion: 2.1 time: 0.164505 Aug 30 19:06:39.425242 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3441/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:39 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:39.446004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.446682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.453002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.453520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.454002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.454775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.455241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.455679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.608342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:39.620908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66c7c418-b396-45fc-b5d5-a97c74c5d73c tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1506 microversion: 2.1 time: 0.178787 Aug 30 19:06:39.621745 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3294/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:39 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:39.643471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.643979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.653117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.653672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.654125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.654891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.655341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.655758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.683321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:06:39.778040 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66e80f03-4226-4825-bde0-ec6afbf27228 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 204 len: 0 microversion: 2.1 time: 0.138362 Aug 30 19:06:39.779075 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3442/6736] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:06:39 2022] DELETE /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:06:39.795697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.796236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.803198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.803695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.804147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.804877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.805368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.805808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.834289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:06:39.892774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.compute.api [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Instance is already in deleting state, ignoring this request Aug 30 19:06:39.894316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-57bba880-44d2-48b0-bdf8-8870362a82ed tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 204 len: 0 microversion: 2.1 time: 0.102317 Aug 30 19:06:39.895423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3295/6737] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:06:39 2022] DELETE /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:06:39.909097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:39.910399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:39.921184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.922165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.923034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.924564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.925396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.926155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:39.987754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:39.997619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:39.998110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:39.998614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:40.013789 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] Creating event network-vif-plugged:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h1-854119-10 Aug 30 19:06:40.019918 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-cfe5a7dd-288e-461f-812f-994f13efb6a2 req-16f6aaf6-7a24-45b0-8506-46caa1f49e7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Aug 30 19:06:40.021274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3296/6738] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:06:40.084977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:40.093434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9cd1d24c-5ae2-44f3-9bd3-46ba65e72b77 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1512 microversion: 2.1 time: 0.191742 Aug 30 19:06:40.094106 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3443/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:39 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:41.117163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:41.117897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:41.125221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:41.125692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:41.126240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:41.127669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:41.128145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:41.128585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:41.368103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2154099776c4848bdc82810dfdcc7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7dc4c409b4c39a85d1bfc24459249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:41.377602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dd846264-4367-4778-bfc6-75767cf5bac9 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 200 len: 1512 microversion: 2.1 time: 0.265908 Aug 30 19:06:41.378113 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3297/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:41 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:41.637799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f90c67-b80a-4b24-9730-2fe72572f9b5", "name": "network-vif-deleted", "tag": "6952b2ce-60ab-4c3c-9dae-ab62cffa22ec"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:41.650736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:41.651445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:41.652045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:41.667720 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] Creating event network-vif-deleted:6952b2ce-60ab-4c3c-9dae-ab62cffa22ec for instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 on n-h1-854119-10 Aug 30 19:06:41.674148 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-762bd424-e66c-4b1b-b7be-208cd65af4b8 req-df0245d3-7f56-4a31-a6bb-a9c0dc626a55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040566 Aug 30 19:06:41.675681 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3444/6741] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:06:42.399213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:42.399817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: 79f90c67-b80a-4b24-9730-2fe72572f9b5] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:42.406971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:42.407466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:42.407912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:42.408631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:42.409123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:42.409533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:42.423745 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] HTTP exception thrown: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Request method failure captured: Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 HTTP/1.1 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl9XvBQ8zjzUWFXyoN0sBlACDR2MLGOluR3NQrPfnOZ58aHYdLFOnWCKclP893jaRLuVt-GvGD6mINQODE6L4Q2g2fxIFzyX-qa4sVF8_wgnZ7OZ8DZQX19MEIUNdrH8eSUIjUoXqwo-TwFUMfcwqNWb-HhJDL4WE8XoHeBWZ8VWszk Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a2154099776c4848bdc82810dfdcc7f4 Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '79f90c67-b80a-4b24-9730-2fe72572f9b5'} Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:42.426113 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Returning 404 to user: Instance 79f90c67-b80a-4b24-9730-2fe72572f9b5 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7726678d-0e9e-4105-82cd-7377dafd4766 tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5" status: 404 len: 111 microversion: 2.1 time: 0.032417 Aug 30 19:06:42.430183 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3298/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:42 2022] GET /compute/v2.1/servers/79f90c67-b80a-4b24-9730-2fe72572f9b5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:06:42.440493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-31e8fa18-bc29-4ec3-8d94-033ead8b18bd tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '.version_select at 0x7f4e55e010d0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:42.464102 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-31e8fa18-bc29-4ec3-8d94-033ead8b18bd tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038088456" status: 202 len: 0 microversion: 2.1 time: 0.030105 Aug 30 19:06:42.464684 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3445/6743] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 19:06:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038088456 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:06:43.136640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:43.137158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:43.143619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:43.144344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:43.144797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:43.145511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:43.145978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:43.146449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:43.164397 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] HTTP exception thrown: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Request method failure captured: Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 HTTP/1.1 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl9XvBQ8zjzUWFXyoN0sBlACDR2MLGOluR3NQrPfnOZ58aHYdLFOnWCKclP893jaRLuVt-GvGD6mINQODE6L4Q2g2fxIFzyX-qa4sVF8_wgnZ7OZ8DZQX19MEIUNdrH8eSUIjUoXqwo-TwFUMfcwqNWb-HhJDL4WE8XoHeBWZ8VWszk Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: a2154099776c4848bdc82810dfdcc7f4 Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'bd774837-d1c9-42ef-821e-68cdebbe6f87'} Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:06:43.169692 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Returning 404 to user: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9ef900d-253b-428f-841e-192e689e78fc tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 404 len: 111 microversion: 2.1 time: 0.039360 Aug 30 19:06:43.172943 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3299/6744] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:06:43 2022] DELETE /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:06:43.181986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:43.182781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] [instance: bd774837-d1c9-42ef-821e-68cdebbe6f87] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:43.190523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:43.191029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:43.191479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:43.192198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:43.192771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:43.193117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:43.207590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] HTTP exception thrown: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Request method failure captured: Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 HTTP/1.1 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl9XvBQ8zjzUWFXyoN0sBlACDR2MLGOluR3NQrPfnOZ58aHYdLFOnWCKclP893jaRLuVt-GvGD6mINQODE6L4Q2g2fxIFzyX-qa4sVF8_wgnZ7OZ8DZQX19MEIUNdrH8eSUIjUoXqwo-TwFUMfcwqNWb-HhJDL4WE8XoHeBWZ8VWszk Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63c7dc4c409b4c39a85d1bfc24459249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 63c7dc4c409b4c39a85d1bfc24459249 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2134564044 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: a2154099776c4848bdc82810dfdcc7f4 Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerDiskConfigTestJSON-2134564044-project Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'bd774837-d1c9-42ef-821e-68cdebbe6f87'} Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:06:43.209421 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] Returning 404 to user: Instance bd774837-d1c9-42ef-821e-68cdebbe6f87 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e89300d6-2d06-4791-b4fc-0fd5de20be4d tempest-ServerDiskConfigTestJSON-2134564044 tempest-ServerDiskConfigTestJSON-2134564044-project] 10.222.0.25 "GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87" status: 404 len: 111 microversion: 2.1 time: 0.034128 Aug 30 19:06:43.213058 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3446/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:43 2022] GET /compute/v2.1/servers/bd774837-d1c9-42ef-821e-68cdebbe6f87 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:06:52.380160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b270756e-4c53-4f29-b500-6ac65c0a7a0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: .version_select at 0x7f4e559525e0>, body: {"keypair": {"name": "tempest-keypair-1376688378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuDq4R1oOQ195frJJG5Bi4nvAgUpos4dBovzGoB+2j3b/ENdbtBBCAK/qCYE96FwcwKgEdSQdWfFV+XtElV+oq0uEN//86/leD06xVXlUz/OvGUmWDHukwUuYI6ouoJWA=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:52.398288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b270756e-4c53-4f29-b500-6ac65c0a7a0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:06:52.404468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-b270756e-4c53-4f29-b500-6ac65c0a7a0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:06:52.445990 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b270756e-4c53-4f29-b500-6ac65c0a7a0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209360 Aug 30 19:06:52.447086 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3300/6746] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:06:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:06:53.935107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1720851256", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43a2ca0e-9cfc-469a-9b83-47e3e3c026bf"}], "security_groups": [{"name": "tempest-securitygroup--1383404970"}], "key_name": "tempest-keypair-1376688378", "user_data": "}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:53.947145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:53.948128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:54.071771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] validate_networks() for [('43a2ca0e-9cfc-469a-9b83-47e3e3c026bf', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:06:54.494314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:06:54.494806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:06:54.495297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:06:54.495749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:06:54.496300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:06:54.507009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:54.507506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:54.507965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:54.508704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:54.509549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:54.509980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:54.529443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:06:54.536778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:06:54.552059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:06:54.554464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:06:54.607985 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e48fcd11-ea5e-4c62-9a3f-42b709f2f1bf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.677132 Aug 30 19:06:54.609406 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3447/6747] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:06:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:06:54.617672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:06:54.623840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f5f58c7-6467-47f4-bb45-9d1083482ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:54.624455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6f5f58c7-6467-47f4-bb45-9d1083482ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:54.682375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6f5f58c7-6467-47f4-bb45-9d1083482ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:54.691131 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f5f58c7-6467-47f4-bb45-9d1083482ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1239 microversion: 2.1 time: 0.073603 Aug 30 19:06:54.692275 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3301/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:54 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:55.711827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:55.712583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:55.721466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:55.722297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:55.722776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:55.723511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:55.723962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:55.724369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:55.795496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:55.804613 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0db63477-c14c-4fe1-818d-8ac51327c7ab tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1291 microversion: 2.1 time: 0.096673 Aug 30 19:06:55.805217 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3448/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:55 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:56.825303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:56.826987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:56.839939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:56.840554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:56.841054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:56.841823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:56.842291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:56.842842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:57.016057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:57.024934 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16b5bf72-4173-4261-96a7-3a61a3c7dcb8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.203535 Aug 30 19:06:57.025537 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3302/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:56 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:57.347161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:06:57.359140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:57.359684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:57.360475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:57.372667 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] Creating event network-changed:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h2-854119-10 Aug 30 19:06:57.378193 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-771e8c4c-2c87-472f-ade6-1f20c71de664 req-82ba89cb-9159-4830-b837-6077af46c5c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Aug 30 19:06:57.378857 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3449/6751] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:06:58.047073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:58.047712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:58.056377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:58.056891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:58.057346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:58.058088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:58.058586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:58.059060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:58.200031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:58.208529 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7c4aeeb-4905-45b7-8aa0-905a51320ad4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.165464 Aug 30 19:06:58.209125 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3303/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:58 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:06:59.231200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:06:59.231780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:06:59.238821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:59.239316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:59.239760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:59.240471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:06:59.240935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:06:59.241364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:06:59.386175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:06:59.394613 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4714646-8d23-4da0-ac50-039a02d008af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.168727 Aug 30 19:06:59.395209 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3450/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:06:59 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:00.420440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:00.421063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:00.430054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:00.430628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:00.431072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:00.431786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:00.432246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:00.432748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:00.577667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:00.586295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77c84c46-9bb8-434f-97bc-95090ddae638 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.169846 Aug 30 19:07:00.587380 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3304/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:00 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:01.608730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:01.609310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:01.619721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:01.620383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:01.621335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:01.623503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:01.624700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:01.625821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:01.778231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:01.788915 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32d126cb-bc53-4a03-bcdc-697d50746c5f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.184222 Aug 30 19:07:01.789512 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3451/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:01 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:02.595438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "name": "network-vif-plugged", "status": "completed", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:07:02.606487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:02.607059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:02.607518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:02.620734 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] Creating event network-vif-plugged:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h2-854119-10 Aug 30 19:07:02.625810 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2aa3988b-9de9-4e52-bf2e-0b572019a30a req-3fa45e11-72d0-430d-bd1a-d922ce8e1d02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Aug 30 19:07:02.626447 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3305/6756] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:07:02.810882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:02.811423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:02.820024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:02.820524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:02.820986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:02.821691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:02.822150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:02.822625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:03.295189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:03.304170 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53ad2bd1-07ed-4237-baaf-9a7819ccae1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1365 microversion: 2.1 time: 0.497464 Aug 30 19:07:03.304765 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3452/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:02 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:04.327599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:04.328355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:04.335528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:04.336036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:04.336482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:04.337237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:04.337704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:04.338114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:04.547867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:04.556841 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41522a1a-8a2f-4905-9060-ea94e43b5ec7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1552 microversion: 2.1 time: 0.234467 Aug 30 19:07:04.557408 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3306/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:04 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1552 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:04.579795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:04.580383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:04.583788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:04.584452 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:04.593873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:04.594420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:04.595062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:04.596008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:04.596609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:04.597141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:04.723423 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3295e1f2-1a17-4ace-805e-27e462322b1b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148094 Aug 30 19:07:04.724018 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3453/6759] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 19:07:04 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:07:05.900522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:07:05.905921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:05.913003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:05.913491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:05.913923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:05.927507 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] Creating event network-changed:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h2-854119-10 Aug 30 19:07:05.932813 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d48bc826-b41e-4bae-af7c-bc729bc55ee4 req-0b5b793a-5371-43cd-8748-4aca744e0c20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036129 Aug 30 19:07:05.933909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3307/6760] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:07:39.780121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:39.780990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:39.785704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:39.786313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:39.793587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:39.794092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:39.794555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:39.795237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:39.795687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:39.796108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.044981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:40.053421 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5341097-8064-4dd4-93db-72cca0795cf5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.275058 Aug 30 19:07:40.054041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3454/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:39 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:40.075504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:40.076223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:40.078432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:40.079159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=28 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:07:40.086479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.087115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.087552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.088336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.088861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.089304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.325745 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:40.335068 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18a4ca29-6918-40b4-8d11-6bbf7eec0aa9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.264127 Aug 30 19:07:40.335663 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3308/6762] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:40 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:40.355533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:40.356151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:40.362713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.363263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.363727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.364432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.364889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.365319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.516009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:40.525066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1baa8c27-a315-4c4d-aef2-1cdd150a2915 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.173388 Aug 30 19:07:40.525656 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3455/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:40 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:40.548079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:07:40.551740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:40.561278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.561963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.562563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.563558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.564064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.564661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.595133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:40.602174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:07:40.609922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:07:40.610384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:07:40.610881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:07:40.611297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:07:40.611723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:07:40.680060 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41f8e44f-53cf-4394-b5c3-a5de72a524e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/action" status: 202 len: 0 microversion: 2.1 time: 0.137540 Aug 30 19:07:40.680673 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3309/6764] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:07:40 2022] POST /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:07:40.688850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:40.689472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:40.696815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.697302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.697732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.698461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:40.698901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:40.699333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:40.870467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:40.879083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c6c7a9e-8a1d-4e65-8d09-24de2bf364b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1680 microversion: 2.1 time: 0.193704 Aug 30 19:07:40.879788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3456/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:40 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:41.904694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:41.905307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:41.914982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:41.915727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:41.916257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:41.917351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:41.918051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:41.918771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:42.072058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:42.080692 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c60ada92-dea6-449b-97b6-c6b7bd106cbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1680 microversion: 2.1 time: 0.182910 Aug 30 19:07:42.081277 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3310/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:41 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:43.102959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:43.103557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:43.111363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:43.111828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:43.112276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:43.112977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:43.113416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:43.113831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:43.257660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:43.266000 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e95feba5-65f0-4323-af23-a07077000369 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.167050 Aug 30 19:07:43.266989 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3457/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:43 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:44.288687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:44.289302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:44.296973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:44.297435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:44.297907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:44.298725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:44.299503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:44.299971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:44.451817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:44.461631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1c06bd8-7ac6-4521-a9ca-2d6c1087244f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.176940 Aug 30 19:07:44.462581 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3311/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:44 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:45.488391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:45.489383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:45.496824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:45.497304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:45.497751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:45.498506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:45.498991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:45.499424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:45.648038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:45.660159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8410cf6b-98ab-4d31-89e3-a9c68957dd4c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.177111 Aug 30 19:07:45.660921 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3458/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:45 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:46.684594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:46.685203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:46.694382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:46.694887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:46.695340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:46.696063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:46.696536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:46.696988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:46.844559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:46.853428 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-96760b7e-80ea-4124-8fca-7cb988bd8459 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.174890 Aug 30 19:07:46.854017 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3312/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:46 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:47.879950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:47.880645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:47.889487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:47.889995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:47.890460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:47.891175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:47.891624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:47.892044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:48.043204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:48.051959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-51f32394-1fa2-42a5-a0d7-6f7794f5eadf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.179531 Aug 30 19:07:48.052551 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3459/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:47 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:07:49.079813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:49.080488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:49.087972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:49.088479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:49.088939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:49.089669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:49.090119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:49.090620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:49.224922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:49.233385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0101c00-54b9-4024-912b-1ba6458afa0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.157513 Aug 30 19:07:49.233969 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3313/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:49 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:50.255580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:50.256297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:50.264083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:50.264576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:50.265011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:50.265718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:50.266168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:50.266616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:50.412538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:50.420629 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7e1472e-c1f7-4349-afe5-b65e90c58f1d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.169271 Aug 30 19:07:50.421215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3460/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:50 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:51.445118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:51.445734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:51.456702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:51.457391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:51.458036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:51.459019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:51.459505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:51.460201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:51.604794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:51.616134 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-79df6508-3994-4892-bc05-fd5534aa01c1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.175998 Aug 30 19:07:51.616847 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3314/6774] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:51 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:52.638486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:52.639059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:52.646602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:52.647099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:52.647587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:52.648377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:52.648813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:52.649266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:52.785932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:52.795717 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f52da13-3da4-42e8-9315-6216ff2f2e0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.161529 Aug 30 19:07:52.796275 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3461/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:52 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:53.820916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:53.821550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:53.832409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:53.833032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:53.833687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:53.834752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:53.835377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:53.835945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:53.986050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:53.994832 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98fe513f-ad7b-4259-a8c7-61a68268b4e8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.180295 Aug 30 19:07:53.995407 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3315/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:53 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:55.017690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:55.018274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:55.026581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:55.027076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:55.027518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:55.028233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:55.028694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:55.029127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:55.173699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:55.183792 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f0f48562-89d9-47cd-b5e2-c3abbee35f55 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.170122 Aug 30 19:07:55.184432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3462/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:55 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:56.205850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:56.206517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:56.213827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:56.214376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:56.214838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:56.215542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:56.215972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:56.216429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:56.360498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:56.368448 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c9f4a6f8-884e-4b27-8fa7-e330f8707de8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.166846 Aug 30 19:07:56.369110 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3316/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:56 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:57.390229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:57.390871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:57.398394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:57.398905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:57.399339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:57.400237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:57.400237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:57.400954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:57.539115 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:57.550876 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cefa728e-370d-4900-8cf9-7072d407d6cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.164466 Aug 30 19:07:57.551590 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3463/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:57 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:58.573388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:58.574157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:58.581969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:58.582523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:58.582968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:58.583682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:58.584171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:58.584597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:58.731744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:58.740119 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ed404207-3450-4656-aada-b2bb01cfe07f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.170941 Aug 30 19:07:58.740685 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3317/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:58 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:07:59.761632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:07:59.762433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:07:59.769717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:59.770213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:59.770715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:59.771445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:07:59.771909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:07:59.772339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:07:59.911710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:07:59.921335 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-617a9949-97c4-4686-b9b2-e4bf9d9b2f62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.163866 Aug 30 19:07:59.921913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3464/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:07:59 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:00.946587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:00.947382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:00.955559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:00.956060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:00.956511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:00.957319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:00.958153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:00.958628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:01.109394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:01.119216 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55ddd617-cff5-422c-88a4-8d3755f51fbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.178637 Aug 30 19:08:01.119922 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3318/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:00 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:02.150949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:02.151564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:02.161736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:02.162385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:02.162946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:02.163972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:02.164605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:02.165126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:02.318376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:02.327171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-452e089d-7d14-4d59-9b2f-384769e64c2c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.182418 Aug 30 19:08:02.327804 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3465/6783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:02 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:03.353555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:03.354157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:03.361966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:03.362501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:03.362958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:03.363685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:03.364139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:03.364604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:03.518293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:03.529003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d6d872e-d990-4959-b2da-f59ac6cf663f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.179478 Aug 30 19:08:03.529597 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3319/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:03 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:04.552422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:04.553118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:04.569199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:04.569757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:04.570561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:04.572257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:04.572778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:04.577275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:04.722301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:04.730855 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d2210ba-2e70-4db4-9802-04b669408798 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1685 microversion: 2.1 time: 0.182872 Aug 30 19:08:04.731474 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3466/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:04 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:05.752770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:05.753628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:05.761092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:05.761574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:05.762018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:05.762954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:05.763447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:05.763888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:05.829631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "name": "network-vif-unplugged", "status": "completed", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:05.839587 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:05.840067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:05.840528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:05.853062 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Creating event network-vif-unplugged:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h1-854119-10 Aug 30 19:08:05.859414 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:08:05.871563 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4e862b87-5419-4cad-b374-d606f2007a89 req-74f0114b-4c37-4a24-9ad5-0cc6e0bce784 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102882 Aug 30 19:08:05.872484 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3467/6786] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:06.325921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:06.334463 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-989e289e-5ffc-4981-947c-1307da717000 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1684 microversion: 2.1 time: 0.585611 Aug 30 19:08:06.335061 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3320/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:05 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1684 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:07.358471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:07.359199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:07.366234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:07.366751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:07.367186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:07.367884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:07.368338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:07.368760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:07.518643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:07.530571 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-826a5fbd-42dc-428e-85d5-90824ae8c257 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1682 microversion: 2.1 time: 0.177359 Aug 30 19:08:07.531427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3468/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:07 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:07.907654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:07.917993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:07.918554 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:07.918981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:07.934152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Creating event network-changed:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h1-854119-10 Aug 30 19:08:07.941202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:08:07.953536 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-be88dde8-1690-4c7a-af51-f4baebaf1cfb req-b633da4b-d677-4f46-9680-3b75822fff08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050836 Aug 30 19:08:07.954187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3321/6789] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:08.557486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:08.558753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:08.567336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.568425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.569331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:08.570300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.571010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.571549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:08.717419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:08.725527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f884983e-f475-41a2-99c4-15a9ea060086 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1679 microversion: 2.1 time: 0.172152 Aug 30 19:08:08.726194 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3469/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:08 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:08.752742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:08.753378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:08.761250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.761760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.762208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:08.762955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.763638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.764079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:08.805465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:08:08.831780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c2379e30-11e3-4f3f-8979-d7152fc8a57b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/action" status: 204 len: 0 microversion: 2.1 time: 0.083319 Aug 30 19:08:08.832870 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3322/6791] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:08:08 2022] POST /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:08:08.841547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:08.842160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:08.860413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.861376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.861820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:08.862578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:08.863149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:08.863593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:09.086638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:09.090399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=100 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:08:09.096284 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5efac5e5-d76d-458e-9af0-0ebcd5bbf2b0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1679 microversion: 2.1 time: 0.258989 Aug 30 19:08:09.096948 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3470/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:08 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1679 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:08:10.122117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:10.122723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:10.125661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=35 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:08:10.132516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:10.133019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:10.133470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:10.134189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:10.134693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:10.135136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:10.300379 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:10.309274 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1f791c19-ddca-44a5-8fc0-dabb6209c06a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1679 microversion: 2.1 time: 0.193700 Aug 30 19:08:10.309926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3323/6793] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:10 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:11.333209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:11.333838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:11.337269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=35 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:08:11.343892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.344542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.345138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.346233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.346848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.347398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.501415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:11.510077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a35bcba4-1c1e-4d92-9ac5-c06d69233bdc tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.183085 Aug 30 19:08:11.510703 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3471/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:11 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:11.534083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:11.534803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:11.545430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.546107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.546698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.547708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.548346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.548784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.687982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:11.696001 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71f804ce-65e6-4309-bde8-85838c73b60e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.168087 Aug 30 19:08:11.696566 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3324/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:11 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:11.717059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:11.717668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:11.726148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.726850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.727473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.728253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.728851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.729499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.890060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:11.898194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53b76e9b-9a6b-4e65-9ae0-65b4312fa754 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1671 microversion: 2.1 time: 0.185331 Aug 30 19:08:11.898807 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3472/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:11 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:11.920319 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:11.920833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:11.927586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.928091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.928541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.929257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:11.929785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:11.930232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:11.955753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:08:12.041579 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b778a2ca-353f-4f3f-89cb-375f7874382b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 204 len: 0 microversion: 2.1 time: 0.126223 Aug 30 19:08:12.042499 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3325/6797] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:08:11 2022] DELETE /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:08:12.051410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:12.052027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:12.058242 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:12.058767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:12.059208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:12.059916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:12.060369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:12.060800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:12.200407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:12.208693 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23486793-837c-405c-ad40-c55978454033 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1677 microversion: 2.1 time: 0.161563 Aug 30 19:08:12.209280 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3473/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:12 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:12.546304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "name": "network-vif-plugged", "status": "completed", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:12.560422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:12.560924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:12.561357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:12.575261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] Creating event network-vif-plugged:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h1-854119-10 Aug 30 19:08:12.579935 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a2437aa4-a8b7-4ee7-a3fb-2a6a857c2485 req-9d6ea186-3a5f-438a-b1f1-9eacb630cd0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092240 Aug 30 19:08:12.580529 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3326/6799] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:13.230607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:13.231366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:13.242873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:13.243364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:13.243847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:13.244550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:13.245013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:13.245431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:13.402049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:13.413576 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c73860a-d806-4fdf-8be7-7fb75cd6065e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1677 microversion: 2.1 time: 0.187318 Aug 30 19:08:13.414338 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3474/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:13 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:14.348250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0298a55-8ec6-4400-b1ae-40234ba8c98a", "name": "network-vif-deleted", "tag": "57b4f2ef-601e-4e97-a729-0bd002f58079"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:14.373544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:14.375352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:14.375827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:14.393298 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] Creating event network-vif-deleted:57b4f2ef-601e-4e97-a729-0bd002f58079 for instance a0298a55-8ec6-4400-b1ae-40234ba8c98a on n-h1-854119-10 Aug 30 19:08:14.398219 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-489a6ef9-dc52-43f5-a920-1befcd09a925 req-9a96f991-16dc-4de3-884b-9118379e942f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055803 Aug 30 19:08:14.399031 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3327/6801] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:14.436578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:14.437295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:14.450309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:14.450827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:14.451375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:14.452064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:14.452671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:14.453247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:14.489833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:14.490305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:14.490917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:14.491393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lazy-loading 'fault' on Instance uuid a0298a55-8ec6-4400-b1ae-40234ba8c98a {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:08:14.541987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:14.552194 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-edd2e4a3-6dc5-4adb-a2b3-24ac5bd375db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 200 len: 1329 microversion: 2.1 time: 0.119671 Aug 30 19:08:14.553077 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3475/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:14 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 1329 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:08:15.576913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:15.577656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:15.584746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:15.585245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:15.585700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:15.586436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:15.586909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:15.587352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:15.602260 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a HTTP/1.1 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'a0298a55-8ec6-4400-b1ae-40234ba8c98a'} Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:08:15.604336 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-161d771e-4c04-4fe0-8dd8-86d5c711a452 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 404 len: 111 microversion: 2.1 time: 0.034099 Aug 30 19:08:15.611641 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3328/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:15 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:08:15.619430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:15.620075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:15.627740 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:15.628442 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:15.628881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:15.629592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:15.630047 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:15.630553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:15.644940 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a HTTP/1.1 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a0298a55-8ec6-4400-b1ae-40234ba8c98a'} Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:08:15.646674 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c279ee0-0d81-4cfa-82d4-bfdbdc3bfe52 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 404 len: 111 microversion: 2.1 time: 0.032767 Aug 30 19:08:15.650535 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3476/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:15 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:08:15.709823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2005815886", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "43a2ca0e-9cfc-469a-9b83-47e3e3c026bf"}], "security_groups": [{"name": "tempest-securitygroup--1383404970"}], "key_name": "tempest-keypair-1376688378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:15.826452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] validate_networks() for [('43a2ca0e-9cfc-469a-9b83-47e3e3c026bf', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:08:16.229859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:08:16.230364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:08:16.230947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:08:16.231350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:08:16.231768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:08:16.247425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:16.247925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:16.248376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:16.249122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:16.249591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:16.250026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:16.270782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:08:16.276501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:08:16.291504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:08:16.294135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:08:16.347908 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d2435c4-9a7c-4770-9e36-f587a2d3bff6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.642068 Aug 30 19:08:16.348583 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3329/6805] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:08:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:08:16.360012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2424cc7d-f8bc-4021-940f-c39f020ae627 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:16.360638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2424cc7d-f8bc-4021-940f-c39f020ae627 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:16.416320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2424cc7d-f8bc-4021-940f-c39f020ae627 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:16.426856 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2424cc7d-f8bc-4021-940f-c39f020ae627 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1239 microversion: 2.1 time: 0.070713 Aug 30 19:08:16.427556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3477/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:16 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:17.450162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:17.450831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:17.458511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:17.459060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:17.459601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:17.460501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:17.461167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:17.461606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:17.543913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:17.552574 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-050e4dc2-b58d-4a24-8141-3e4ef8bd751e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1309 microversion: 2.1 time: 0.107677 Aug 30 19:08:17.553168 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3330/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:17 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:18.575173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:18.575819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:18.586725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:18.587220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:18.587669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:18.588388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:18.588855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:18.589295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:18.728330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:18.736428 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a6d92d10-458e-424f-83c4-652ac6093351 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.166084 Aug 30 19:08:18.737020 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3478/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:18 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:18.788364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:18.802492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:18.802990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:18.803429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:18.816548 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] Creating event network-changed:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h1-854119-10 Aug 30 19:08:18.822025 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-593fb743-9780-4eca-874a-afe2af9cb079 req-e8a5b081-ef8e-47a7-96b9-f65a9f2b7da7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039702 Aug 30 19:08:18.822663 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3331/6809] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:19.759424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:19.760339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:19.767835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:19.768320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:19.768792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:19.769450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:19.769949 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:19.770310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:19.912230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:19.920891 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-375b0ad8-75b5-4a45-847a-e77164abcd0f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.165804 Aug 30 19:08:19.921696 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3479/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:19 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:20.945086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:20.945799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:20.952694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:20.953203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:20.953653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:20.954385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:20.954861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:20.955332 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:21.097640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:21.106298 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a352b934-bba9-4c97-8857-23b924fd4dac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.166478 Aug 30 19:08:21.106916 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3332/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:20 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:22.129799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:22.130668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:22.148614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:22.150045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:22.150700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:22.151843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:22.152583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:22.153100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:22.305542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:22.314645 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f7042b22-2e22-4573-8590-159333555c93 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.190642 Aug 30 19:08:22.315239 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3480/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:22 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:23.336729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:23.337330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:23.344750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:23.345262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:23.345675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:23.346445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:23.346905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:23.347336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:23.489395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:23.499716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9efc8772-0059-4cf8-95eb-b7c30a959612 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.166937 Aug 30 19:08:23.500285 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3333/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:23 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:24.521609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "name": "network-vif-plugged", "status": "completed", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:24.531339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:24.532250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:24.534967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:24.536366 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:24.536884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:24.539830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:24.541182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:24.541873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:24.542719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:24.543691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:24.543691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:24.550378 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] Creating event network-vif-plugged:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h1-854119-10 Aug 30 19:08:24.556094 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c7acfe37-1bda-4e28-8693-5f790fa9eb34 req-560ba3a9-44b6-4a4d-9fb1-0b101df3a06a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038363 Aug 30 19:08:24.557324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3481/6814] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:24.738766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:24.747250 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab4732c3-dc22-4f5e-b44b-aff0d99fa500 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1365 microversion: 2.1 time: 0.221711 Aug 30 19:08:24.747822 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3334/6815] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:24 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:25.771480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:25.773091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:25.782285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:25.784325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:25.785142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:25.786220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:25.786711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:25.787141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:25.935219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:08:25.943702 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e226ffa2-973c-4abd-8431-89b19898d4be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1551 microversion: 2.1 time: 0.178396 Aug 30 19:08:25.944279 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3482/6816] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:08:25 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:08:25.969286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:08:25.970148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:08:25.977984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:25.978591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:25.979028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:25.979767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:25.980484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:25.981019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:26.071758 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46bf3e5a-c05c-4555-9543-99097faa11b1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108795 Aug 30 19:08:26.072519 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3335/6817] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 19:08:25 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:08:27.100368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:08:27.174503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:08:27.185334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:08:27.185821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:08:27.186259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:08:27.203293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] Creating event network-changed:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h1-854119-10 Aug 30 19:08:27.208667 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-80644276-fa7d-4e94-8ed6-3a13a8dc3f59 req-0dc471a5-dc71-4bf6-a386-3c37fde45d84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108899 Aug 30 19:08:27.209293 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3483/6818] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:02.051028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.051817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.053805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.054633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=65,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.059755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:02.069033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:02.069577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:02.070065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:02.096354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Going to try to stop instance {{(pid=122590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 19:09:02.145718 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f81f02be-abc3-4967-b847-ded60a4a95dd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action" status: 202 len: 0 microversion: 2.1 time: 0.095019 Aug 30 19:09:02.146286 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3336/6819] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:09:02 2022] POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:09:02.154849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.156454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=62 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:02.162673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:02.163845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:02.173030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:02.173526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:02.174292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:02.175056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:02.175517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:02.175946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:02.325155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:02.334066 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ca6d2937-8e0d-4029-b89c-ebfe73268adf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.182040 Aug 30 19:09:02.334550 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3484/6820] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:02 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:09:03.356550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:03.357263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:03.364436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:03.364935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:03.365385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:03.366131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:03.366629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:03.367067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:03.524673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:03.534217 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7b98089-e37e-40e2-89b3-2a1f28dfd0e1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.182570 Aug 30 19:09:03.534920 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3337/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:03 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:04.556489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:04.557099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:04.568330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:04.568829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:04.569265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:04.569989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:04.570481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:04.570997 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:04.708429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:04.716943 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-946550b6-4641-4255-8369-c5210205b181 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.164508 Aug 30 19:09:04.717573 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3485/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:04 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:05.738513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:05.739149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:05.749489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:05.750098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:05.750527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:05.751205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:05.751677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:05.752119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:05.896817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:05.905190 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05b8f5b6-0be2-4d28-948e-4c4b5fc2d80f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.170781 Aug 30 19:09:05.905766 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3338/6823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:05 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:06.928535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:06.929131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:06.937100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:06.937633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:06.938079 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:06.938842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:06.939305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:06.939840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:07.093964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:07.102294 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1e18c3a8-3a74-4b6a-81e8-62630489dfd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.178112 Aug 30 19:09:07.102907 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3486/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:06 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:09:08.124985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:08.125841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:08.136601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:08.137109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:08.137563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:08.138302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:08.138807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:08.139250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:08.291467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:08.300134 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4d3d2ca8-7dba-4be2-8755-6700519858a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.179534 Aug 30 19:09:08.300716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3339/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:08 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:09.322264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:09.322907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:09.330569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:09.331052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:09.331483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:09.332189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:09.332641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:09.333059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:09.502108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:09.510050 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-774084f9-7c66-4909-ac43-d1dd05ea46d3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.191844 Aug 30 19:09:09.510676 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3487/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:09 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:10.532080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:10.532836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:10.540049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:10.540540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:10.540982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:10.541779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:10.542241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:10.542703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:10.686068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:10.696685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-35df574d-352e-43f9-b9a7-342cf299d4a1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.168257 Aug 30 19:09:10.697832 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3340/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:10 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:11.724642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:11.725243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:11.732028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:11.732528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:11.732973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:11.733685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:11.734128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:11.734597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:11.877689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:11.885811 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dc9d7732-25ff-4704-8e12-468d1621c4ca tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.165341 Aug 30 19:09:11.886389 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3488/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:11 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:12.907646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:12.908241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:12.915067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:12.915560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:12.916003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:12.916774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:12.917234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:12.917667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:13.057100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:13.065477 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7c2645fa-5a85-4c17-a1c2-500ca7cb56cb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.162001 Aug 30 19:09:13.066084 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3341/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:12 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:14.087784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:14.088429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:14.096266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:14.096783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:14.097233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:14.097942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:14.098398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:14.098860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:14.235730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:14.244080 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d41fdf68-e09e-49d6-99f9-4747b3bd1dbf tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.160395 Aug 30 19:09:14.245082 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3489/6830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:14 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:15.265553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:15.266166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:15.273545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:15.274035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:15.274477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:15.275195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:15.275717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:15.276149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:15.425545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:15.434044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-981e34a3-99f8-4334-8529-064d74bd3336 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.172415 Aug 30 19:09:15.434673 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3342/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:15 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:16.459196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:16.459844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:16.470063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:16.470731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:16.471255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:16.472222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:16.472812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:16.473250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:16.637931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:16.652308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5a48f332-5bdd-41d8-8590-039ed9450444 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.197609 Aug 30 19:09:16.653081 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3490/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:16 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:17.677677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:17.678402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:17.686826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:17.687330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:17.687786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:17.688501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:17.688976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:17.689420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:17.843252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:17.854836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aaa1f178-6dc7-47a0-a4d9-9e235aeb5535 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1657 microversion: 2.1 time: 0.182423 Aug 30 19:09:17.855418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3343/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:17 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1657 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:17.883991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:17.886686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:17.894005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:17.894525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:17.894973 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:17.895682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:17.896179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:17.896609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:17.930786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:17.937478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:09:17.944612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:09:17.945049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:09:17.945528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:09:17.945943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:09:17.946377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:09:18.020081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-38659860-516c-4ae3-a74b-24616a105883 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action" status: 202 len: 0 microversion: 2.1 time: 0.142360 Aug 30 19:09:18.020716 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3491/6834] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:09:17 2022] POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:09:18.029322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:18.029997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:18.036124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:18.036628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:18.037061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:18.037804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:18.038769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:18.038769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:18.175629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:18.188059 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6b9264c-92c2-4d4c-8d39-aac6f8102d3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.162474 Aug 30 19:09:18.188716 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3344/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:18 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:19.216394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:19.216955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:19.222986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:19.223479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:19.223901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:19.224811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:19.225567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:19.225725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:19.366207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:19.374896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4e9984d-4efd-4759-bb9d-727cf97a6909 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1680 microversion: 2.1 time: 0.165382 Aug 30 19:09:19.375473 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3492/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:19 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:20.396236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:20.396854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:20.405020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:20.405523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:20.405973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:20.406726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:20.407193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:20.407660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:20.557271 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:09:20.557534 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 (ip 10.222.0.25) !!! Aug 30 19:09:20.562235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:20.572155 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a602c03-c135-4e23-baf8-b1acf0c6a4aa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1685 microversion: 2.1 time: 0.179734 Aug 30 19:09:20.572931 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3345/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:20 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:21.594287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:21.594923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:21.602464 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:21.602966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:21.603415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:21.604155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:21.604618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:21.605053 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:21.750691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:21.761816 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4fbdb0f-1436-48cc-b2d6-f7b999634ce8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1685 microversion: 2.1 time: 0.171516 Aug 30 19:09:21.762400 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3493/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:21 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:22.719653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "name": "network-vif-unplugged", "status": "completed", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:22.731004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:22.731522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:22.732047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:22.744834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Creating event network-vif-unplugged:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h2-854119-10 Aug 30 19:09:22.751071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:09:22.763730 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d6625a44-5246-45d2-897a-d5d85466f65e req-9cbde977-3688-4728-a4ee-9b22dc359335 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048105 Aug 30 19:09:22.764794 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3346/6839] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:22.782650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:22.783273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:22.790238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:22.790773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:22.791236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:22.792002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:22.792454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:22.792885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:23.062713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:23.070962 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3a57538f-0620-45ef-a39a-81c5150e32c9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1684 microversion: 2.1 time: 0.292224 Aug 30 19:09:23.071677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3494/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:22 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1684 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:24.092661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:24.093348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:24.101553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:24.102047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:24.102526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:24.103235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:24.103793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:24.104236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:24.247549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:24.255777 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f2ceef2-0c81-4d70-8c3a-46b1f6058da3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1684 microversion: 2.1 time: 0.167394 Aug 30 19:09:24.256811 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3347/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:24 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:09:24.792110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:24.797135 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:09:24.797279 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 19:09:24.809279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:24.809767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:24.810174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:24.822380 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Creating event network-changed:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h2-854119-10 Aug 30 19:09:24.827948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:09:24.839274 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-2925d0fe-0766-4fa2-b4a7-2e116aecf96e req-e2c620da-6030-4062-a7aa-a6359ecdc50d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051070 Aug 30 19:09:24.839862 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3495/6842] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:09:25.277916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:25.278665 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:25.286793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:25.287318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:25.287759 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:25.288755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:25.289066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:25.289422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:25.488967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:25.497754 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1ca8a212-c2df-4d0f-b29a-3f9ae2841b88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1682 microversion: 2.1 time: 0.224061 Aug 30 19:09:25.498468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3348/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:25 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:26.521998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:26.522751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:26.529806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.530259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.530792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.531674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.532112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.532734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.670630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:26.679230 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7dd9e4c3-804b-42c8-9eea-845cdf931fd5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1678 microversion: 2.1 time: 0.162256 Aug 30 19:09:26.679628 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3496/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:26 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:09:26.702051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:26.702684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:26.710292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.710818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.711293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.712042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.712512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.713841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.779366 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c542927f-e383-4742-9fe0-da60c326dff5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action" status: 204 len: 0 microversion: 2.1 time: 0.082077 Aug 30 19:09:26.780023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3349/6845] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:09:26 2022] POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 19:09:26.788502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:26.789119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:26.795466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.796054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.796496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.797205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:26.797900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:26.798310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:26.949599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:26.957676 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad14f530-9abe-49c4-8de4-51b17d737ea1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1678 microversion: 2.1 time: 0.173098 Aug 30 19:09:26.958307 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3497/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:26 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:27.982026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:27.982684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:27.990442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:27.990969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:27.991417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:27.992130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:27.992601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:27.993039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:28.132313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:28.135345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:28.142547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a8b09e6-3a86-4ae7-94c6-5084e9421477 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1678 microversion: 2.1 time: 0.165761 Aug 30 19:09:28.143128 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3350/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:27 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:29.164895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:29.165463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:29.173279 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.174103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.174581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.175274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.175732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.176182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.313836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:29.322644 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60213bec-d2d4-4050-a6d6-2294c17d0b73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1657 microversion: 2.1 time: 0.161437 Aug 30 19:09:29.323809 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3498/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:29 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1657 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:29.343743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "name": "network-vif-plugged", "status": "completed", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:29.349865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:29.350758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:29.358695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.359450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.360055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.360933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.361540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.362127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.362742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.363629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.364322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.377951 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] Creating event network-vif-plugged:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h2-854119-10 Aug 30 19:09:29.383183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:29.384774 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-252816d5-8934-4eac-86be-8119b63f24c2 req-a9b7dc4c-8436-4326-b4be-a08ad32f6ac4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047765 Aug 30 19:09:29.386312 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3351/6849] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:29.510197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:29.521745 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9c3f237-676d-4048-98db-5cc15b5aff3a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1657 microversion: 2.1 time: 0.176939 Aug 30 19:09:29.522636 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3499/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:29 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1657 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:29.543945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:29.550773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.551264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.551725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.575416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Going to try to start instance {{(pid=122590) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 19:09:29.632261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c84f7a95-fed2-467c-8545-59c158fc18e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action" status: 202 len: 0 microversion: 2.1 time: 0.092775 Aug 30 19:09:29.633251 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3352/6851] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:09:29 2022] POST /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:09:29.646373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:29.647209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:29.654874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.655399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.655820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.656597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:29.657160 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:29.657730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:29.894994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:29.903232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-26ab69ec-04f6-4145-a33e-c2738ee551a9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1666 microversion: 2.1 time: 0.263230 Aug 30 19:09:29.903804 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3500/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:29 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1666 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:30.927246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:30.927952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:30.934752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:30.935250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:30.935689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:30.936391 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:30.936851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:30.937285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:31.081940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:31.090833 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0426f4b7-2565-497c-8ce4-5e714d086090 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1670 microversion: 2.1 time: 0.169130 Aug 30 19:09:31.091418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3353/6853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:30 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:31.112309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:31.112829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:31.120116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:31.120611 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:31.121043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:31.121732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:31.122183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:31.122702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:31.148380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:09:31.230986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ea488a04-a7d1-4449-99ef-92040a9a2927 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 204 len: 0 microversion: 2.1 time: 0.122256 Aug 30 19:09:31.231611 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3501/6854] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:09:31 2022] DELETE /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:09:31.240307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:31.240930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:31.247270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:31.247762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:31.248204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:31.248904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:31.249360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:31.249796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:31.393850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:31.401970 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-901525d7-53a7-4abc-8b7f-9f14edfbef9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1676 microversion: 2.1 time: 0.165643 Aug 30 19:09:31.402578 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3354/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:31 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:32.427074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:32.427797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:32.430613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:32.437849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:32.438437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:32.438911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:32.439638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:32.440087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:32.440515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:32.583933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:32.593521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4161ba05-dd22-4465-b098-f35d65621d36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1676 microversion: 2.1 time: 0.171201 Aug 30 19:09:32.594111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3502/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:32 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:33.615715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:33.616668 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:33.623445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=39 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:33.625361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:33.626090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:33.626884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:33.627871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:33.628414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:33.628934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:33.707441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:33.716210 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0a5af7ad-5a8a-446e-9043-724867d634ad tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 200 len: 1608 microversion: 2.1 time: 0.104459 Aug 30 19:09:33.716793 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3355/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:33 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 1608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:33.806786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec52d89-eaf7-49af-99b8-c6adf0438560", "name": "network-vif-deleted", "tag": "db804b64-bbc5-4f50-a7d2-9a771d2c0f51"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:33.816883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:33.817753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:33.818424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:33.831732 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] Creating event network-vif-deleted:db804b64-bbc5-4f50-a7d2-9a771d2c0f51 for instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 on n-h2-854119-10 Aug 30 19:09:33.839009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-caee06c9-9700-4c14-9cda-a238a95498f2 req-57de77d7-7a59-47a5-811b-44e737fcb51e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088816 Aug 30 19:09:33.839780 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3503/6858] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:34.739086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:34.739713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:34.747215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:34.747725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:34.748175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:34.749094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:34.749341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:34.749782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:34.763609 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 HTTP/1.1 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3ec52d89-eaf7-49af-99b8-c6adf0438560'} Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:09:34.765369 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7fe8b1ba-c466-4bae-8a70-ce3bf250d144 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 404 len: 111 microversion: 2.1 time: 0.031661 Aug 30 19:09:34.770122 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3356/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:34 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:09:34.785203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:34.785915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:34.792858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:34.793353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:34.793805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:34.794553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:34.795015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:34.795459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:34.812959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 HTTP/1.1 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '3ec52d89-eaf7-49af-99b8-c6adf0438560'} Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:09:34.814582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af8b6aeb-f5a9-46a1-9d92-24bec6ea91ac tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 404 len: 111 microversion: 2.1 time: 0.036189 Aug 30 19:09:34.818719 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3504/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:34 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:09:34.876017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-150497964", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "43a2ca0e-9cfc-469a-9b83-47e3e3c026bf"}], "security_groups": [{"name": "tempest-securitygroup--1383404970"}], "key_name": "tempest-keypair-1376688378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:34.996033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] validate_networks() for [('43a2ca0e-9cfc-469a-9b83-47e3e3c026bf', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:09:35.471816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:09:35.472423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:09:35.473170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:09:35.473836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:09:35.474573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:09:35.488663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:35.489388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:35.490021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:35.491236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:35.491928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:35.492597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:35.510991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:09:35.516506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:09:35.530689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:09:35.533242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:09:35.585653 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75112238-54d0-43b1-886b-2bcea41b06fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713493 Aug 30 19:09:35.586274 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3357/6861] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:09:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:09:35.598580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-359806b1-9bf2-4126-83a2-2bc0d8112b05 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:35.599605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-359806b1-9bf2-4126-83a2-2bc0d8112b05 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:35.660031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-359806b1-9bf2-4126-83a2-2bc0d8112b05 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:35.668431 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-359806b1-9bf2-4126-83a2-2bc0d8112b05 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1238 microversion: 2.1 time: 0.074243 Aug 30 19:09:35.669009 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3505/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:35 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:36.692252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:36.693259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:36.702331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:36.702862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:36.703524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:36.704457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:36.705186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:36.705731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:36.781786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:36.790310 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9013f33e-e9d4-40bc-a096-14128402a1db tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1308 microversion: 2.1 time: 0.102870 Aug 30 19:09:36.791674 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3358/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:36 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:37.813058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:37.814374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:37.823523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:37.824274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:37.824710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:37.825589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:37.826202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:37.826672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:37.969359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:37.977767 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00aee93c-7d77-4d3f-b29e-27e7a6cc25a8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.168765 Aug 30 19:09:37.978428 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3506/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:37 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:38.371702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:38.391123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:38.391619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:38.392145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:38.407060 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] Creating event network-changed:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:09:38.412584 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-39011c20-a980-475c-8792-585b7e6ee4ff req-f81bad7f-4b64-439c-9b3a-10b292f85101 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045911 Aug 30 19:09:38.413194 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3359/6865] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:38.999978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:39.000626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:39.007884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:39.008373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:39.008847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:39.009617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:39.010074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:39.010543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:39.155257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:39.166277 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6666911b-a809-49ea-b36f-5f6caa273aff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.170295 Aug 30 19:09:39.166904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3507/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:38 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:40.189994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:40.190654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:40.197619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:40.198161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:40.198646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:40.199358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:40.199822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:40.200261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:40.344930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:40.355632 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0ff6b6f-9891-46b8-be2a-67b439551355 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.170931 Aug 30 19:09:40.356198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3360/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:40 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:41.378214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:41.378826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:41.386183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:41.386705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:41.387145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:41.387854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:41.388316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:41.388774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:41.534748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:41.546425 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-92305f4a-63f0-4177-99d6-af4ea6b0cc73 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.172002 Aug 30 19:09:41.547107 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3508/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:41 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:42.569953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:42.570694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:42.578632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:42.579136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:42.579585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:42.580301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:42.580768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:42.581210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:42.721849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:42.730897 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-12464d76-8238-49cf-8a2b-af9ee9880e97 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.165331 Aug 30 19:09:42.731492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3361/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:42 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:43.753266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:43.754031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:43.761775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:43.762377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:43.762892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:43.763700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:43.764221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:43.764690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:43.906943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:43.917023 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dec0352e-153e-4971-9013-a41744972010 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.167714 Aug 30 19:09:43.917847 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3509/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:43 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:44.847583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "name": "network-vif-plugged", "status": "completed", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:44.861359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:44.861857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:44.862300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:44.875600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] Creating event network-vif-plugged:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:09:44.881332 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-04b40c33-0c5d-4fdd-a8de-819eeb16966b req-3e39fdce-d760-4759-841f-1f01e129cb5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037420 Aug 30 19:09:44.882148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3362/6871] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:44.939537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:44.940062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:44.947902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:44.948506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:44.948929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:44.949660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:44.950125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:44.950619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:45.091485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:45.103854 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-50c891b8-a015-4118-ada2-2a2d80076ba3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1364 microversion: 2.1 time: 0.168423 Aug 30 19:09:45.104673 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3510/6872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:44 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:46.126125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:46.126935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:46.128995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:46.129729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:46.136489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:46.137006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:46.137461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:46.138202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:46.138694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:46.139130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:46.281491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:09:46.293737 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-66a6fd93-eca6-4d4c-8fd1-425ade7507b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1550 microversion: 2.1 time: 0.171622 Aug 30 19:09:46.294711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3363/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:09:46 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:09:46.322280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:09:46.323073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:09:46.324751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:09:46.331026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:46.331543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:46.331939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:46.332636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:46.333081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:46.333502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:46.414280 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f320c283-a771-4de1-9ba3-920cc6d50206 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098251 Aug 30 19:09:46.414993 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3511/6874] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 19:09:46 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:09:47.487492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:09:47.498282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:09:47.498812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:09:47.499237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:09:47.511747 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] Creating event network-changed:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:09:47.516629 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fe4a2578-4988-49a5-b141-e1c6cc35975e req-f2672f1f-ee26-4baf-89b3-01ee540055b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032885 Aug 30 19:09:47.517527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3364/6875] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:20.595513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=21 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:20.596336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:20.601081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:20.603838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:20.611639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:20.612135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:20.612590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:20.613311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:20.613764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:20.614204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:20.663485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:20.671148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:10:20.678661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:10:20.679008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:10:20.679483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:10:20.679923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:10:20.680337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:10:20.753127 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21fc2288-fa18-4d8d-85d9-86a8974f5e96 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/action" status: 202 len: 0 microversion: 2.1 time: 0.159540 Aug 30 19:10:20.753747 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3512/6876] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:10:20 2022] POST /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:10:20.761253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:20.762656 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:20.767875 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:20.768647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:20.776569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:20.777305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:20.777750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:20.778699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:20.779248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:20.779870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:20.925446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:20.934261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fbc78c42-e469-42ee-9a2f-691c0a02e58c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1678 microversion: 2.1 time: 0.175589 Aug 30 19:10:20.935144 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3365/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:20 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:21.958489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:21.959120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:21.965389 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:21.965870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:21.966275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:21.967021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:21.967471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:21.967886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:22.110865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:22.119481 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-df545b5e-c424-4fad-8080-7ecbfe5374ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1678 microversion: 2.1 time: 0.166243 Aug 30 19:10:22.120142 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3513/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:21 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:23.151193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:23.151844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:23.159936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:23.160448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:23.160939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:23.161655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:23.162153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:23.162582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:23.299677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:23.308039 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b159cf1b-6b6d-49de-bbf3-9cb65cc2a882 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.162894 Aug 30 19:10:23.308625 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3366/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:23 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:24.330891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:24.331497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:24.338999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:24.339494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:24.339934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:24.340639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:24.341151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:24.341540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:24.483599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:24.491633 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad40398d-be37-47b0-a1ed-fef8aa1f92e3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.164726 Aug 30 19:10:24.492236 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3514/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:24 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:10:25.513742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:25.514294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:25.521644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:25.522135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:25.522612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:25.523316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:25.523774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:25.524204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:25.667641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:25.679789 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-acf731b4-9bec-4cc7-9b01-2aff914c0523 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.169842 Aug 30 19:10:25.680475 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3367/6881] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:25 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:26.701847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:26.702430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:26.710168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:26.710704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:26.711158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:26.711863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:26.712456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:26.712880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:26.850674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:26.859956 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d2100d92-dec3-4510-9c0d-08564ee44559 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.162012 Aug 30 19:10:26.870444 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3515/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:26 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:27.882038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:27.882754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:27.890484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:27.890978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:27.891421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:27.892129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:27.892618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:27.893020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:28.030004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:28.038406 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5be647f-ad62-41f1-a041-ca9db5936a10 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.160368 Aug 30 19:10:28.038989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3368/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:27 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:29.061265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:29.061991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:29.069510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:29.070001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:29.070468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:29.071171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:29.071631 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:29.072055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:29.217757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:29.225850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f672b182-b111-4a04-a83c-68c1ed90a5be tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.168728 Aug 30 19:10:29.226454 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3516/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:29 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:30.248112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:30.248712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:30.256136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:30.256609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:30.257051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:30.257750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:30.258207 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:30.258670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:30.401689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:30.410760 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a2f643c-f870-40e6-bcfb-127ebd81769a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.166698 Aug 30 19:10:30.411341 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3369/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:30 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:31.434253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:31.436042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:31.443161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:31.443717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:31.444168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:31.444889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:31.445352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:31.445897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:31.601027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:31.609570 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f862b91d-090a-4ed0-921d-3b413ba2a190 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.179677 Aug 30 19:10:31.610154 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3517/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:31 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:32.636079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:32.636674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:32.644717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:32.645221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:32.645643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:32.646386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:32.646884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:32.647323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:32.788273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:32.796698 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1fc21e18-9a78-46b4-ad72-dfc026db40b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.164777 Aug 30 19:10:32.797369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3370/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:32 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:33.819146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:33.819753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:33.827216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:33.827699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:33.828130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:33.828823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:33.829269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:33.829689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:33.980391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:33.988737 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2b348979-d8ea-478c-b199-8ced1ca14b75 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.173535 Aug 30 19:10:33.989295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3518/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:33 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:35.010868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:35.011420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:35.018928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:35.019433 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:35.019951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:35.020978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:35.021567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:35.022066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:35.159495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:35.167848 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77cb52a8-1721-4fe5-ab26-e11b6cf81354 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.161190 Aug 30 19:10:35.168399 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3371/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:35 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:36.190729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:36.191326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:36.200154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:36.200718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:36.201159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:36.201881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:36.202386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:36.202884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:36.346512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:36.358071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98ed9af7-2490-41bc-bd78-18b4429ecb11 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.171367 Aug 30 19:10:36.358687 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3519/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:36 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:37.379927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:37.380528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:37.388329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:37.388845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:37.389299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:37.390027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:37.390543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:37.390998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:37.539684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:37.548791 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-70fd5e1c-3bec-45de-8613-def81c6038b9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.172610 Aug 30 19:10:37.549344 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3372/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:37 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:38.570730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:38.571339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:38.579011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:38.579501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:38.579941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:38.580651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:38.581104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:38.581500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:38.732383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:38.741219 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-785984ce-aceb-473c-a176-5a9a2ca16d0a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1683 microversion: 2.1 time: 0.174984 Aug 30 19:10:38.741876 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3520/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:38 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:39.764337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:39.765477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:39.776389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:39.777621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:39.778471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:39.779210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:39.779684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:39.780122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:39.929372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:39.937650 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0722a82f-6dca-4b27-a120-8116b8e87797 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1682 microversion: 2.1 time: 0.178066 Aug 30 19:10:39.938595 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3373/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:39 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:40.237837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "name": "network-vif-unplugged", "status": "completed", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:40.249175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:40.249661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:40.250302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:40.263201 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Creating event network-vif-unplugged:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h2-854119-10 Aug 30 19:10:40.269662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:10:40.282310 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-dcea6494-f823-4bfd-8519-37aae17a8c0f req-43bc4602-fb45-4aa0-9371-a63d651ced0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049580 Aug 30 19:10:40.283416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3521/6894] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:40.959287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:40.960102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:40.967407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:40.967990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:40.968483 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:40.969203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:40.969683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:40.970140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:41.106634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:41.115054 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-db954663-3eea-4615-91dd-5851f99dc34b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1682 microversion: 2.1 time: 0.159635 Aug 30 19:10:41.115643 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3374/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:40 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:42.139232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:42.139937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:42.147433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:42.147919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:42.148367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:42.149074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:42.149528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:42.149954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:42.304541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:42.312975 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5fa8aaf9-cfd0-4882-b5c4-e6ac0fe330a5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1680 microversion: 2.1 time: 0.179348 Aug 30 19:10:42.313532 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3522/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:42 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:42.665625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:42.680220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:42.680880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:42.681480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:42.695475 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Creating event network-changed:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h2-854119-10 Aug 30 19:10:42.701065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:10:42.713056 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-790d891f-d44d-4084-8cfa-60e97a170525 req-0d12191e-90c4-4415-b100-586c04cd7695 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053301 Aug 30 19:10:42.713648 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3375/6897] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:43.335169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:43.335766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:43.343216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.343781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.344110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.344816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.345262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.345678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.559271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:43.567647 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d239884-a7de-4bd6-b3b1-2af6b1ff2cd2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1677 microversion: 2.1 time: 0.236573 Aug 30 19:10:43.568209 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3523/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:43 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:43.589718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:43.590393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:43.597000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.597500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.597915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.598847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.599313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.599742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.642312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.642846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.643307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.644040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.644511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.644948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.666758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:10:43.672481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:10:43.791666 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cece93b9-c376-406d-aa28-147504beab49 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/action" status: 202 len: 0 microversion: 2.1 time: 0.206095 Aug 30 19:10:43.792321 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3376/6899] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:10:43 2022] POST /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:10:43.801177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:43.801806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:43.807886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.808645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.808918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:43.809608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:43.810070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:43.810520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:44.015617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:44.024051 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8a62d3d0-8e46-49af-bd96-22bb04f7e8d8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1676 microversion: 2.1 time: 0.227160 Aug 30 19:10:44.025751 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3524/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:43 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:45.047081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:45.047816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:45.056305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:45.056814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:45.057266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:45.057987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:45.058487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:45.058930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:45.210674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:45.218742 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-335173df-3c70-46b6-9405-dbfbbdbc3416 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1676 microversion: 2.1 time: 0.177121 Aug 30 19:10:45.219335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3377/6901] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:45 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:45.680147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "name": "network-vif-plugged", "status": "completed", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:45.692802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:45.693311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:45.693752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:45.707002 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Creating event network-vif-plugged:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h2-854119-10 Aug 30 19:10:45.712471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:10:45.724889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c4c1fbf9-268e-4f17-9303-524b227c94a9 req-af010916-6d4a-4023-ac00-2c42e8e715c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 Aug 30 19:10:45.725737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3525/6902] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:46.240467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:46.241084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:46.248841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:46.249430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:46.250249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:46.250805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:46.251420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:46.251943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:46.396570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:46.400209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:46.405268 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d5be9a0a-5946-4a7a-8d10-a57a8f2abef0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1676 microversion: 2.1 time: 0.168782 Aug 30 19:10:46.406703 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3378/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:46 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:47.330362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "name": "network-vif-unplugged", "status": "completed", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:47.340870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:47.341555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:47.341984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:47.354431 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Creating event network-vif-unplugged:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:10:47.360237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:10:47.373063 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ad2f55c8-d781-44ce-a7b8-4f5b4c5cc5ff req-a913e035-7cf6-494c-912c-42961b60a187 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047360 Aug 30 19:10:47.373860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3526/6904] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:47.428595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:47.429351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:47.438056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:47.438601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:47.439051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:47.439802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:47.440282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:47.440716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:47.676838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:47.685388 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be979da1-107e-4ed9-b333-17b662e152c3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1676 microversion: 2.1 time: 0.261008 Aug 30 19:10:47.685984 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3379/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:47 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1676 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:48.709129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:48.709683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:48.716430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:48.716915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:48.717341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:48.718039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:48.718518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:48.719024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:48.889156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:48.900146 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e10b11b5-b8aa-41dc-add9-c4e0950df74a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1676 microversion: 2.1 time: 0.196405 Aug 30 19:10:48.900997 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3527/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:48 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:49.412481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:49.426796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:49.427396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:49.428229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:49.443488 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Creating event network-changed:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:10:49.449999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:10:49.461766 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-4ffdeaa3-6ea4-4294-8b25-bec37b736310 req-334a83b2-5b4a-4c7e-b762-4c5eaa1bd37b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052958 Aug 30 19:10:49.462418 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3380/6907] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:10:49.922907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:49.923862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:49.930956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:49.931771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:49.932437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:49.933355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:49.934026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:49.934669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:49.939494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:50.181977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:50.190569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aecc7d3f-999f-4c55-9e36-561544c48e78 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1669 microversion: 2.1 time: 0.271708 Aug 30 19:10:50.191546 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3528/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:49 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:50.212599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:50.213637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:50.220517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.221434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.222083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.223070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.223609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.224062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.455010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:50.464850 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-24ca3651-2600-4ecd-b824-d1d83f2cb110 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1669 microversion: 2.1 time: 0.256741 Aug 30 19:10:50.465446 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3381/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:50 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:50.486203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:50.487074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:50.493582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.494061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.494537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.495256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.495718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.496143 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.636372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:50.644859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-49290bd9-5897-4e46-8cfa-20d281528b43 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1669 microversion: 2.1 time: 0.162909 Aug 30 19:10:50.645556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3529/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:50 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:50.665479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:50.666109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:50.672732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.673645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.674168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.675005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.675614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.676047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.706547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:10:50.797663 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-404de41d-2408-4164-88ae-fae9c2cec99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 204 len: 0 microversion: 2.1 time: 0.135729 Aug 30 19:10:50.798951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3382/6911] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:10:50 2022] DELETE /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:10:50.808465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:50.809077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:50.811002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=41 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:50.816764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.817333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.817767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.818499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:50.818961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:50.819365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:50.961270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:50.969857 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6f375947-73e8-4bc1-9edc-c33b43c47f4f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1675 microversion: 2.1 time: 0.166083 Aug 30 19:10:50.970564 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3530/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:50 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:51.992499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:51.993348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:51.996275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:52.002059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:52.002590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:52.003024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:52.003765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:52.004234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:52.004672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:52.209690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:52.218123 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b0e02879-ce85-4499-b1bc-5c02311d721b tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1675 microversion: 2.1 time: 0.229917 Aug 30 19:10:52.218823 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3383/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:51 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:53.049251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a51ec4-c8f7-48e0-b755-bf892b7a3596", "name": "network-vif-deleted", "tag": "445ff61a-73ff-4129-bab6-cd84f10d0f0b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:53.071722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:53.072191 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:53.072691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:53.086732 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] Creating event network-vif-deleted:445ff61a-73ff-4129-bab6-cd84f10d0f0b for instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 on n-h1-854119-10 Aug 30 19:10:53.092967 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-ee7fbb5a-4714-45d2-9f9c-01e84c804c19 req-b1eb7c04-3651-44ca-bffe-fec1d5942449 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049430 Aug 30 19:10:53.094069 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3531/6914] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:53.240475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:53.241329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:53.248608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:53.249199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:53.249708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:53.250954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:53.251418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:53.251852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:53.284352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:53.284848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:53.285286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:53.285758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lazy-loading 'fault' on Instance uuid 21a51ec4-c8f7-48e0-b755-bf892b7a3596 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:10:53.330832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:53.339128 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d4275a90-1df5-40cd-b36f-194315f85caa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 200 len: 1328 microversion: 2.1 time: 0.102647 Aug 30 19:10:53.339743 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3384/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:53 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:54.364241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:54.364885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:54.373861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:54.374644 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:54.375171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:54.376591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:54.377251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:54.377846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:54.396801 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 HTTP/1.1 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '21a51ec4-c8f7-48e0-b755-bf892b7a3596'} Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:10:54.398537 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3b5c79d4-e0bc-419a-bf14-1cc6ad4f9df6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 404 len: 111 microversion: 2.1 time: 0.042514 Aug 30 19:10:54.402502 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3532/6916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:54 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:10:54.419062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:54.419692 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:54.421603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:10:54.428782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:54.429344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:54.429893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:54.430490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:54.430961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:54.431399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:54.446302 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 HTTP/1.1 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '21a51ec4-c8f7-48e0-b755-bf892b7a3596'} Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:10:54.448083 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1adb756f-c614-487b-a02f-a21a809fa99c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 404 len: 111 microversion: 2.1 time: 0.034427 Aug 30 19:10:54.452507 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3385/6917] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:54 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:10:54.503789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1498656553", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "43a2ca0e-9cfc-469a-9b83-47e3e3c026bf"}], "security_groups": [{"name": "tempest-securitygroup--1383404970"}], "key_name": "tempest-keypair-1376688378", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:54.614136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] validate_networks() for [('43a2ca0e-9cfc-469a-9b83-47e3e3c026bf', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:10:55.119412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:10:55.119846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:10:55.120337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:10:55.120758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:10:55.121304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:10:55.140710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:55.141203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:55.141685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:55.142466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:55.142915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:55.143346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:55.164097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:10:55.170586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:10:55.187407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:10:55.191361 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:10:55.244124 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4b5b4d5-0c42-4316-9dab-c7f264d08a01 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745702 Aug 30 19:10:55.244966 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3533/6918] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:10:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:10:55.257982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-74ce9ae8-7c03-4c6d-adfb-416b30820530 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:55.258539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-74ce9ae8-7c03-4c6d-adfb-416b30820530 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:55.318415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-74ce9ae8-7c03-4c6d-adfb-416b30820530 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:55.326225 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-74ce9ae8-7c03-4c6d-adfb-416b30820530 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1239 microversion: 2.1 time: 0.072549 Aug 30 19:10:55.326933 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3386/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:55 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:56.349189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:56.349877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:56.359620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:56.360120 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:56.360707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:56.361462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:56.361942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:56.362387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:56.426738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:56.434871 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1ebdf81a-9262-4f56-af59-d39eeabd9e88 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1291 microversion: 2.1 time: 0.090877 Aug 30 19:10:56.435620 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3534/6920] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:56 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1291 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:57.458129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:57.458857 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:57.468129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:57.468819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:57.469451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:57.470109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:57.470609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:57.471052 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:57.610477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:57.618830 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5609b937-f0f1-4384-a98e-4f54b551cfeb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.165117 Aug 30 19:10:57.619626 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3387/6921] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:57 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:57.900168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:10:57.914357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:57.914955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:57.915493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:57.929223 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] Creating event network-changed:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:10:57.935678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-9ef733ae-eba6-4b24-86af-edd7b19480de req-ddae2ade-e492-404e-a494-ecaa4b229052 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041824 Aug 30 19:10:57.936903 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3535/6922] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:10:58.641863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:58.642666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:58.650197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:58.650730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:58.651206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:58.651914 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:58.652385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:58.652825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:58.792130 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:10:58.801722 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-71a00386-7306-4cae-8829-bb2810cd2809 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.164117 Aug 30 19:10:58.802369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3388/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:58 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:10:59.828208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:10:59.828789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:10:59.839277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:59.839823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:59.840273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:59.841308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:10:59.841918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:10:59.842511 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:10:59.988353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:00.000241 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7bfe6ab7-d981-42cd-8766-4ef4c6ee9693 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.178976 Aug 30 19:11:00.000999 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3536/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:10:59 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:01.029227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:01.029887 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:01.037987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:01.038513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:01.038954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:01.039657 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:01.040120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:01.040557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:01.196228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:01.204567 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3179bfee-9e14-460d-9ed2-9f1b7cccd0c6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.179141 Aug 30 19:11:01.205469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3389/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:01 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:02.230675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:02.231671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:02.243133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:02.243834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:02.244441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:02.245506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:02.246138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:02.246877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:02.778119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:02.786844 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f3f7d66c-19a6-44a8-8eb5-f953ab3274b2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.562787 Aug 30 19:11:02.787425 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3537/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:02 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:03.768781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-plugged", "status": "completed", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:11:03.780027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:03.780509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:03.780945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:03.792873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] Creating event network-vif-plugged:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:11:03.798540 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-a5fcf9a7-d31f-4551-af0e-daa3d142a8dc req-2b48664c-9667-4b84-a82c-5d3cf11682c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Aug 30 19:11:03.799152 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3390/6927] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:11:03.809445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:03.810156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:03.817679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:03.818333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:03.818881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:03.819753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:03.820435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:03.821056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:04.004476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:04.012797 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5feb3938-b3be-4e88-832e-7548641f82e2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.207491 Aug 30 19:11:04.013615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3538/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:03 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:05.036508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:05.037240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:05.044142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:05.044805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:05.045361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:05.046198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:05.046888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:05.047423 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:05.197330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:05.209468 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd8e1986-894f-46b6-b36d-1a170a0861c7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1365 microversion: 2.1 time: 0.177315 Aug 30 19:11:05.210423 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3391/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:05 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:06.233883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:06.234609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:06.238127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:06.238912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:06.247040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:06.247538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:06.247984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:06.248722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:06.249180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:06.249605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:06.402993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:06.412377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec2bf7a3-8f0b-4671-ae67-0123853f18fb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1551 microversion: 2.1 time: 0.182471 Aug 30 19:11:06.413034 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3539/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:06 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1551 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:06.435481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:06.436297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:06.438674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:06.445504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:06.446453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:06.446602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:06.447233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:06.447699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:06.448146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:06.531826 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4e991255-a8fb-4f56-bfa7-ddf2bd497e38 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101272 Aug 30 19:11:06.532428 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3392/6931] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 19:11:06 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:11:07.680027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:11:07.692649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:07.693208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:07.693580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:07.707010 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] Creating event network-changed:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:11:07.714049 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b71dd92a-6a68-4320-8e0c-f047ecf4ea55 req-6b89c5d2-d018-4f87-a9ac-b2e803ef27c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041571 Aug 30 19:11:07.714760 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3540/6932] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:11:39.388768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=23 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:39.389593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:39.394258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:39.394855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:39.402126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:39.402661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:39.403095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:39.403813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:39.404280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:39.404739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:39.551519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:39.564483 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-78396ffc-e5cc-4ff1-b5c1-51f463f45916 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1670 microversion: 2.1 time: 0.178491 Aug 30 19:11:39.565095 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3393/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:39 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:39.589168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50118e4e-c579-4606-8cda-05b96ddb0a43"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:11:39.592873 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:39.595315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:39.595998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=56 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:39.602674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:39.603220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:39.603707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:39.604440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:39.604901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:39.605325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:39.931962 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b5c6e039-a3e7-4605-8b14-442a01d1866f tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350051 Aug 30 19:11:39.932625 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3541/6934] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:11:39 2022] POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:11:51.768263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:11:51.770676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:51.772881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:51.773547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:51.779121 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:51.779828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:51.780520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:51.781300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:51.781748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:51.782210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:51.812750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:51.819289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122590) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:11:51.826708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:11:51.827113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:11:51.827619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:11:51.828042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:11:51.828463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:11:51.894185 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [d5995e86-49c0-482e-bbb6-bfd7aae3c53e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:11:52.904073 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [d5995e86-49c0-482e-bbb6-bfd7aae3c53e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60828. Aug 30 19:11:52.908926 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36e9831f-13e7-4f78-9ec2-b3ffec265a16 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/action" status: 202 len: 0 microversion: 2.1 time: 1.146522 Aug 30 19:11:52.909652 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3394/6935] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:11:51 2022] POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/action => generated 0 bytes in 1148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:11:52.916766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:52.917560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:11:52.983561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:52.984295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:52.991436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:52.991939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:52.992382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:52.993126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:52.993574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:52.993992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:53.131847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:53.140516 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d97cd91-cc83-4d1c-a4e4-0814c4af3e29 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1725 microversion: 2.1 time: 0.225862 Aug 30 19:11:53.141112 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3542/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:52 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:54.165273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:54.165890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:54.174128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:54.174677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:54.175201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:54.175921 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:54.176427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:54.176880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:54.319255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:54.329164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d10241ed-253d-4661-8398-f27ef08a7885 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1725 microversion: 2.1 time: 0.170062 Aug 30 19:11:54.329756 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3395/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:54 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:55.350503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:55.351118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:55.358320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:55.358879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:55.359316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:55.360010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:55.360487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:55.360926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:55.531117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:55.539756 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d210e867-222d-40e8-b4cf-f44c8e648f98 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.193280 Aug 30 19:11:55.540337 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3543/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:55 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:56.561787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:56.562431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:56.570001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:56.570537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:56.570988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:56.571707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:56.572181 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:56.572619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:56.718792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:56.729228 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a1eb1d8-4ecd-402e-8b6f-b31be7543b42 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.171366 Aug 30 19:11:56.729750 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3396/6939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:56 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:57.754197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:57.754914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:57.762099 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:57.762629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:57.763074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:57.763783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:57.764246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:57.764677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:57.917247 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:57.926540 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-93f00b86-c8d0-429e-aac0-1ffcaa2a8577 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.178594 Aug 30 19:11:57.927089 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3544/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:57 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:11:58.955188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:11:58.955919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:11:58.964195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:58.964706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:58.965167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:58.965898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:11:58.966428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:11:58.966840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:11:59.110560 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:11:59.124295 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb892f7a-7887-4adf-a7d9-92d3201c2bbd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.172750 Aug 30 19:11:59.125020 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3397/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:11:58 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:00.149443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:00.150069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:00.160094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:00.160756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:00.161375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:00.162483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:00.163101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:00.163583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:00.306876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:00.319605 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c04f4114-19f1-4d50-989d-7523f08fff68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.176202 Aug 30 19:12:00.320354 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3545/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:00 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:01.345408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:01.346066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:01.353673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:01.354171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:01.354670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:01.355387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:01.355859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:01.356298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:01.496590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:01.507539 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f27be42d-1e30-490a-ab3f-036aa6167fc8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.166152 Aug 30 19:12:01.508164 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3398/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:01 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:02.529370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:02.529974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:02.537448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:02.537933 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:02.538385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:02.539089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:02.539538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:02.539958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:02.680962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:02.693142 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-35d0047d-15d2-4804-9857-2a9406b30352 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.167734 Aug 30 19:12:02.693701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3546/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:02 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:03.715597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:03.716209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:03.723743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:03.724238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:03.724683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:03.725388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:03.725845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:03.726275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:03.870830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:03.879963 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-18f8e76b-f4ea-4590-bee3-8796f17430a0 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.168226 Aug 30 19:12:03.880914 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3399/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:03 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:04.905061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:04.905671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:04.913216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:04.913702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:04.914144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:04.914880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:04.915336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:04.915764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:05.058281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:05.069359 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8eeb85ad-0333-43a1-9d80-b5de31e527d2 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.168275 Aug 30 19:12:05.069957 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3547/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:04 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:06.092771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:06.093371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:06.101069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:06.101596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:06.102048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:06.102797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:06.103272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:06.103712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:06.242115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:06.251392 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-43e33b02-3009-41f8-ae9d-88ac560a59f9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.162711 Aug 30 19:12:06.252015 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3400/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:06 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:07.283232 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:07.284810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:07.294831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:07.295354 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:07.295792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:07.296508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:07.296984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:07.297391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:07.447920 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:07.456965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dea3234f-3e7d-45c5-b372-f5194f83b438 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.186887 Aug 30 19:12:07.457560 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3548/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:07 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:08.480383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:08.481221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:08.488389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:08.488912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:08.489363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:08.490086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:08.490671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:08.491419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:08.659776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:08.668925 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b0709c46-0be0-40a9-b02e-1d449604aefb tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.193071 Aug 30 19:12:08.669505 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3401/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:08 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:09.691461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:09.692075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:09.701514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:09.702106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:09.702665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:09.703683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:09.704234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:09.704834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:09.845785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:09.854712 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-da255972-df29-458d-b9fb-e2bfa425a7af tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.167246 Aug 30 19:12:09.855541 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3549/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:09 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:10.883386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:10.884009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:10.891350 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:10.891842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:10.892289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:10.892980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:10.893422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:10.893873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:11.034079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:11.046159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73bbf0fe-7c79-41bf-b4d1-64819c558293 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.166682 Aug 30 19:12:11.046975 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3402/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:10 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:12.074211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:12.074851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:12.082654 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:12.083176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:12.083626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:12.084447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:12.084921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:12.085350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:12.227312 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:12.236307 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1b423c1a-954a-4add-9006-8062539c9b77 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.166845 Aug 30 19:12:12.236893 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3550/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:12 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:13.258800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:13.259342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:13.266618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:13.267119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:13.267563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:13.268255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:13.268712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:13.269145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:13.411288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:13.419937 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3a83ba86-67f7-4dfe-b21a-e03068fc5e70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1730 microversion: 2.1 time: 0.165416 Aug 30 19:12:13.421472 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3403/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:13 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:14.442506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:14.443092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:14.451206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:14.452107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:14.452710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:14.453423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:14.454052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:14.454556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:14.591490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-unplugged", "status": "completed", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:14.596736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:14.604612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:14.605098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:14.605526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:14.607114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0e719f2-1e18-4862-b7d7-a10e92305e74 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1729 microversion: 2.1 time: 0.168463 Aug 30 19:12:14.608075 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3551/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:14 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:14.632806 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Creating event network-vif-unplugged:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h1-854119-10 Aug 30 19:12:14.638676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] Instance 47295d31-3525-469e-b22c-eabbee730ec0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:12:14.651161 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0e3fe100-b4bb-4a56-88d5-b300de6f7bb0 req-f8aa1058-0b42-438b-92ea-f29c690ab434 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064813 Aug 30 19:12:14.651796 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3404/6955] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:15.631930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:15.632929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:15.640330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:15.640832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:15.641311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:15.642051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:15.642551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:15.643002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:15.797508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:15.806648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1e46b2a-2529-46a7-ab9c-8349bc7c6096 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1729 microversion: 2.1 time: 0.180439 Aug 30 19:12:15.807322 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3552/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:15 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:16.684007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:16.695235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:16.695740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:16.696209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:16.708800 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Creating event network-changed:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h1-854119-10 Aug 30 19:12:16.714812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] Instance 47295d31-3525-469e-b22c-eabbee730ec0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:12:16.726590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-7f85c673-a060-4b18-b7e6-aa5dc6c807ac req-eb4c4e81-675e-4ee2-9bc2-cfd96fba2a7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046753 Aug 30 19:12:16.727188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3405/6957] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:16.828957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:16.830185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:16.838258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:16.839301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:16.839941 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:16.841761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:16.842682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:16.843275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:17.085043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:17.098077 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fc3974e3-4b0c-499d-a56f-1fd086afd32c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.273272 Aug 30 19:12:17.099702 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3553/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:16 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:18.122928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:18.123756 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:18.130493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:18.131000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:18.131459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:18.132196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:18.132689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:18.133131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:18.283098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:18.293972 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a01e77e3-d35e-448d-b341-993466d9b852 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.176360 Aug 30 19:12:18.294577 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3406/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:18 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:19.317685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:19.318479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:19.325777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:19.326314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:19.326794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:19.327510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:19.328002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:19.328437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:19.472685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:19.481763 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-baea6150-6573-4824-9b83-7775b99b748e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.168134 Aug 30 19:12:19.482460 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3554/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:19 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:20.504005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:20.504706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:20.512081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:20.512688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:20.513206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:20.514134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:20.514646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:20.515146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:20.677963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:20.690701 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-77194c99-a7a1-4b23-817d-1b260351ad0d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.191178 Aug 30 19:12:20.691275 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3407/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:20 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:21.715813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:21.716708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:21.724563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:21.725387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:21.725822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:21.726580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:21.727033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:21.727453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:21.872266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:21.881808 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8448b94-2f4d-4d14-a2fc-7e0c486cde9d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.172103 Aug 30 19:12:21.882398 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3555/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:21 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:22.904294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:22.904898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:22.907762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=33 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:22.913620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:22.914112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:22.914585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:22.915289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:22.915750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:22.916176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:22.919046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:23.066073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:23.074898 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f769eb63-6866-45c5-bce0-7044d083739c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.174941 Aug 30 19:12:23.075492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3408/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:22 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:24.097621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:24.098237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:24.100974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:24.106355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:24.106867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:24.107299 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:24.108013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:24.108483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:24.108903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:24.111776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=85 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:24.250076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:24.262593 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8d11ad31-5422-4918-9feb-776beaab144a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.168821 Aug 30 19:12:24.263286 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3556/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:24 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:25.285064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:25.285778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:25.294626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:25.295388 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:25.295890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:25.296801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:25.297309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:25.298184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:25.440679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:25.449907 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b1da0a3-99b9-4e4a-93c6-fb9a7fdeafda tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.168923 Aug 30 19:12:25.450585 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3409/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:25 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:26.473675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:26.474403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:26.482016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:26.483286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:26.483780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:26.484504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:26.484992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:26.485419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:26.639086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:26.647746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-83c8e7af-89e1-4b5e-8aa9-fec73f09d15e tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.178132 Aug 30 19:12:26.648323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3557/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:26 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:27.670769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:27.671516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:27.682544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:27.683258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:27.683912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:27.684949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:27.685607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:27.686275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:27.839871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:27.848967 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d233dca1-cd18-471a-ae93-56e97a6aea68 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1727 microversion: 2.1 time: 0.183083 Aug 30 19:12:27.849556 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3410/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:27 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:28.872185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:28.873500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:28.881200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:28.881674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:28.882106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:28.882840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:28.883288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:28.883701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.028970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:29.037913 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3bb90649-797d-4807-a435-c666adfcb5d6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1724 microversion: 2.1 time: 0.169900 Aug 30 19:12:29.038537 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3558/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:28 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:29.062048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:29.062864 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:29.070028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.070577 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.071034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.071777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.072230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.072671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.112156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.112658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.113106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.113848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.114320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.114798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.136349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for project f0389b803464405093dc4d8457e85c2f. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:12:29.142289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Getting quotas for user 76789b99a5224451b439d6b7d47fb87c and project f0389b803464405093dc4d8457e85c2f. Resources: {'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:12:29.257790 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-541308a1-fadd-4c34-88da-24a679206c45 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/action" status: 202 len: 0 microversion: 2.1 time: 0.201704 Aug 30 19:12:29.258453 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3411/6969] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:12:29 2022] POST /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:12:29.267959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:29.268574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:29.274898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.275471 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.276032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.276647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:29.277180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:29.277588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:29.419325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:29.430391 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8bee85a2-36c0-4c7f-aedd-90b21577e2fa tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.167220 Aug 30 19:12:29.431322 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3559/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:29 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:30.454988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:30.455821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:30.464290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:30.464782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:30.465259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:30.465998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:30.466488 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:30.466923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:30.611140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:30.623759 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5c03f724-a854-48b6-b324-baab1dde10b3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.174169 Aug 30 19:12:30.624629 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3412/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:30 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:31.650659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:31.652249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:31.662495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-plugged", "status": "completed", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:31.676461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:31.678398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:31.679142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:31.679788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:31.680676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:31.681343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:31.681822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:31.686853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:31.687960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:31.701706 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Creating event network-vif-plugged:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h1-854119-10 Aug 30 19:12:31.708060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] Instance 47295d31-3525-469e-b22c-eabbee730ec0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:12:31.720461 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1871ab05-303c-45be-bd3b-c6840e67c5ae req-41fafdc3-c5b2-4b7c-aac0-2bab83953e74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061626 Aug 30 19:12:31.721488 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3413/6972] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:31.830632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:31.839484 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3599f95-8cff-4527-a980-1458e8f041d7 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.192993 Aug 30 19:12:31.840072 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3560/6973] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:31 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:32.863110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:32.863722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:32.870741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:32.871240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:32.871716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:32.872518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:32.873009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:32.873770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:33.019994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:33.029069 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-512aa686-258f-4421-b1d7-546679e955d1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.171409 Aug 30 19:12:33.029650 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3414/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:32 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:34.051905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:34.052759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:34.060435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:34.060956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:34.061404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:34.062481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:34.062979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:34.063405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:34.210420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:34.219200 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5a39fc3-e6a7-4805-af64-467439c5285a tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.171988 Aug 30 19:12:34.219787 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3561/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:34 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:34.626477 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-unplugged", "status": "completed", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:34.638369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:34.638899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:34.639384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:34.651811 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Creating event network-vif-unplugged:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:12:34.657286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] Instance 47295d31-3525-469e-b22c-eabbee730ec0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122590) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:12:34.668789 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-896c77b3-1dba-4597-b7f5-95332a112a8a req-85d13686-f378-4626-a405-7b07ae82e9d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046830 Aug 30 19:12:34.669375 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3415/6976] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:35.243077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:35.245161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:35.255624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:35.256129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:35.256566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:35.257340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:35.257826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:35.258257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:35.668340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:35.677990 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-57a87726-3359-453b-9286-366d539bbce1 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.439496 Aug 30 19:12:35.678715 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3562/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:35 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:36.701609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:36.702590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:36.704610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:36.710662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:36.711219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:36.711881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:36.712785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:36.713418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:36.713859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:36.716523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:36.717254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:36.717686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:36.731028 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Creating event network-changed:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:12:36.737413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] Instance 47295d31-3525-469e-b22c-eabbee730ec0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:12:36.749133 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b24158e1-25b2-40b4-9af2-bdb449acf058 req-adf720d7-8302-441f-bb9a-3bc731ff9374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048088 Aug 30 19:12:36.749750 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3563/6978] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:36.953597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:36.969892 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e0c79713-7a88-4a8c-af94-a5793c29bb62 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.272875 Aug 30 19:12:36.970888 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3416/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:36 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:37.992573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:37.993278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:38.000699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:38.001188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:38.001624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:38.002387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:38.002880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:38.003303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:38.140533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:38.149746 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-60abca5f-088d-4495-a74d-ad70d30d478c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.161458 Aug 30 19:12:38.150503 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3564/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:37 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:12:39.171036 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:39.171671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:39.175148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:39.180910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:39.181441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:39.181897 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:39.182654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:39.183126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:39.183564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:39.325746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:39.335323 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-651dbb3a-7dd3-49da-8c05-7ae331bd5417 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.168255 Aug 30 19:12:39.335834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3417/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:39 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:12:40.357564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:40.358179 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:40.365509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:40.366001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:40.366469 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:40.367183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:40.367634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:40.368054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:40.561381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:40.571117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9eb5abd7-9a35-41b3-af34-1c05fcff0bd4 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.217533 Aug 30 19:12:40.571695 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3565/6982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:40 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:41.594559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:41.595167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:41.602669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:41.603123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:41.603573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:41.604282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:41.604758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:41.605235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:41.801799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:41.813102 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2a5f6132-da70-45cb-b858-78d31339eff9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.222499 Aug 30 19:12:41.813768 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3418/6983] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:41 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:42.835722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:42.836314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:42.843659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:42.844148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:42.844580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:42.845277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:42.845724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:42.846381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:42.985296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:42.994827 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a7898db-db9a-48d0-aad6-8ea5a4bef730 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.163175 Aug 30 19:12:42.995402 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3566/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:42 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:44.018376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:44.018978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:44.023137 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:12:44.023300 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 (ip 10.222.0.25) !!! Aug 30 19:12:44.030484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:44.031179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:44.031854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:44.033068 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:44.033796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:44.034233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:44.199336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:44.208323 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17ca8e31-61ae-4574-8a71-7074d411ee36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.195250 Aug 30 19:12:44.208900 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3419/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:44 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:45.233266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:45.234156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:45.241098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:45.241537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:45.242076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:45.242948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:45.243465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:45.243944 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:45.386642 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:45.396981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-156ea98d-fdf8-4ff0-9373-8e1d2adf6a36 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.170433 Aug 30 19:12:45.397539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3567/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:45 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:46.418223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:46.418890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:46.427573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:46.428076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:46.428534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:46.429218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:46.429718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:46.430156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:46.574702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:46.584029 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c41dada5-8403-463f-ae86-8f944fd9afec tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.169811 Aug 30 19:12:46.584592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3420/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:46 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:47.606573 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:47.607434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:47.611513 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:12:47.611657 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:12:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 (ip 10.222.0.25) !!! Aug 30 19:12:47.618074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:47.618590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:47.619029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:47.619744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:47.620196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:47.620621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:47.783002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:47.791813 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9243dea-a0c7-4ad3-99b1-8ad85fb47ab5 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1723 microversion: 2.1 time: 0.189354 Aug 30 19:12:47.792753 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3568/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:47 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:48.817377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:48.818224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:48.828654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:48.829438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:48.830218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:48.831342 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:48.831955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:48.832401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:48.969242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:48.982400 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7f682ed-19d0-4a0e-9ded-8b95e77473ff tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1716 microversion: 2.1 time: 0.168956 Aug 30 19:12:48.983136 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3421/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:48 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:49.005431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:49.006015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:49.013250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.013656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.014085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.014814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.015259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.015679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.156803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:49.170311 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-76e03288-ce38-4485-9f72-edd98f73c6f3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1716 microversion: 2.1 time: 0.169199 Aug 30 19:12:49.171174 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3569/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:48 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:49.193987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:49.194637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:49.201531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.202032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.202523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.203229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.203695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.204134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.222381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:49.354485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:49.366013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-aa1afd6e-1f61-41c3-aec6-fac9f1fc514c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1716 microversion: 2.1 time: 0.175836 Aug 30 19:12:49.366857 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3422/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:49 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1716 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:49.390305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:49.390831 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:49.399127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.399752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.400346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.401400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.402041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.402690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.431595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:12:49.527460 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-65ca1847-d757-4ca3-a42e-34687a3a8b46 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 204 len: 0 microversion: 2.1 time: 0.140680 Aug 30 19:12:49.528327 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3570/6992] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:12:49 2022] DELETE /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:12:49.537522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:49.538327 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:49.544592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.545091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.545565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.546260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:49.546778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:49.547218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:49.688441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:49.697651 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-efdd0aaf-38e7-498d-8dc7-a5e51799ed59 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1722 microversion: 2.1 time: 0.164411 Aug 30 19:12:49.698220 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3423/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:49 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:50.307037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-plugged", "status": "completed", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:50.319103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:50.319650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:50.320187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:50.331643 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] Creating event network-vif-plugged:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:12:50.336809 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7da7c214-62c8-45e4-a8de-dbcd74f84924 req-5d45df2a-39ee-4b48-823f-610f13607c43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033992 Aug 30 19:12:50.337426 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3571/6994] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:50.722077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:50.723162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:50.730866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:50.731373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:50.731825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:50.732576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:50.733053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:50.733497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:50.886507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:50.895882 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-303b365d-3fb7-429a-8011-e4056a79e3e9 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1722 microversion: 2.1 time: 0.178243 Aug 30 19:12:50.896469 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3424/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:50 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:51.924142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:51.924830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:51.932010 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:51.932495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:51.932926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:51.933626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:51.934073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:51.934500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:51.937401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:52.193297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:52.202727 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-82867dd2-971b-4943-935f-96070cc8f22d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1722 microversion: 2.1 time: 0.284512 Aug 30 19:12:52.203455 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3572/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:51 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:52.815238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47295d31-3525-469e-b22c-eabbee730ec0", "name": "network-vif-deleted", "tag": "b3779bac-75f4-4ad2-8785-beaba9a6f4cb"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:12:52.826928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:52.827428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:52.827873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:52.840515 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] Creating event network-vif-deleted:b3779bac-75f4-4ad2-8785-beaba9a6f4cb for instance 47295d31-3525-469e-b22c-eabbee730ec0 on n-h2-854119-10 Aug 30 19:12:52.846895 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-827c537f-3fc3-4efa-b0d8-2444ec3203a6 req-0667359b-91bd-4421-bb5f-78ec4813cff5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Aug 30 19:12:52.847557 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3425/6997] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:12:53.226413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:53.227767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:53.234959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:53.235416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:53.236198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:53.237077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:53.237690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:53.238388 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:53.310838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:53.320340 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d8c95d9-fefb-4775-83fb-79afb504ce70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1370 microversion: 2.1 time: 0.098830 Aug 30 19:12:53.320845 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3573/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:53 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:54.343721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:54.344434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:54.346500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:54.353587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:54.354109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:54.354633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:54.355352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:54.355818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:54.356255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:54.425440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:54.435933 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14b3c2fd-05b3-431c-99e1-6388ccf8173d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1370 microversion: 2.1 time: 0.097864 Aug 30 19:12:54.436547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3426/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:54 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:55.457839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:55.458483 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:55.461555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:12:55.467734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:55.468264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:55.468695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:55.469538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:55.470000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:55.470450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:55.535122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:55.544171 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ea222fe7-f251-4b50-9be5-7ec146c58be6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1370 microversion: 2.1 time: 0.090492 Aug 30 19:12:55.544630 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3574/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:55 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:56.566105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:56.566997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:56.574203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:56.574742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:56.575177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:56.575895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:56.576374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:56.576812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:56.642217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76789b99a5224451b439d6b7d47fb87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0389b803464405093dc4d8457e85c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:12:56.651003 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea450134-a093-44d1-87f2-ac6c0f3764fd tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 200 len: 1370 microversion: 2.1 time: 0.088905 Aug 30 19:12:56.651550 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3427/7001] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:56 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:12:57.737278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:57.737858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:57.748183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:57.748811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:57.749346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:57.750465 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:57.751358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:57.751918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:57.770057 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 HTTP/1.1 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '47295d31-3525-469e-b22c-eabbee730ec0'} Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:12:57.771983 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-365f829d-3e31-4919-9e5a-5cd1c70d7c70 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 404 len: 111 microversion: 2.1 time: 0.040732 Aug 30 19:12:57.776205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3575/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:12:57 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:12:57.839715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:12:57.841927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:12:57.849100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:57.849624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:57.850077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:57.850840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:12:57.851348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:12:57.851797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:12:57.864909 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-volume_attachments HTTP/1.1 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': '47295d31-3525-469e-b22c-eabbee730ec0'} Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:12:57.866646 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e92f6ae5-d2c6-4c5e-9e47-d45afd81ab3c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032548 Aug 30 19:12:57.870127 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3428/7003] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:12:57 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.412819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.413461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.420861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.421367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.421807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.422559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.423349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.423799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.438893 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 HTTP/1.1 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '47295d31-3525-469e-b22c-eabbee730ec0'} Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.440459 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d827f06e-642e-47e3-8df7-4cff8f392e1c tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 404 len: 111 microversion: 2.1 time: 0.033496 Aug 30 19:13:01.449320 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3576/7004] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:01 2022] DELETE /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.451731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.452377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 47295d31-3525-469e-b22c-eabbee730ec0] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.459833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.460458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.460779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.461503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.462479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.462479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.478546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 HTTP/1.1 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '47295d31-3525-469e-b22c-eabbee730ec0'} Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.480279 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 47295d31-3525-469e-b22c-eabbee730ec0 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-55746168-fb81-41a4-8f96-11c06c4dabe3 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0" status: 404 len: 111 microversion: 2.1 time: 0.034087 Aug 30 19:13:01.486465 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3429/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:01 2022] GET /compute/v2.1/servers/47295d31-3525-469e-b22c-eabbee730ec0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.492138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.492736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.498988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.499566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.500074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.500841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.501367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.501860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.516527 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 HTTP/1.1 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '21a51ec4-c8f7-48e0-b755-bf892b7a3596'} Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.518151 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b528ec3c-7134-4729-929c-b7a1734c1902 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 404 len: 111 microversion: 2.1 time: 0.031763 Aug 30 19:13:01.522963 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3577/7006] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:01 2022] DELETE /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.529955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.530633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 21a51ec4-c8f7-48e0-b755-bf892b7a3596] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.538117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.538970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.539715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.540883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.541655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.542406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.560615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 HTTP/1.1 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '21a51ec4-c8f7-48e0-b755-bf892b7a3596'} Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.562167 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 21a51ec4-c8f7-48e0-b755-bf892b7a3596 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7e4209f5-6690-459f-b014-b82ee05f66f6 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596" status: 404 len: 111 microversion: 2.1 time: 0.038236 Aug 30 19:13:01.569732 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3430/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:01 2022] GET /compute/v2.1/servers/21a51ec4-c8f7-48e0-b755-bf892b7a3596 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.572732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.573231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.579547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.580033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.580468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.581171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.581623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.582048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.596795 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 HTTP/1.1 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '3ec52d89-eaf7-49af-99b8-c6adf0438560'} Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.598636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-66321c51-b8f5-4bca-ab08-54d154a8a812 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 404 len: 111 microversion: 2.1 time: 0.031765 Aug 30 19:13:01.603638 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3578/7008] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:01 2022] DELETE /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.609785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.610467 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: 3ec52d89-eaf7-49af-99b8-c6adf0438560] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.617072 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.617582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.618034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.618786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.619256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.619697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.636915 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 HTTP/1.1 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '3ec52d89-eaf7-49af-99b8-c6adf0438560'} Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.638400 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance 3ec52d89-eaf7-49af-99b8-c6adf0438560 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e275c5e3-a056-48d0-9873-15b9f1fc0c71 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560" status: 404 len: 111 microversion: 2.1 time: 0.033995 Aug 30 19:13:01.642057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3431/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:01 2022] GET /compute/v2.1/servers/3ec52d89-eaf7-49af-99b8-c6adf0438560 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.649365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.649884 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.656226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.656761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.657146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.657836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.658285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.658730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.674008 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a HTTP/1.1 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a0298a55-8ec6-4400-b1ae-40234ba8c98a'} Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.675636 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a80b9cee-2959-4805-a8c4-72deaccecec8 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 404 len: 111 microversion: 2.1 time: 0.032420 Aug 30 19:13:01.682929 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3579/7010] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:01 2022] DELETE /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.689229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.689773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] [instance: a0298a55-8ec6-4400-b1ae-40234ba8c98a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:01.696225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.696719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.697161 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.697838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:01.698320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:01.698790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:01.713230 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] HTTP exception thrown: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Request method failure captured: Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a HTTP/1.1 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDl_MV6JO78X7USBWhZJ6AUWuVUQmdVRTTJnMFk9tKEJLD8BXGlFyH2LyiqTrXjYjI1Ib0EDYa17uKTDB9k3TGw2IJh-5C8qYT5q8LYb3hfUsJXwUAyBlF2SDwsmAggdiy_484Jzpy77AQ77Mu9XKcidkJKuXZq_7a2yNhpkCLArIboU Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0389b803464405093dc4d8457e85c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0389b803464405093dc4d8457e85c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: f0389b803464405093dc4d8457e85c2f Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServerActionsTestJSON-1848446793 Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 76789b99a5224451b439d6b7d47fb87c Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServerActionsTestJSON-1848446793-project Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'a0298a55-8ec6-4400-b1ae-40234ba8c98a'} Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:01.714826 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Returning 404 to user: Instance a0298a55-8ec6-4400-b1ae-40234ba8c98a could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-04e7c8ad-292f-4049-8cd6-d83531cc4269 tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a" status: 404 len: 111 microversion: 2.1 time: 0.031057 Aug 30 19:13:01.718564 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3432/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:01 2022] GET /compute/v2.1/servers/a0298a55-8ec6-4400-b1ae-40234ba8c98a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:01.725425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ad7938c1-f7fb-4cd5-a262-5003751a099d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] Calling method '.version_select at 0x7f4e5aed75e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:01.753232 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ad7938c1-f7fb-4cd5-a262-5003751a099d tempest-ServerActionsTestJSON-1848446793 tempest-ServerActionsTestJSON-1848446793-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376688378" status: 202 len: 0 microversion: 2.1 time: 0.031716 Aug 30 19:13:01.754028 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3580/7012] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 19:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376688378 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:13:11.614680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-393840920", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "26d74c6a-cf7e-494b-97b9-2023781030af"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:11.673137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] validate_networks() for [('26d74c6a-cf7e-494b-97b9-2023781030af', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:13:11.703842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=39 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:12.081625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:13:12.082264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:13:12.082801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:13:12.083507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:13:12.083971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:13:12.093324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:12.093826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:12.094279 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:12.095057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:12.095527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:12.095966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:12.114005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Getting quotas for project 563156a3182a4364bf074b6930194b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:13:12.120206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Getting quotas for user 1f72183ed081447086803d3864a4f2b8 and project 563156a3182a4364bf074b6930194b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:13:12.133816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:13:12.136223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:13:12.185669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a82fec2e-f32e-4d32-b9ba-360dc4e5be6d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705403 Aug 30 19:13:12.186306 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3433/7013] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:13:12.197915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d164a341-38b2-48f2-8aa5-4d3b096226b3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:12.199174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d164a341-38b2-48f2-8aa5-4d3b096226b3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:12.201856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=27 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:12.202723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:12.262886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d164a341-38b2-48f2-8aa5-4d3b096226b3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:12.272807 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d164a341-38b2-48f2-8aa5-4d3b096226b3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1216 microversion: 2.1 time: 0.077891 Aug 30 19:13:12.273426 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3581/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:12 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:13.295542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:13.296817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:13.305522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:13.305716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:13.306023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:13.307013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:13.307511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:13.307926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:13.393846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:13.403194 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-13dbd42b-3821-434d-843d-f469fd0a2e7f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1268 microversion: 2.1 time: 0.113673 Aug 30 19:13:13.417044 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3434/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:13 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:14.424929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:14.425527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:14.433504 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:14.434287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:14.434945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:14.435667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:14.436447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:14.436900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:14.722636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:14.737148 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9fac22c0-7174-44e2-a287-623945fcd283 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.315632 Aug 30 19:13:14.739286 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3582/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:14 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:14.944602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a", "tag": "77b86169-8917-4640-b663-e2b1b5253091"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:14.967534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:14.968448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:14.969091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:14.997268 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] Creating event network-changed:77b86169-8917-4640-b663-e2b1b5253091 for instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a on n-h2-854119-10 Aug 30 19:13:15.004578 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-17c4a084-c7d6-44fb-af7c-7ed64d367bf1 req-64b68042-1343-4264-84ca-c698dcbdbedc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063441 Aug 30 19:13:15.005987 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3435/7017] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:15.761548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:15.762195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:15.769898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:15.770463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:15.770899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:15.771739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:15.772083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:15.772546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:15.916190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:15.926085 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21ce9204-be23-4155-9c29-d77466011bc3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.168248 Aug 30 19:13:15.926972 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3583/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:15 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:16.949248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:16.949978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:16.957099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:16.958131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:16.958822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:16.959586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:16.960064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:16.960503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:17.120377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:17.132385 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-edb38102-d519-43fb-b3d3-ba989f967c7a tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.188335 Aug 30 19:13:17.132860 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3436/7019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:16 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:18.154102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:18.154668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:18.162282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:18.163012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:18.163491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:18.164302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:18.164756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:18.165467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:18.315008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:18.323493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f7b1be37-7e2c-45c0-beb6-479f324e3bf7 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.173354 Aug 30 19:13:18.324111 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3584/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:18 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:19.346533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:19.347304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:19.354779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:19.355295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:19.355732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:19.356472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:19.356961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:19.357401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:19.531640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:19.544984 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d0a2736a-6872-4af8-a7ac-5889e75f9cb6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.202179 Aug 30 19:13:19.545925 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3437/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:19 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:20.474763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a", "name": "network-vif-plugged", "status": "completed", "tag": "77b86169-8917-4640-b663-e2b1b5253091"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:20.486453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:20.486985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:20.487423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:20.501384 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] Creating event network-vif-plugged:77b86169-8917-4640-b663-e2b1b5253091 for instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a on n-h2-854119-10 Aug 30 19:13:20.507412 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bd2d96cd-8d6d-429a-bc4a-c88000b87e08 req-107cdea6-ef1d-445c-8535-341a30f39ef6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115383 Aug 30 19:13:20.508143 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3585/7022] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:20.568337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:20.569300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:20.577082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:20.577723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:20.578186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:20.579097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:20.579622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:20.580064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:20.756653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:20.764932 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1c585405-4e3a-4af1-93db-d16f1cfb912b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1316 microversion: 2.1 time: 0.200887 Aug 30 19:13:20.765523 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3438/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:20 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:21.789992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:21.790804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:21.798466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:21.798966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:21.799406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:21.800248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:21.800711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:21.801147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:21.960618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:21.969083 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7bee88a-39dc-45c2-b2c4-546959828b21 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.185066 Aug 30 19:13:21.969698 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3586/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:21 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:22.033721 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1138071680", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "26d74c6a-cf7e-494b-97b9-2023781030af"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:22.101862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] validate_networks() for [('26d74c6a-cf7e-494b-97b9-2023781030af', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:13:22.106250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:22.127931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:22.561553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:13:22.562001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:13:22.562502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:13:22.562947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:13:22.563351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:13:22.575731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:22.576007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:22.576688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:22.577516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:22.578192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:22.578925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:22.598149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Getting quotas for project 563156a3182a4364bf074b6930194b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:13:22.604621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Getting quotas for user 1f72183ed081447086803d3864a4f2b8 and project 563156a3182a4364bf074b6930194b6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:13:22.618146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:13:22.620671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:13:22.670679 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33b917ae-f980-4290-a55c-3c3d35e3094b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640929 Aug 30 19:13:22.671364 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3439/7025] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:13:22.685795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-de199e77-7710-44df-94e3-393ff409c301 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:22.686175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-de199e77-7710-44df-94e3-393ff409c301 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:22.688625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:22.764196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-de199e77-7710-44df-94e3-393ff409c301 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:22.771720 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-de199e77-7710-44df-94e3-393ff409c301 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1217 microversion: 2.1 time: 0.090750 Aug 30 19:13:22.772543 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3587/7026] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:22 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:23.800440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:23.801129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:23.807969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:23.808512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:23.809080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:23.809973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:23.811866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:23.813075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:23.906243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:23.915289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39dfd6e4-41db-4ec4-b13d-abbafb6f002d tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1269 microversion: 2.1 time: 0.120003 Aug 30 19:13:23.915843 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3440/7027] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:23 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:24.950975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:24.951705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:24.959765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:24.960461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:24.960966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:24.961789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:24.962307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:24.962824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:25.148157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:25.156492 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed4935dc-35d5-4886-a271-319c01d17ccb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.210445 Aug 30 19:13:25.157144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3588/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:24 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:25.736271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f975561b-66ef-48b8-945f-3dbe27f66031", "tag": "632b2fcb-9d7b-4269-8a66-a48f8b3cc5da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:25.742761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:25.749575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:25.750105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:25.750607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:25.765164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] Creating event network-changed:632b2fcb-9d7b-4269-8a66-a48f8b3cc5da for instance f975561b-66ef-48b8-945f-3dbe27f66031 on n-h1-854119-10 Aug 30 19:13:25.771279 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-582a035f-e354-472c-944e-9b317b86e961 req-1d78195c-13d9-4e8c-9d7d-1bd6b8803f0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105106 Aug 30 19:13:25.771932 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3441/7029] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:26.182867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:26.183630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:26.190382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:26.190901 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:26.191347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:26.192148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:26.192757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:26.193453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:26.345927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:26.354649 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c1294ff3-ef98-4e0e-af6c-27b847a64885 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.177142 Aug 30 19:13:26.355253 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3589/7030] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:26 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:27.376942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:27.378557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:27.393568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:27.394530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:27.395165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:27.396084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:27.396703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:27.397432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:27.572265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:27.580882 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f2985a90-7e4d-44bd-bffb-90d6b2895acb tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.208507 Aug 30 19:13:27.581552 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3442/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:27 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:28.603357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:28.603957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:28.611700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:28.612205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:28.612640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:28.613358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:28.613903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:28.614491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:28.758280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:28.772968 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a9a43f8-5a29-4405-abf6-ed7075fe7f1f tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.173284 Aug 30 19:13:28.774053 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3590/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:28 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:29.795073 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:29.795865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:29.804247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:29.804752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:29.805210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:29.805961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:29.806466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:29.806905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:29.962377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:29.968624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ae1db60-844e-41f5-b26b-7bd4b02440d3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.177282 Aug 30 19:13:29.969235 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3443/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:29 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:30.991166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:30.991804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:30.999220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:30.999704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:31.000138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:31.000865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:31.001319 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:31.001737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:31.160313 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:31.168781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-968658df-0f13-42f0-af0a-c21c7b96905b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.181597 Aug 30 19:13:31.169374 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3591/7034] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:30 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:31.904894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f975561b-66ef-48b8-945f-3dbe27f66031", "name": "network-vif-plugged", "status": "completed", "tag": "632b2fcb-9d7b-4269-8a66-a48f8b3cc5da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:31.916031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:31.916534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:31.916980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:31.929077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] Creating event network-vif-plugged:632b2fcb-9d7b-4269-8a66-a48f8b3cc5da for instance f975561b-66ef-48b8-945f-3dbe27f66031 on n-h1-854119-10 Aug 30 19:13:31.934255 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-73d68674-9375-4a49-a306-5d0d34cc605d req-0a4636fd-69c4-4032-a1f0-6f5ab4f297d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Aug 30 19:13:31.935103 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3444/7035] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:32.190380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:32.190998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:32.198841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:32.199336 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:32.199776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:32.200497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:32.200983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:32.201409 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:32.343066 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:32.352288 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58d067a1-0156-4648-b0d8-c8ff8f223a06 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1317 microversion: 2.1 time: 0.165935 Aug 30 19:13:32.352894 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3592/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:32 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:33.379764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:33.381321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:33.384595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:33.385434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:33.393091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.393591 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.394038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.394803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.395290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.395730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.541047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:33.549620 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07fbe975-b0ab-4991-935b-d04f4248c4d6 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1507 microversion: 2.1 time: 0.175157 Aug 30 19:13:33.550187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3445/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:33 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:33.573951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:33.573951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:33.575105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:33.581083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.581571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.582007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.582756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.583489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.583943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.612190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:13:33.702812 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff99eb59-a092-4b29-b87d-f84c94bead55 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 204 len: 0 microversion: 2.1 time: 0.135338 Aug 30 19:13:33.703333 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3593/7038] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:33 2022] DELETE /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:13:33.714049 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:33.715155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:33.721602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.722115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.722596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.723329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:33.724694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:33.725144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:33.883986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:33.894839 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b1c3d04e-3860-40e7-a88a-209a40f757a2 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1513 microversion: 2.1 time: 0.186734 Aug 30 19:13:33.895631 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3446/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:33 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:34.917876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:34.918632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:34.926382 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:34.926985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:34.927470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:34.928259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:34.928716 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:34.929149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:35.074008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:35.082464 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-970bd01a-16f8-45a2-a0a5-66b7788672b4 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1513 microversion: 2.1 time: 0.168895 Aug 30 19:13:35.083199 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3594/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:34 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:35.819868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f975561b-66ef-48b8-945f-3dbe27f66031", "name": "network-vif-deleted", "tag": "632b2fcb-9d7b-4269-8a66-a48f8b3cc5da"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:35.848827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:35.850666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:35.852255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:35.882174 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] Creating event network-vif-deleted:632b2fcb-9d7b-4269-8a66-a48f8b3cc5da for instance f975561b-66ef-48b8-945f-3dbe27f66031 on n-h1-854119-10 Aug 30 19:13:35.896244 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-38ce6110-5e58-49a6-85a9-ea2e1a256b91 req-02ea0c52-5404-4b39-bda8-b65fd51b18c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094085 Aug 30 19:13:35.897733 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3447/7041] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:36.104829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:36.105664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:36.113271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:36.113772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:36.114314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:36.115070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:36.115526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:36.115955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:36.154515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:36.155009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:36.155458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:36.155909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lazy-loading 'fault' on Instance uuid f975561b-66ef-48b8-945f-3dbe27f66031 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:13:36.202006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:36.212658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1d75ab03-6d7b-41fe-bb73-95caefd006f5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 200 len: 1307 microversion: 2.1 time: 0.112855 Aug 30 19:13:36.213270 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3595/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:36 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:37.235399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:37.236144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.243855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.244352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.244802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.245512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.245975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.246436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.264146 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 HTTP/1.1 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f975561b-66ef-48b8-945f-3dbe27f66031'} Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.265833 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 404 to user: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1808cc7d-673f-4b08-8927-69db9f9610c9 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 404 len: 111 microversion: 2.1 time: 0.036191 Aug 30 19:13:37.270413 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3448/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:37 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:37.276717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:37.277293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.287049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.287540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.287971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.288709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.289157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.289550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.433624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:37.442014 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a8e27017-a7a6-4b98-ab30-573e3346f291 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.169225 Aug 30 19:13:37.442643 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3596/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:37 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:37.463277 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:37.465558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: 97f128f8-ceb4-4173-b878-e3f8d5e305f7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.471551 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/97f128f8-ceb4-4173-b878-e3f8d5e305f7/action HTTP/1.1 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 32 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: {"resize": {"flavorRef": "452"}} Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '97f128f8-ceb4-4173-b878-e3f8d5e305f7', 'body': {'resize': {'flavorRef': '452'}}} Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:37.473146 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 404 to user: Instance 97f128f8-ceb4-4173-b878-e3f8d5e305f7 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3f2865ef-4c8c-4d0c-8d6b-94cbb589d83b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "POST /compute/v2.1/servers/97f128f8-ceb4-4173-b878-e3f8d5e305f7/action" status: 404 len: 111 microversion: 2.1 time: 0.015906 Aug 30 19:13:37.477159 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3449/7045] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:13:37 2022] POST /compute/v2.1/servers/97f128f8-ceb4-4173-b878-e3f8d5e305f7/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 19:13:37.485167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:37.486142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.492419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.492903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.493812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.494560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.495009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.495431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.640088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:37.651255 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a87174ea-77b2-471f-befe-dba20c5fb7dd tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.171052 Aug 30 19:13:37.652346 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3597/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:37 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:37.676997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:37.677659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.685468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.685982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.686465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.687201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.687659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.688100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.831165 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:37.839403 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8d4244a-0314-4907-80f0-1a791cd510df tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.170056 Aug 30 19:13:37.840011 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3450/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:37 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:37.860695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "4c4cbcec-f173-44ce-86cd-900bfdd25fb1"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:37.863129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.869581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.870110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.870578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.871292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.871756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.872248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.877052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:37.905524 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:37.912078 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: request: POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action HTTP/1.1 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 65 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: {"resize": {"flavorRef": "4c4cbcec-f173-44ce-86cd-900bfdd25fb1"}} Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: exception: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a', 'body': {'resize': {'flavorRef': '4c4cbcec-f173-44ce-86cd-900bfdd25fb1'}}} Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:37.914001 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 400 to user: Flavor 4c4cbcec-f173-44ce-86cd-900bfdd25fb1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1eb2c19-895d-44dc-8dad-2b1ed1ceb8ed tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action" status: 400 len: 107 microversion: 2.1 time: 0.058995 Aug 30 19:13:37.918593 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3598/7048] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:13:37 2022] POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action => generated 107 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 19:13:37.925091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:37.925729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:37.932115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.932599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.933025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:37.933733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:37.934191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:37.934642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.084739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:38.094890 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0ba0109f-918d-46df-aa96-b6d523488a73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.173945 Aug 30 19:13:38.095471 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3451/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:37 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:38.116223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.116838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.123647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.124141 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.124579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.125290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.125746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.126171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.264945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:38.273789 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0569be08-1dac-4601-99d1-32708efc500b tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.161447 Aug 30 19:13:38.274565 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3599/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:38 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:38.296307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd9f8181-0011-495b-bef4-0a4728ac4fea tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd9f8181-0011-495b-bef4-0a4728ac4fea tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: request: POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action HTTP/1.1 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 29 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: {"resize": {"flavorRef": ""}} Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'd6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a', 'body': {'resize': {'flavorRef': ''}}} Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise error Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi '' Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.300328 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bd9f8181-0011-495b-bef4-0a4728ac4fea tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bd9f8181-0011-495b-bef4-0a4728ac4fea tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action" status: 400 len: 113 microversion: 2.1 time: 0.010617 Aug 30 19:13:38.307602 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3452/7051] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:13:38 2022] POST /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 19:13:38.311517 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.312193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.319357 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.319846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.320287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.320989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.321450 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.321875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.466520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:38.475721 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-55fe8ba6-e593-4a6d-9b30-c15b96b063a5 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1506 microversion: 2.1 time: 0.168389 Aug 30 19:13:38.476300 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3600/7052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:38 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:13:38.500115 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.500645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.508160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.508669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.509476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.510219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.510686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.511111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.525608 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 HTTP/1.1 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'f975561b-66ef-48b8-945f-3dbe27f66031'} Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:38.527249 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 404 to user: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5553513c-456a-4fb1-89cf-d8109569cbdf tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 404 len: 111 microversion: 2.1 time: 0.032669 Aug 30 19:13:38.531482 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3453/7053] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:38 2022] DELETE /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:38.543385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.544255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: f975561b-66ef-48b8-945f-3dbe27f66031] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.552946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.553300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.553855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.554726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.555439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.555960 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.570752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 HTTP/1.1 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'f975561b-66ef-48b8-945f-3dbe27f66031'} Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:38.572734 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 404 to user: Instance f975561b-66ef-48b8-945f-3dbe27f66031 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4072a5bc-ef26-4eb3-9199-e69116dbdc1e tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031" status: 404 len: 111 microversion: 2.1 time: 0.039759 Aug 30 19:13:38.577136 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3601/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:38 2022] GET /compute/v2.1/servers/f975561b-66ef-48b8-945f-3dbe27f66031 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:13:38.583211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.583730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.590079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.590634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.591087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.591805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.592275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.592717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.620438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:13:38.714827 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36df95f4-7121-49b7-bbfa-fb8446f466c3 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 204 len: 0 microversion: 2.1 time: 0.135195 Aug 30 19:13:38.715430 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3454/7055] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:13:38 2022] DELETE /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:13:38.724320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:38.724948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:38.732192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.732693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.733810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.734592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:38.735050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:38.735493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:38.879840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:38.889091 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-675c5c44-d9be-4657-9070-d1ddf2cf7794 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1512 microversion: 2.1 time: 0.168750 Aug 30 19:13:38.889701 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3602/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:38 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:13:39.911869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:39.912575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:39.919879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:39.920377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:39.920937 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:39.921669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:39.922111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:39.922945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:39.928005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:40.068774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:40.077892 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6a55cd9-ccf8-4cdc-8d82-0d77a22ae333 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1512 microversion: 2.1 time: 0.170295 Aug 30 19:13:40.078536 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3455/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:39 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:40.805685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a", "name": "network-vif-deleted", "tag": "77b86169-8917-4640-b663-e2b1b5253091"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:13:40.817864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:40.818368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:40.818810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:40.845635 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] Creating event network-vif-deleted:77b86169-8917-4640-b663-e2b1b5253091 for instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a on n-h2-854119-10 Aug 30 19:13:40.855080 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7670715a-2993-4dea-8d51-d91991dd127e req-9326b549-2d0a-4d3f-9eef-183b27e5e3f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052959 Aug 30 19:13:40.856192 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3603/7058] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:13:41.099835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:41.100417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:41.108247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:41.108789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:41.109245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:41.109965 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:41.110485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:41.110931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:41.434920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:41.435424 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:41.435987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:41.436464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lazy-loading 'fault' on Instance uuid d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:13:41.480187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f72183ed081447086803d3864a4f2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563156a3182a4364bf074b6930194b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:13:41.488631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-14de5e69-7dea-4c58-9aee-bc689722bf73 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 200 len: 1306 microversion: 2.1 time: 0.392854 Aug 30 19:13:41.489231 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3456/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:41 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 1306 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:13:42.517508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:13:42.518197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] [instance: d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:13:42.520272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:13:42.526218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:42.526739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:42.527180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:42.527902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:13:42.528362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:13:42.528793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:13:42.544953 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] HTTP exception thrown: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Request method failure captured: Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a HTTP/1.1 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmFHzCWzczh2_jP4oY_dQXctODTHRMEkJFR0lwDhJlWMg5C_Hyc8s677zYU37hgwacUHLxNF8f9ZfD8W1JKxmAT731KFMGgTtjcnmAaGYvBO9B94BKNaLF3Vlf9h_F8mslr5xDrnOYPAzWxlTyiNHD_RmYD9WHTnqZo3nRLntOB8YPc Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/563156a3182a4364bf074b6930194b6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/563156a3182a4364bf074b6930194b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_563156a3182a4364bf074b6930194b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 563156a3182a4364bf074b6930194b6b Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1759698842 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 1f72183ed081447086803d3864a4f2b8 Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-ServersNegativeTestJSON-1759698842-project Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'd6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a'} Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:13:42.546889 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] Returning 404 to user: Instance d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-faf78442-3b85-423a-92b5-c6c7cd054375 tempest-ServersNegativeTestJSON-1759698842 tempest-ServersNegativeTestJSON-1759698842-project] 10.222.0.25 "GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a" status: 404 len: 111 microversion: 2.1 time: 0.036915 Aug 30 19:13:42.552329 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3604/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:13:42 2022] GET /compute/v2.1/servers/d6707c4c-850d-47d7-a4b9-b6f5f6a2cf8a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:14:16.663087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:16.670310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:16.878503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-17484978-411a-42bb-a1c2-2fa3de28f71a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: .version_select at 0x7f4e44752820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2043860492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD/Q4o0hDaSVDE7qHQr8+jm/LVFt27PSdsxAkwmwkISVB5n9aySMOuGHyu4FfXxN35l4N2mRJgxk15ys5GXItyOdShSZ7Gs83uwbZk/YXIDxjTugDmRnPJc9uoqeXMFhg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:16.907401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-17484978-411a-42bb-a1c2-2fa3de28f71a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:14:16.913821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-17484978-411a-42bb-a1c2-2fa3de28f71a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:14:16.954455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-17484978-411a-42bb-a1c2-2fa3de28f71a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.302032 Aug 30 19:14:16.955815 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3457/7061] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:14:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:17.011067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1205285686", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2043860492", "networks": [{"uuid": "8d9245e0-a808-43df-97f1-72802d12bfd6"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:17.020702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=26 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:17.022014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:17.080892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] validate_networks() for [('8d9245e0-a808-43df-97f1-72802d12bfd6', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:14:17.493266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:14:17.493768 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:14:17.494404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:14:17.494977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:14:17.495394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:14:17.506796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:17.507277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:17.507706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:17.508419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:17.508956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:17.509566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:17.528610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:14:17.534868 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:14:17.548659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:14:17.551067 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:14:17.602538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-20261043-d4cc-401b-82c3-18e898b70eb3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595371 Aug 30 19:14:17.603519 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3605/7062] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:14:17.621701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-92f1f331-f861-4aa5-b527-753e508df824 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:17.622820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-92f1f331-f861-4aa5-b527-753e508df824 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:17.683142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-92f1f331-f861-4aa5-b527-753e508df824 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:17.691408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-92f1f331-f861-4aa5-b527-753e508df824 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1263 microversion: 2.1 time: 0.074433 Aug 30 19:14:17.691928 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3458/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:17 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:18.713887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:18.714694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:18.721971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:18.722500 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:18.723187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:18.723890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:18.724860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:18.725309 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:18.811131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:18.824458 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09b2117e-2b8b-4289-a05c-3897c9e391b6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1323 microversion: 2.1 time: 0.116196 Aug 30 19:14:18.825736 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3606/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:18 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1323 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:19.847893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:19.850184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:19.861442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:19.862513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:19.863781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:19.864733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:19.865323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:19.871901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:20.035616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:20.045657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6fcc627d-9f09-4823-9ec4-569f3ca734a6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.201789 Aug 30 19:14:20.050391 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3459/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:19 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:20.535985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64403070-f64e-417b-853d-ccc5ad67ab13", "tag": "dd36740d-d91b-4612-81c2-f6b6c252eb31"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:20.550056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:20.550824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:20.551324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:20.567569 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] Creating event network-changed:dd36740d-d91b-4612-81c2-f6b6c252eb31 for instance 64403070-f64e-417b-853d-ccc5ad67ab13 on n-h2-854119-10 Aug 30 19:14:20.573064 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8ed20db9-6503-448d-a714-4818518ec53a req-b207559f-b9ea-4673-bfc2-f69ff6c4b0cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042142 Aug 30 19:14:20.573788 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3607/7066] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:21.068426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:21.068967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:21.077479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:21.077978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:21.078456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:21.079175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:21.079641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:21.080064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:21.232018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:21.244704 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de4cd2e3-8381-4d49-bf64-00b2359993b5 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.180542 Aug 30 19:14:21.245544 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3460/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:21 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:22.272301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:22.273206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:22.281185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:22.281840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:22.282243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:22.283009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:22.283470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:22.283898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:22.481322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:22.489577 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0a95ae82-1e79-47a0-ad6f-ef68033401d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.221586 Aug 30 19:14:22.490205 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3608/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:22 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:23.512786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:23.513318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:23.521254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:23.521766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:23.522238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:23.522993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:23.523466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:23.523912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:23.670075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:23.682740 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d5da4fbe-7283-4183-8d11-c99c58b317f2 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.174159 Aug 30 19:14:23.683697 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3461/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:23 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:24.708472 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:24.709088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:24.716600 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:24.717088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:24.717518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:24.718216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:24.718705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:24.719131 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:24.862536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:24.871354 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4e51b112-9a6a-439d-b615-479497fb6da4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.166721 Aug 30 19:14:24.876744 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3609/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:24 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:25.892628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:25.893298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:25.901140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:25.901704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:25.902153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:25.902909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:25.903368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:25.903805 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:26.042911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:26.051989 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8f4c9b86-fa62-493d-8d13-7035c036c3d3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.163540 Aug 30 19:14:26.052897 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3462/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:25 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:26.559019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64403070-f64e-417b-853d-ccc5ad67ab13", "name": "network-vif-plugged", "status": "completed", "tag": "dd36740d-d91b-4612-81c2-f6b6c252eb31"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:26.578582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:26.579373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:26.580021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:26.595986 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] Creating event network-vif-plugged:dd36740d-d91b-4612-81c2-f6b6c252eb31 for instance 64403070-f64e-417b-853d-ccc5ad67ab13 on n-h2-854119-10 Aug 30 19:14:26.615747 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-5b1ecb08-9672-4c30-889c-5aa432dad862 req-8c618a07-7ecc-4cdb-8ad6-29d14a9892f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060871 Aug 30 19:14:26.616624 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3610/7072] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:27.077636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:27.078545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:27.086546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:27.087031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:27.087480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:27.088188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:27.088792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:27.089229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:27.241700 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:27.250137 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82b45bb2-559e-4e1a-badd-f7a587fbdc4a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1363 microversion: 2.1 time: 0.179688 Aug 30 19:14:27.250788 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3463/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:27 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:28.269675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:28.270372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:28.276402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:28.277224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:28.289033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:28.289580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:28.290024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:28.290780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:28.291237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:28.293819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:28.436931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:28.445372 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5c00277b-7732-4b66-9af2-8512fc09a581 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1554 microversion: 2.1 time: 0.176805 Aug 30 19:14:28.446003 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3611/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:28 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:28.466528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:28.467103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:28.469062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:28.475695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:28.476224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:28.476670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:28.477386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:28.477883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:28.478338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:28.630383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:28.638430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac4f9572-bb1b-4f2c-8e9d-b2e8c625645d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1554 microversion: 2.1 time: 0.176175 Aug 30 19:14:28.639003 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3464/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:28 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:30.316921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c5a78f1-22cc-4644-af70-bef10288f9d6"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:30.320003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:30.328706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:30.329186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:30.329616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:30.330337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:30.331095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:30.331523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:30.642522 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6d1b48a1-a1a0-4eda-8edb-ef31125864ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332309 Aug 30 19:14:30.643894 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3612/7076] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:14:30 2022] POST /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:14:41.414362 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:41.414892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:41.419143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:41.419961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=36 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:41.426398 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:41.426910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:41.427383 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:41.428102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:41.428575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:41.428998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:41.516751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lazy-loading 'services' on Instance uuid 64403070-f64e-417b-853d-ccc5ad67ab13 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:14:41.600557 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68cf034d-e38e-4694-8a13-4d21078c946a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments/7c5a78f1-22cc-4644-af70-bef10288f9d6" status: 202 len: 0 microversion: 2.1 time: 0.192176 Aug 30 19:14:41.601448 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3465/7077] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:14:41 2022] DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments/7c5a78f1-22cc-4644-af70-bef10288f9d6 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:14:41.610306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:41.611540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:14:41.616344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:41.618221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:41.626652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:41.627175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:41.627592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:41.628303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:41.628761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:41.629168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:41.661538 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b028653f-0170-43df-839e-6a525b23c03b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053178 Aug 30 19:14:41.662121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3613/7078] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:41 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:42.676716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:42.679159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:42.686230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:42.686788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:42.687240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:42.687969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:42.688436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:42.688873 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:42.720476 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6934f56-87c4-4921-a971-72871d01cb7c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049431 Aug 30 19:14:42.721049 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3466/7079] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:42 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:43.733781 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:43.735998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:43.743899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:43.744392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:43.744826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:43.745530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:43.745976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:43.746400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:43.779848 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1beb118-9625-4269-a0ad-4dd78585fa49 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050506 Aug 30 19:14:43.780433 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3614/7080] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:43 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:44.792785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:44.795253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:44.803116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:44.803755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:44.804231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:44.804949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:44.805413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:44.805840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:44.838549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-303da026-fe5e-41fe-bad1-96062b7446f6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049791 Aug 30 19:14:44.839143 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3467/7081] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:44 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:45.851900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:45.854083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:45.861619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:45.862121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:45.862636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:45.863316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:45.863794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:45.864224 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:45.897087 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d8115544-e020-4739-bbdb-827692a496ff tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049347 Aug 30 19:14:45.897677 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3615/7082] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:45 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:46.910497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:46.912711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:46.919981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:46.920474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:46.920917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:46.921630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:46.922090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:46.922892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:46.958622 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e7befbf-b72c-4935-a226-86475c4abe70 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052085 Aug 30 19:14:46.959206 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3468/7083] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:14:46 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 19:14:46.972404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:46.973163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:46.981231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:46.981700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:46.982739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:46.983229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:46.983713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:46.984142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:47.071640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 is not attached to volume 7c5a78f1-22cc-4644-af70-bef10288f9d6 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments/7c5a78f1-22cc-4644-af70-bef10288f9d6 HTTP/1.1 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 is not attached to volume 7c5a78f1-22cc-4644-af70-bef10288f9d6 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '64403070-f64e-417b-853d-ccc5ad67ab13', 'id': '7c5a78f1-22cc-4644-af70-bef10288f9d6'} Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7c5a78f1-22cc-4644-af70-bef10288f9d6. Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 is not attached to volume 7c5a78f1-22cc-4644-af70-bef10288f9d6 Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:14:47.080876 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 is not attached to volume 7c5a78f1-22cc-4644-af70-bef10288f9d6 Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 is not attached to volume 7c5a78f1-22cc-4644-af70-bef10288f9d6 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f4760c6a-a33e-46cf-8fe6-846a5e7dff66 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments/7c5a78f1-22cc-4644-af70-bef10288f9d6" status: 404 len: 154 microversion: 2.1 time: 0.117019 Aug 30 19:14:47.086265 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3616/7084] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:14:46 2022] DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13/os-volume_attachments/7c5a78f1-22cc-4644-af70-bef10288f9d6 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:14:50.449980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:50.451470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:50.458190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:50.458729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:50.459156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:50.460025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:50.460669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:50.461128 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:50.490336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:14:50.573638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9cb114e-9eaa-4f9a-b48f-3574b4c1b742 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 204 len: 0 microversion: 2.1 time: 0.127387 Aug 30 19:14:50.574261 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3469/7085] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:14:50 2022] DELETE /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:14:50.584075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:50.584725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:50.596791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:50.597303 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:50.597749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:50.598738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:50.599221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:50.599650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:50.737803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:50.746005 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22c9f2eb-f9b9-4e84-b279-ace26a16997f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1560 microversion: 2.1 time: 0.166706 Aug 30 19:14:50.746657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3617/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:50 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:14:51.769583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:51.770334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:51.779877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:51.780382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:51.780840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:51.781570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:51.782038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:51.782531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:51.918866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:51.927615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1c7ffc71-3f4c-489f-806a-eaf07704b739 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1560 microversion: 2.1 time: 0.162796 Aug 30 19:14:51.928209 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3470/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:51 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:52.948365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:52.948991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:52.956986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:52.957516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:52.958231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:52.959167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:52.959943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:52.960571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:53.011909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64403070-f64e-417b-853d-ccc5ad67ab13", "name": "network-vif-deleted", "tag": "dd36740d-d91b-4612-81c2-f6b6c252eb31"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:53.022895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:53.023681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:53.024274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:53.038011 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] Creating event network-vif-deleted:dd36740d-d91b-4612-81c2-f6b6c252eb31 for instance 64403070-f64e-417b-853d-ccc5ad67ab13 on n-h2-854119-10 Aug 30 19:14:53.038237 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:53.044224 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-733aca2f-a230-49c8-b4ae-43a9bacca867 req-327f0b1e-f1e0-4291-82c1-7d7081ce1e78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111476 Aug 30 19:14:53.045229 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3618/7088] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:53.051164 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8586da37-0a87-4993-b01d-04a64bfc3586 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 200 len: 1518 microversion: 2.1 time: 0.107122 Aug 30 19:14:53.051909 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3471/7089] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:52 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 1518 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:54.073785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:54.074589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 64403070-f64e-417b-853d-ccc5ad67ab13] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:54.082593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:54.083123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:54.084034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:54.084310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:54.084703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:54.085124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:54.101068 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 HTTP/1.1 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '64403070-f64e-417b-853d-ccc5ad67ab13'} Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:54.102814 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance 64403070-f64e-417b-853d-ccc5ad67ab13 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0ca4764a-3588-493e-9d8a-b39a623e70ae tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13" status: 404 len: 111 microversion: 2.1 time: 0.034935 Aug 30 19:14:54.112057 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3619/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:54 2022] GET /compute/v2.1/servers/64403070-f64e-417b-853d-ccc5ad67ab13 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:14:54.114862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e7903a90-d7a1-41d4-a542-8f2f98ac40eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '.version_select at 0x7f4e447abb80>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:54.143430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e7903a90-d7a1-41d4-a542-8f2f98ac40eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2043860492" status: 202 len: 0 microversion: 2.1 time: 0.033097 Aug 30 19:14:54.144031 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3472/7091] 10.222.0.25 () {58 vars in 1278 bytes} [Tue Aug 30 19:14:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2043860492 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:14:54.163650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1846d262-f988-48eb-9c5d-4de7b6ca98ad tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: .version_select at 0x7f4e567e3e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1280458059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHoXecjh/cSal1oQ0gZYsRMx1CrQznHXbXjepxwC9E3T3xWSOevWOziLm+/QGGj8+XaFSGE2g2ZU9PllkaKZnw9LgDdCbFGghZ29NQcZZEXFSiRo4DELqdpdDJIwCNaIQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:54.184102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1846d262-f988-48eb-9c5d-4de7b6ca98ad tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:14:54.190617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1846d262-f988-48eb-9c5d-4de7b6ca98ad tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:14:54.219859 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1846d262-f988-48eb-9c5d-4de7b6ca98ad tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061052 Aug 30 19:14:54.220476 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3620/7092] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:14:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:54.277874 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-913393816", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1280458059", "networks": [{"uuid": "8d9245e0-a808-43df-97f1-72802d12bfd6"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:54.352087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] validate_networks() for [('8d9245e0-a808-43df-97f1-72802d12bfd6', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:14:54.874220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:14:54.874705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:14:54.875837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:14:54.875837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:14:54.876208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:14:54.885539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:54.886032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:54.886506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:54.887251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:54.887714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:54.888253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:54.905817 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:14:54.911385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:14:54.924649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:14:54.927050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:14:54.978771 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-67650d0e-c2cf-476f-96cc-056787dffa84 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704949 Aug 30 19:14:54.979402 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3473/7093] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:14:54.991080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a1febb12-938a-4456-86cc-1f881e208ffb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:54.991700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a1febb12-938a-4456-86cc-1f881e208ffb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:55.047025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a1febb12-938a-4456-86cc-1f881e208ffb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:55.055240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a1febb12-938a-4456-86cc-1f881e208ffb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1262 microversion: 2.1 time: 0.068274 Aug 30 19:14:55.056464 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3621/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:54 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:56.078653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:56.079248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:56.086301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:56.086816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:56.087306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:56.088033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:56.088480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:56.088962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:56.157654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:56.166408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68d43239-8980-4848-a74c-9bba98be078b tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1314 microversion: 2.1 time: 0.092759 Aug 30 19:14:56.167028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3474/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:56 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1314 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:57.188703 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:57.189998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:57.197166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:57.197653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:57.198100 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:57.198866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:57.199315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:57.199755 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:57.412084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:57.420250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e7278eab-298f-41e8-ad08-177555af3507 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.235698 Aug 30 19:14:57.434080 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3622/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:57 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:57.609490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d48d61-881a-4f1e-8852-559d8cdfcf65", "tag": "fd1f4c68-024b-4c42-8641-a7b0f1b5621e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:14:57.620771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:57.621397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:57.621936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:57.634188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] Creating event network-changed:fd1f4c68-024b-4c42-8641-a7b0f1b5621e for instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 on n-h2-854119-10 Aug 30 19:14:57.640017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-aaeae1f5-76d8-46a3-9cb8-2e2a65ce64fa req-aca55df4-bd3d-4257-b817-d7371ff9ac1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034646 Aug 30 19:14:57.640722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3475/7097] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:14:58.441989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:58.442599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:58.450301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:58.450866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:58.451302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:58.451996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:58.452446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:58.452861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:58.603765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:58.613117 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9109219b-5c12-4668-958f-f899c26d115a tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.175044 Aug 30 19:14:58.613709 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3623/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:58 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:14:59.635634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:14:59.636476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:14:59.643305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:59.643803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:59.644252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:59.644971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:14:59.645457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:14:59.645902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:14:59.791017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:14:59.802454 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1012be80-9e6f-4648-97f2-195d73bd1339 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.171774 Aug 30 19:14:59.803248 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3476/7099] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:14:59 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:00.824543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:00.825277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:00.832729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:00.833266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:00.833645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:00.834403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:00.834861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:00.835288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:00.969316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:00.977628 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7147c135-5c08-486d-8185-a11639b467b1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.157043 Aug 30 19:15:00.978181 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3624/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:00 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:02.000500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:02.001111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:02.008586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:02.009089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:02.009547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:02.010262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:02.010767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:02.011210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:02.162373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:02.170669 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d363735-3974-4781-96e4-556347cfe51c tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.175076 Aug 30 19:15:02.171249 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3477/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:01 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:02.756959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d48d61-881a-4f1e-8852-559d8cdfcf65", "name": "network-vif-plugged", "status": "completed", "tag": "fd1f4c68-024b-4c42-8641-a7b0f1b5621e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:02.769321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:02.769805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:02.770246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:02.781876 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] Creating event network-vif-plugged:fd1f4c68-024b-4c42-8641-a7b0f1b5621e for instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 on n-h2-854119-10 Aug 30 19:15:02.787192 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8934b14f-cd6f-475e-81bf-cb34385e37f7 req-a5e15598-2b79-425e-a491-3e8b3193ba3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Aug 30 19:15:02.787808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3625/7102] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:03.192609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:03.193221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:03.201471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:03.201984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:03.202580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:03.203304 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:03.203777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:03.204219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:03.358485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:03.366611 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d8b85bb-beb4-4181-b216-521f9ae636d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1362 microversion: 2.1 time: 0.177986 Aug 30 19:15:03.367188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3478/7103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:03 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:04.390459 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:04.391186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:04.398286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:04.398817 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:04.399281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:04.400005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:04.400473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:04.400910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:04.550317 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:04.562387 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39c15537-ff30-4b74-a745-2b360883b126 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1553 microversion: 2.1 time: 0.177946 Aug 30 19:15:04.563012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3626/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:04 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:04.584512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:04.585138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:04.592898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:04.593404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:04.593860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:04.594625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:04.595101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:04.595545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:04.743145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:04.755267 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28a8cb40-9523-4da5-a101-d94c26f73888 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1553 microversion: 2.1 time: 0.174428 Aug 30 19:15:04.755979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3479/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:04 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:06.300833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5b00e1a-f845-41b8-bede-cd59cb62a5ea"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:06.303229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:06.305234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:06.311929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:06.312415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:06.312842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:06.313544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:06.313995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:06.314457 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:06.616579 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a12e3798-0d83-4590-8248-47f5d1b82c31 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320044 Aug 30 19:15:06.617144 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3627/7106] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:15:06 2022] POST /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:17.367198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:17.367765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:17.369902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.370607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.371346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.372017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.378406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:17.378916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:17.379371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:17.380096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:17.380573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:17.381017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:17.474294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lazy-loading 'services' on Instance uuid 50d48d61-881a-4f1e-8852-559d8cdfcf65 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:15:17.561963 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-09d6101d-077a-4737-b8a3-c8fabca57fa8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments/a5b00e1a-f845-41b8-bede-cd59cb62a5ea" status: 202 len: 0 microversion: 2.1 time: 0.198712 Aug 30 19:15:17.562610 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3480/7107] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:15:17 2022] DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments/a5b00e1a-f845-41b8-bede-cd59cb62a5ea => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:15:17.569842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.570726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:17.575147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:17.577533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:17.586813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:17.587344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:17.587782 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:17.588493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:17.588939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:17.589377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:17.623752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7a3fe639-259b-40b4-82ac-1c2927d33886 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055738 Aug 30 19:15:17.624311 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3628/7108] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:17 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:18.639212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:18.641789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:18.648881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:18.649389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:18.649970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:18.650738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:18.651213 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:18.651683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:18.683978 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-936b0d93-d541-48ac-ad06-12310e9d8dbb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050191 Aug 30 19:15:18.684606 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3481/7109] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:18 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:19.696948 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:19.699217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:19.707195 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:19.707738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:19.708121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:19.708838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:19.709297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:19.709723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:19.743633 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-11967ec1-5ae0-48e1-a587-2355902e1ee7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050781 Aug 30 19:15:19.744219 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3629/7110] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:19 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:20.756623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:20.758957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:20.766496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:20.767007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:20.767478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:20.768235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:20.768718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:20.769164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:20.803024 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-763048f6-846e-417b-a896-2ee004c345b7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050626 Aug 30 19:15:20.803586 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3482/7111] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:20 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:21.815332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:21.817301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:21.824881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:21.825368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:21.825798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:21.826532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:21.826962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:21.827377 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:21.858255 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab838160-ed5b-4b55-890b-4c9fd6fb75b4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Aug 30 19:15:21.858850 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3630/7112] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:21 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:22.871199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:22.873527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:22.882044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:22.882501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:22.882959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:22.883681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:22.884155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:22.884594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:22.926610 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b6a859a9-8f1f-4d52-b893-0d952de3cf79 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059468 Aug 30 19:15:22.927211 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3483/7113] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:22 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 19:15:22.937797 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:22.938288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:22.945292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:22.945783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:22.946187 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:22.946897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:22.947353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:22.947762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:23.040978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 is not attached to volume a5b00e1a-f845-41b8-bede-cd59cb62a5ea Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments/a5b00e1a-f845-41b8-bede-cd59cb62a5ea HTTP/1.1 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 is not attached to volume a5b00e1a-f845-41b8-bede-cd59cb62a5ea Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '50d48d61-881a-4f1e-8852-559d8cdfcf65', 'id': 'a5b00e1a-f845-41b8-bede-cd59cb62a5ea'} Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a5b00e1a-f845-41b8-bede-cd59cb62a5ea. Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 is not attached to volume a5b00e1a-f845-41b8-bede-cd59cb62a5ea Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:23.042660 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 is not attached to volume a5b00e1a-f845-41b8-bede-cd59cb62a5ea Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 is not attached to volume a5b00e1a-f845-41b8-bede-cd59cb62a5ea {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dcef1c37-3769-47b0-bf27-62aac1e4058f tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments/a5b00e1a-f845-41b8-bede-cd59cb62a5ea" status: 404 len: 154 microversion: 2.1 time: 0.110351 Aug 30 19:15:23.046586 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3631/7114] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:15:22 2022] DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65/os-volume_attachments/a5b00e1a-f845-41b8-bede-cd59cb62a5ea => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:15:26.414017 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:26.414633 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:26.422434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:26.422985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:26.423438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:26.424420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:26.424901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:26.425425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:26.452695 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:15:26.546116 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e6403a7f-85f3-46da-9e72-373e8c222049 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 204 len: 0 microversion: 2.1 time: 0.135580 Aug 30 19:15:26.547720 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3484/7115] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:15:26 2022] DELETE /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 19:15:26.556544 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:26.557815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:26.574107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:26.574636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:26.575074 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:26.575789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:26.576238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:26.576853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:26.723539 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:26.732263 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bbe40184-baab-4665-a6ba-5f9c3ba76bc7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1559 microversion: 2.1 time: 0.179729 Aug 30 19:15:26.732913 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3632/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:26 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:27.754748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:27.755485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:27.762978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:27.763470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:27.763918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:27.764675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:27.765148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:27.765582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:27.902739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:27.910725 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c41ec88d-dc1e-413f-b6cc-eb2a7458eff3 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1559 microversion: 2.1 time: 0.160287 Aug 30 19:15:27.911276 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3485/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:27 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:28.833576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d48d61-881a-4f1e-8852-559d8cdfcf65", "name": "network-vif-deleted", "tag": "fd1f4c68-024b-4c42-8641-a7b0f1b5621e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:28.845664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:28.846558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:28.847229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:28.859601 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] Creating event network-vif-deleted:fd1f4c68-024b-4c42-8641-a7b0f1b5621e for instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 on n-h2-854119-10 Aug 30 19:15:28.865250 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4dce8502-4739-4974-83da-14696ad2dee2 req-96d72513-737c-4f19-b5db-7e8a8a695e3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036143 Aug 30 19:15:28.866166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3633/7118] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:15:28.932866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:28.933663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:28.941625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:28.942135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:28.942610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:28.943349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:28.943838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:28.944265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:28.978046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:28.978604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:28.979054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:28.979521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lazy-loading 'fault' on Instance uuid 50d48d61-881a-4f1e-8852-559d8cdfcf65 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:15:29.023670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:29.032105 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-70521898-06e7-4f6a-b2ea-94b690531f2e tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 200 len: 1352 microversion: 2.1 time: 0.103188 Aug 30 19:15:29.032700 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3486/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:28 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:15:30.055510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:30.056104 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: 50d48d61-881a-4f1e-8852-559d8cdfcf65] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:30.063072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:30.063554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:30.063990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:30.064720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:30.065155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:30.065578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:30.079389 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 HTTP/1.1 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '50d48d61-881a-4f1e-8852-559d8cdfcf65'} Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:30.081269 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance 50d48d61-881a-4f1e-8852-559d8cdfcf65 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa16c6d6-20c0-4111-9897-fe09721134d7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65" status: 404 len: 111 microversion: 2.1 time: 0.032609 Aug 30 19:15:30.085699 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3634/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:30 2022] GET /compute/v2.1/servers/50d48d61-881a-4f1e-8852-559d8cdfcf65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:15:30.092138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6fc40824-98e6-4475-a783-2521d5e3a360 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '.version_select at 0x7f4e447f4670>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:30.115517 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6fc40824-98e6-4475-a783-2521d5e3a360 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1280458059" status: 202 len: 0 microversion: 2.1 time: 0.027647 Aug 30 19:15:30.116099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3487/7121] 10.222.0.25 () {58 vars in 1278 bytes} [Tue Aug 30 19:15:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1280458059 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:15:30.131445 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e4448332-6a2c-4fe3-aac4-dec27eeeba10 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: .version_select at 0x7f4e56aefee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1576461328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFP4/BZQR+54/OGI0uhDueZtaD8eInrOE03eJLlBgD99jM1hjPlorKoD9buchTUru8f7lUwU2VmDwDlANIK/o1JSPNEwjHXBz3pTba5s8uMeppp5ab3YVp3y/1pobVbOQ=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:30.147285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e4448332-6a2c-4fe3-aac4-dec27eeeba10 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:15:30.152686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-e4448332-6a2c-4fe3-aac4-dec27eeeba10 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:15:30.180127 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e4448332-6a2c-4fe3-aac4-dec27eeeba10 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053056 Aug 30 19:15:30.180771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3635/7122] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:15:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:30.230824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1258513530", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1576461328", "networks": [{"uuid": "8d9245e0-a808-43df-97f1-72802d12bfd6"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:30.290974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] validate_networks() for [('8d9245e0-a808-43df-97f1-72802d12bfd6', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:15:30.715438 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:15:30.716173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:15:30.716953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:15:30.717637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:15:30.718246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:15:30.732302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:30.733088 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:30.733819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:30.735029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:30.735742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:30.736524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:30.754963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:15:30.760576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Getting quotas for user 8d1823414f374a4fb8a336279dc7986c and project 6bfaeec3c6214f3aa3d9d5107b6d274b. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:15:30.774565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:15:30.776953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:15:30.827876 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-22521924-2c81-4937-b329-31e3444adc5d tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601032 Aug 30 19:15:30.828651 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3488/7123] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:15:30.840498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-95f73019-06d6-42db-aafa-6fd472056e03 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:30.841430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-95f73019-06d6-42db-aafa-6fd472056e03 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:30.915424 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-95f73019-06d6-42db-aafa-6fd472056e03 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:30.924249 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-95f73019-06d6-42db-aafa-6fd472056e03 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1263 microversion: 2.1 time: 0.087877 Aug 30 19:15:30.924814 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3636/7124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:30 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:15:31.946465 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:31.947140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:31.957071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:31.957582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:31.958338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:31.959098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:31.959589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:31.960032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:32.026171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:32.035029 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0da4881a-5839-4702-bb26-b74bb0bc7000 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1323 microversion: 2.1 time: 0.093975 Aug 30 19:15:32.035649 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3489/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:31 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:33.057605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:33.058669 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:33.071110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:33.071911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:33.072694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:33.073895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:33.074752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:33.075495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:33.328794 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:33.336965 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e0703c52-ee6a-43e6-8daf-178c277e5894 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.283967 Aug 30 19:15:33.337568 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3637/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:33 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:33.422940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a3dc4a-323e-47fa-9da2-f8236c59e1a7", "tag": "1108b30c-fd80-4bd8-af02-045df418ba03"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:33.436507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:33.437080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:33.437599 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:33.452821 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] Creating event network-changed:1108b30c-fd80-4bd8-af02-045df418ba03 for instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 on n-h2-854119-10 Aug 30 19:15:33.459237 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2648df55-e857-4ccc-8a94-e6fe8ef6813e req-6fb56964-a7bf-4fac-bb4f-38bd5e12a36e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040785 Aug 30 19:15:33.460311 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3490/7127] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:34.359432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:34.360044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:34.367558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:34.368051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:34.368489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:34.369198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:34.369655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:34.370085 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:34.514027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:34.527741 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a577df84-e681-47e9-bab2-4479c2505050 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.172052 Aug 30 19:15:34.528662 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3638/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:34 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:35.553410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:35.554042 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:35.560761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:35.561266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:35.561716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:35.562460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:35.562935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:35.563369 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:35.708250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:35.716361 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4be35548-18c0-4fa9-aa03-4c052bff39b8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.169175 Aug 30 19:15:35.716996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3491/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:35 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:36.738233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:36.738894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:36.746543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:36.747041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:36.747474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:36.748196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:36.748643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:36.749068 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:36.892541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:36.900662 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-08d072b8-9604-45c3-982f-059f7014ebab tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.166760 Aug 30 19:15:36.901391 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3639/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:36 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:37.922293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:37.922964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:37.930527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:37.931034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:37.931481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:37.932188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:37.932653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:37.933086 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:38.070993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:38.082144 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0e58c25-4ca6-423f-b1a6-0f7e6ce2d3eb tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.164130 Aug 30 19:15:38.082790 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3492/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:37 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:38.821017 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a3dc4a-323e-47fa-9da2-f8236c59e1a7", "name": "network-vif-plugged", "status": "completed", "tag": "1108b30c-fd80-4bd8-af02-045df418ba03"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:38.834204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:38.835206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:38.835548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:38.848334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] Creating event network-vif-plugged:1108b30c-fd80-4bd8-af02-045df418ba03 for instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 on n-h2-854119-10 Aug 30 19:15:38.853761 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-6f82c9c4-6f1a-49d6-9663-262dbcbffe9a req-10eade76-4824-40a5-bdcb-e31da361d9db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Aug 30 19:15:38.854860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3640/7132] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:39.103985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:39.104592 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:39.111584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:39.112083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:39.112536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:39.113260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:39.113732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:39.114175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:39.256204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:39.264462 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-21a3540c-4218-4aa1-b67a-da4307b9e720 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1363 microversion: 2.1 time: 0.164515 Aug 30 19:15:39.265013 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3493/7133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:39 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:40.290386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:40.291218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:40.302069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:40.302605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:40.303054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:40.303767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:40.304228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:40.304659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:40.451636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:40.461271 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f1816182-96c9-47e1-804c-1aefad248447 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1555 microversion: 2.1 time: 0.178752 Aug 30 19:15:40.461812 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3641/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:40 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:40.483757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:40.483757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:40.491077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:40.491569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:40.492034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:40.492754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:40.493263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:40.493649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:40.631529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:15:40.649833 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6bca83e2-cae9-40a3-96bf-f6e1988649f4 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1555 microversion: 2.1 time: 0.171196 Aug 30 19:15:40.650964 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3494/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:15:40 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:15:42.199691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16e0ab0e-7a62-42c0-a2af-1aea2880a7d9"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:15:42.203314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:42.206286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:42.215107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:42.215825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:42.216497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:42.217528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:42.217975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:42.218590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:42.522884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e8d4f9be-e906-4e74-b38a-2246309a8fa9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "POST /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329830 Aug 30 19:15:42.523539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3642/7136] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:15:42 2022] POST /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:53.255891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:53.256460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:53.258604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.259610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.260401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.261061 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.267410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:53.267911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:53.268363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:53.269084 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:53.269551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:53.269991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:53.359344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lazy-loading 'services' on Instance uuid a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:15:53.439442 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8adb1590-21a4-4ec7-873e-bc956752bbf9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments/16e0ab0e-7a62-42c0-a2af-1aea2880a7d9" status: 202 len: 0 microversion: 2.1 time: 0.187737 Aug 30 19:15:53.440099 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3495/7137] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:15:53 2022] DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments/16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:15:53.447581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.448849 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:15:53.453863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:53.457061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:53.466779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:53.467359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:53.467864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:53.468656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:53.469201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:53.469629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:53.504259 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a81ade81-6de2-4913-a7c8-59f2daafbbbe tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058823 Aug 30 19:15:53.504748 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3643/7138] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:53 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:54.518952 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:54.521352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:54.528198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:54.528678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:54.529135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:54.529851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:54.530315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:54.530774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:54.565534 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6f04d393-fc98-4d21-9775-b4b26999ced1 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052392 Aug 30 19:15:54.566157 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3496/7139] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:54 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:55.577929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:55.580430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:55.589748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:55.590261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:55.590763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:55.591548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:55.591987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:55.592513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:55.630564 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4b12ce21-f47e-4af0-92c9-4b002f703859 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056932 Aug 30 19:15:55.631660 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3644/7140] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:55 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:56.644590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:56.646858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:56.654303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:56.654843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:56.655289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:56.656005 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:56.656464 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:56.656900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:56.689958 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a0889ae6-bcca-49aa-ad67-83712f18c899 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050421 Aug 30 19:15:56.690812 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3497/7141] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:56 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:57.703018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:57.705756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:57.713326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:57.713820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:57.714260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:57.715019 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:57.715479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:57.715910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:57.748150 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-730f26c0-9a43-483c-9edf-e3ccc82c1ba9 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Aug 30 19:15:57.748583 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3645/7142] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:57 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:15:58.763958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:58.767844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:58.778064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:58.778626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:58.779082 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:58.779820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:58.780297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:58.780735 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:58.814324 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36e50f6d-0183-412e-bcd7-31990c43e519 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056495 Aug 30 19:15:58.815326 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3498/7143] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:15:58 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 19:15:58.828102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:15:58.828728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:15:58.836736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:58.837227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:58.837665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:58.838379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:15:58.838835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:15:58.839260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:15:58.924908 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 is not attached to volume 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments/16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 HTTP/1.1 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 is not attached to volume 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': 'a8a3dc4a-323e-47fa-9da2-f8236c59e1a7', 'id': '16e0ab0e-7a62-42c0-a2af-1aea2880a7d9'} Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9. Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 is not attached to volume 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:15:58.926582 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 is not attached to volume 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 is not attached to volume 16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d3e5d5a0-5e62-42c0-81f5-0c45caa328f8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments/16e0ab0e-7a62-42c0-a2af-1aea2880a7d9" status: 404 len: 154 microversion: 2.1 time: 0.104491 Aug 30 19:15:58.930825 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3646/7144] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:15:58 2022] DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7/os-volume_attachments/16e0ab0e-7a62-42c0-a2af-1aea2880a7d9 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:16:02.286439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:02.287025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:02.294133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:02.294675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:02.295143 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:02.295850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:02.296312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:02.296746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:02.323360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:16:02.412840 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e357da31-a366-413f-8ff8-bc270b567bf6 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 204 len: 0 microversion: 2.1 time: 0.130087 Aug 30 19:16:02.413766 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3499/7145] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:16:02 2022] DELETE /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:16:02.423197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:02.424045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:02.432422 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:02.433094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:02.433667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:02.434491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:02.435028 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:02.435513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:02.575592 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:02.583937 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6616d7cf-c252-4128-9bd0-bd3538618dd7 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1561 microversion: 2.1 time: 0.165688 Aug 30 19:16:02.584575 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3647/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:02 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:03.609658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:03.610409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:03.622245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:03.623041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:03.623623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:03.624645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:03.625259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:03.625940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:03.776411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:03.784807 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-01e88d5a-bdea-449f-ba1b-14a1de0598dd tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1561 microversion: 2.1 time: 0.181503 Aug 30 19:16:03.785412 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3500/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:03 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:04.655033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a3dc4a-323e-47fa-9da2-f8236c59e1a7", "name": "network-vif-deleted", "tag": "1108b30c-fd80-4bd8-af02-045df418ba03"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:04.667300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:04.667786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:04.668219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:04.682101 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] Creating event network-vif-deleted:1108b30c-fd80-4bd8-af02-045df418ba03 for instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 on n-h2-854119-10 Aug 30 19:16:04.687552 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1f555bb5-9faf-4717-adb8-df8a6189ac3e req-2fd5d480-6c85-4bf6-9c33-78777755af9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 Aug 30 19:16:04.692059 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3648/7148] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:16:04.811525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:04.812677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:04.824995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:04.825796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:04.830898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:04.831904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:04.832452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:04.832941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:04.870880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:04.871484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:04.871825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:04.872316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lazy-loading 'fault' on Instance uuid a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:16:04.915306 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1823414f374a4fb8a336279dc7986c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfaeec3c6214f3aa3d9d5107b6d274b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:04.924163 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-48330256-e852-4712-b6a6-6a17879704d8 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 200 len: 1353 microversion: 2.1 time: 0.121199 Aug 30 19:16:04.924781 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3501/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:04 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 1353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:05.947147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:05.947846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] [instance: a8a3dc4a-323e-47fa-9da2-f8236c59e1a7] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:05.955381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:05.955888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:05.956321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:05.957026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:05.957477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:05.957914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:05.973073 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] HTTP exception thrown: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Request method failure captured: Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 HTTP/1.1 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmGDeToWppSgtUbP9Qtd5xTSYy6BqFFW0pMfzXJvfUEtXIka3K-Q57lKkn1wSA-EcJSJLAI5EDqfVgZT42jL6u3nfM4F56J2hNj9Pcr27ie5W9UVR3IP7gFKHLxbQptIenOKWaYuiQUKd-hJjNtr4XKvv0QCo3WPBtAmxat5dpAkT_I Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bfaeec3c6214f3aa3d9d5107b6d274b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 6bfaeec3c6214f3aa3d9d5107b6d274b Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1223480856 Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 8d1823414f374a4fb8a336279dc7986c Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestEncryptedCinderVolumes-1223480856-project Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'a8a3dc4a-323e-47fa-9da2-f8236c59e1a7'} Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:16:05.974777 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Returning 404 to user: Instance a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-25806309-4268-4c8e-a2c1-62c701767426 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7" status: 404 len: 111 microversion: 2.1 time: 0.034350 Aug 30 19:16:05.979240 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3649/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:05 2022] GET /compute/v2.1/servers/a8a3dc4a-323e-47fa-9da2-f8236c59e1a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:16:05.985322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-255c4f37-0aab-4f68-8b61-f107e48df287 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] Calling method '.version_select at 0x7f4e55c8e5e0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:06.008559 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-255c4f37-0aab-4f68-8b61-f107e48df287 tempest-TestEncryptedCinderVolumes-1223480856 tempest-TestEncryptedCinderVolumes-1223480856-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1576461328" status: 202 len: 0 microversion: 2.1 time: 0.027114 Aug 30 19:16:06.009117 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3502/7151] 10.222.0.25 () {58 vars in 1278 bytes} [Tue Aug 30 19:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1576461328 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 19:16:33.579713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdff49f6-1cd3-41fb-9ff4-6ed8a06eaafb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: .version_select at 0x7f4e569a6af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1542411729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeRToGrDc2d/VYihj3Rycly3aBR9owoDGXZN8yy7w5t6LGlWfnlay+3yvcHPGV7pCkggjKlnZJo3rVs/1w37ButVrvQzzZfzCmJErpfs7pSLi7Kakv0EstjstZdk8iWhg=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:33.586151 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 19:16:33.587533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:33.588194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=34 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:33.602569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cdff49f6-1cd3-41fb-9ff4-6ed8a06eaafb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for project 36b54ee3d151449385890093ec18f539. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:16:33.608038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-cdff49f6-1cd3-41fb-9ff4-6ed8a06eaafb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for user 64ee4e46e10c47609ba89bd2d92da1f1 and project 36b54ee3d151449385890093ec18f539. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:16:33.634457 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdff49f6-1cd3-41fb-9ff4-6ed8a06eaafb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059223 Aug 30 19:16:33.635085 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3650/7152] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:16:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:16:33.686893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:33.687737 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:33.692156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1981820739", "imageRef": "77e5cdb2-5919-4f05-9558-fb5a3c1fd87a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1542411729", "networks": [{"uuid": "282f9ca5-ce82-4cb2-bd5e-210dd58cde9e"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:33.747014 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] validate_networks() for [('282f9ca5-ce82-4cb2-bd5e-210dd58cde9e', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:16:34.184295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:16:34.184714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:16:34.185210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:16:34.185688 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:16:34.186038 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:16:34.195957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:34.196484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:34.197241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:34.197997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:34.198504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:34.198950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:34.216230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for project 36b54ee3d151449385890093ec18f539. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:16:34.221950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for user 64ee4e46e10c47609ba89bd2d92da1f1 and project 36b54ee3d151449385890093ec18f539. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:16:34.235071 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:16:34.237160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77e5cdb2-5919-4f05-9558-fb5a3c1fd87a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:16:34.290325 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1b1f89a-4ec9-4595-9e32-a380fdb54ddd tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605412 Aug 30 19:16:34.290930 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3503/7153] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:16:34.302481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-973b8ec0-cad5-45c2-9ebc-ba738c4c7a14 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:34.303093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-973b8ec0-cad5-45c2-9ebc-ba738c4c7a14 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:34.359387 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-973b8ec0-cad5-45c2-9ebc-ba738c4c7a14 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:34.366725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-973b8ec0-cad5-45c2-9ebc-ba738c4c7a14 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1259 microversion: 2.1 time: 0.068375 Aug 30 19:16:34.367310 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3651/7154] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:34 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:35.389414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:35.391044 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:35.399950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:35.400463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:35.400911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:35.401625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:35.402297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:35.402766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:35.487749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:35.496336 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-344953f9-54ae-4fc5-9058-f608506de177 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1319 microversion: 2.1 time: 0.112215 Aug 30 19:16:35.496980 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3504/7155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:35 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:36.521128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:36.522227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:36.531549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:36.532453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:36.533119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:36.534077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:36.534790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:36.535359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:36.673932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:36.681710 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-806b00e6-22fc-4ec3-b5da-971936873d42 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.165973 Aug 30 19:16:36.682290 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3652/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:36 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:37.704357 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:37.704895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:37.712045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:37.712563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:37.712983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:37.713698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:37.714163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:37.714638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:37.872649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:37.881077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d6dd223-283f-48d6-882d-ee999d28acf4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.181145 Aug 30 19:16:37.881628 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3505/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:37 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:38.902668 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:38.903297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:38.910679 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:38.911168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:38.911604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:38.912311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:38.912764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:38.913185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:39.075660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:39.083817 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a314d003-c672-430f-825d-f6b1f5eb8a73 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.185083 Aug 30 19:16:39.084396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3653/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:38 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:40.105476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:40.106780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:40.122630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:40.123463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:40.123920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:40.124791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:40.125253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:40.125696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:40.279977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:40.288583 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4425123f-de9b-4b02-9998-bd9760174b5e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.187077 Aug 30 19:16:40.289200 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3506/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:40 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:41.311841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:41.313140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:41.322065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:41.322955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:41.323892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:41.325181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:41.326009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:41.326786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:41.498891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:41.508217 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1e98e3b-0a8a-47ab-b908-e73d22d915ab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.202022 Aug 30 19:16:41.508985 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3654/7160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:41 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:42.534163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:42.534976 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:42.542679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:42.543525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:42.544202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:42.545300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:42.546126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:42.547136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:42.705523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:42.713905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6649a2f0-d045-4c62-9418-7b2436290ff7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.184409 Aug 30 19:16:42.714540 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3507/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:42 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:43.736602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:43.737255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:43.744874 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:43.745358 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:43.745800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:43.746534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:43.746992 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:43.747416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:43.895040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:43.906578 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-feac0f0d-3e86-4682-8362-a5ba6ae03efc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.174876 Aug 30 19:16:43.907389 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3655/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:43 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:44.929666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:44.930251 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:44.933027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:44.933746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:44.940063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:44.940570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:44.941020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:44.941751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:44.942221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:44.942771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:45.148133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:45.156485 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-079f14aa-2ee4-4d65-b400-331bdb156d6a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.230946 Aug 30 19:16:45.157209 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3508/7163] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:44 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:45.667737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:45.675943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:16:45.684061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:45.684866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:45.685428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:45.700327 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] Creating event network-changed:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:16:45.709782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-14948f67-da78-4f73-8b5e-257af0f1b97e req-20a3ee4d-8f25-4062-bd69-2a87a80cfc67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045736 Aug 30 19:16:45.711047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3656/7164] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:16:46.178367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:46.178995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:46.186298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:46.186838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:46.187404 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:46.188273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:46.188753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:46.189204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:46.341793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:46.350916 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82ff99c8-12dd-495a-ad46-23f8ee21cfb5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.176646 Aug 30 19:16:46.351511 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3509/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:46 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:47.373869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:47.374822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:47.381692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:47.382194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:47.382661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:47.383381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:47.383839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:47.384270 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:47.521965 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:47.530477 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bc1361fd-ad09-49c7-98c7-89062a446df1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.161756 Aug 30 19:16:47.531093 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3657/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:47 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:48.558938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:48.559566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:48.567354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:48.567856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:48.568310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:48.569411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:48.569859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:48.570331 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:48.722663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:48.730868 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-979dbaa7-7f21-4ce1-a0ea-310e9fee84e7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.175840 Aug 30 19:16:48.731579 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3510/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:48 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:49.752616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:49.753173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:49.760637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:49.761117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:49.761548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:49.762267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:49.762750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:49.763174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:49.900656 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:49.909403 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43315505-2fe9-4e06-9961-a88220404ef1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.160840 Aug 30 19:16:49.909981 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3658/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:49 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:50.856455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "name": "network-vif-plugged", "status": "completed", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:50.870994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:50.871614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:50.872280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:50.884712 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] Creating event network-vif-plugged:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:16:50.890022 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-41e228e5-b21c-4eef-93a7-7db5f836e812 req-fe066899-bc1e-4cc4-9bb3-887ee7711dd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037389 Aug 30 19:16:50.897883 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3511/7169] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:16:50.930044 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:50.930674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:50.937939 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:50.938462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:50.938918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:50.939622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:50.940087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:50.940519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:51.082857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:51.090890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fa6b0c2a-d779-42f7-8b04-07546a5eda0a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1359 microversion: 2.1 time: 0.165151 Aug 30 19:16:51.091501 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3659/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:50 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:52.113865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:52.114610 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:52.121550 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.121982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.122469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.123243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.123675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.124103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.266111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:52.278643 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a4eab11-4909-4b8a-b1e2-98d595e87d56 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1549 microversion: 2.1 time: 0.169832 Aug 30 19:16:52.279924 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3512/7171] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:52 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:52.301045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:52.301670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:52.309305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.309812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.310249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.310971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.311426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.311840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.452537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:52.463800 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cd270126-54a2-4376-974b-11740813c66c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1549 microversion: 2.1 time: 0.166917 Aug 30 19:16:52.464416 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3660/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:52 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:52.485096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:52.489894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:52.490714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Searching by: {'deleted': False, 'project_id': '36b54ee3d151449385890093ec18f539'} {{(pid=122590) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 19:16:52.496603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.497140 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.497551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.498291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.498824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.499271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.531241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.multi_cell_list [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 19:16:52.571600 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-865e74e1-ddc1-4e8a-9fa2-0c020bedfe63 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.090127 Aug 30 19:16:52.572497 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3513/7173] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 19:16:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:16:52.584200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:16:52.584835 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:52.591102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.591583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.592011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.592730 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:52.593163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:52.593577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:52.738886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:16:52.750664 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-986d10a6-ee3c-46fa-b386-1574e38d5b33 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1549 microversion: 2.1 time: 0.170180 Aug 30 19:16:52.751403 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3661/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:16:52 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:16:54.367411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a449249-5c09-4781-b4bd-7a3f72c2528a"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:16:54.369846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:16:54.377348 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:54.377844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:54.378295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:54.379040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:16:54.379502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:16:54.379938 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:16:54.672795 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c7f2d3bf-9d91-45f9-b57b-b20527b25509 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308225 Aug 30 19:16:54.673308 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3514/7175] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:16:54 2022] POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:17:07.822651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:17:07.823234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:17:07.826241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:17:07.826881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=56 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:17:07.832763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:07.833258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:07.833704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:07.834439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:07.834897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:07.835325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:07.976228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:17:07.988854 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8d6dcbf-f8f9-41b5-872a-71c25f7c2dde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1595 microversion: 2.1 time: 0.169963 Aug 30 19:17:07.989775 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3662/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:17:07 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:17:10.304585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:17:10.312166 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:17:10.313313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:17:10.314150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:17:10.319934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:10.320518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:10.321035 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:10.335876 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] Creating event network-changed:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:17:10.341898 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6cfad204-5f3a-4dfd-8f8c-94f57594ec5a req-c7cf8c01-caf1-4fa5-889b-3d14489c8934 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041312 Aug 30 19:17:10.343123 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3515/7177] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:17:11.481029 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-663767641"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:17:11.481609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:17:11.493027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:11.493522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:11.493972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:11.494759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:11.495197 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:11.495626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:11.635175 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Adding security group 56fd20c7-ee7c-47a2-8971-691a0cbb3b20 to port aaf86229-131b-4b43-857a-450e18069115 Aug 30 19:17:11.982970 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-582800c6-7eca-41eb-bb49-5fc00720ad47 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action" status: 202 len: 0 microversion: 2.1 time: 0.506280 Aug 30 19:17:11.983666 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3663/7178] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:17:11 2022] POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:17:11.992827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:17:11.993545 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:17:12.003362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:17:12.012708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:12.013499 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:12.014136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:12.015112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:12.015782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:12.016229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:12.024779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:17:12.025305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:17:12.025707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:17:12.050971 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] Creating event network-changed:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:17:12.059167 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3e3b1f41-e146-4bc1-91f5-b0bf4455ab28 req-2a439092-160a-4ed3-bcdf-f4c366f1f9d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059427 Aug 30 19:17:12.059771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3664/7179] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:17:12.290228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:17:12.309681 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07c798c8-7f64-48a8-ad5f-88e510aac206 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1760 microversion: 2.1 time: 0.321043 Aug 30 19:17:12.310311 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3516/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:17:11 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1760 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:18:50.320410 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:18:50.321599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:18:50.322321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:18:50.323466 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:18:50.323700 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action (ip 10.222.0.25) !!! Aug 30 19:18:50.325438 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:18:50.325558 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action (ip 10.222.0.25) !!! Aug 30 19:18:50.332575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:18:50.334919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:18:50.344519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:50.345008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:50.345446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:50.346230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:50.346713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:50.347146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:50.425935 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0485dbae-65d2-4aba-be98-3d03e82484a0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action" status: 202 len: 0 microversion: 2.1 time: 0.107156 Aug 30 19:18:50.426617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3665/7181] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:18:50 2022] POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:18:50.433430 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:18:50.434400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:18:50.435164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:18:50.436836 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:18:50.437091 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 (ip 10.222.0.25) !!! Aug 30 19:18:50.445118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:18:50.445798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:18:50.459712 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:50.460205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:50.460653 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:50.461376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:50.461842 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:50.462313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:50.840771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:18:50.849864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8c3a2930-8d1c-47b7-8681-00eae2e05a3d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1762 microversion: 2.1 time: 0.418352 Aug 30 19:18:50.850496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3517/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:18:50 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1762 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:18:51.875401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:18:51.876157 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:18:51.884566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:51.885027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:51.885522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:51.886710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:51.887443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:51.887845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:51.892357 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34074. Aug 30 19:18:52.102607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:18:52.111590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-58f7e045-a1b6-4599-8d39-e98afd434113 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1767 microversion: 2.1 time: 0.243433 Aug 30 19:18:52.112156 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3666/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:18:51 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1767 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:18:53.133666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:18:53.134245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:18:53.143195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:53.143698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:53.144138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:53.144850 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:18:53.145313 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:18:53.145754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:18:53.151981 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34082. Aug 30 19:18:53.297602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:18:53.306801 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2e48ead6-ea7e-485f-bba2-c907ae97b914 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1760 microversion: 2.1 time: 0.177200 Aug 30 19:18:53.307382 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3518/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:18:53 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:07.353553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:07.354277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:07.358533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-663767641"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:07.359062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:07.366435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:07.366919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:07.367349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:07.368033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:07.368481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:07.368892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:07.517838 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Removing security group 56fd20c7-ee7c-47a2-8971-691a0cbb3b20 from port aaf86229-131b-4b43-857a-450e18069115 Aug 30 19:20:07.857493 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9e4ab6d-e8f6-406e-b219-89807471c145 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action" status: 202 len: 0 microversion: 2.1 time: 0.505815 Aug 30 19:20:07.862589 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3667/7185] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:20:07 2022] POST /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:20:07.865329 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:07.866253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:07.973153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:07.984176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:07.985085 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:07.985414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:07.997812 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] Creating event network-changed:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:20:08.001665 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] [eebdd681-5ccd-4a1d-8718-5f793cf2347f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:20:09.010199 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] [eebdd681-5ccd-4a1d-8718-5f793cf2347f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34132. Aug 30 19:20:09.018168 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-c09e1ddd-2c48-4f20-a2c2-4a184d47049e req-dc34941d-6397-4899-bfa0-d4e5bd3364fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.155554 Aug 30 19:20:09.019468 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3519/7186] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:09.054645 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:09.056462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:09.075601 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:09.076178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:09.076643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:09.077447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:09.078029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:09.078862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:09.092203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:09.106118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:09.106736 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:09.107430 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:09.125205 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] Creating event network-changed:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:20:09.131720 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e3ea6cc5-7588-4a0b-85c6-29610ac42fee req-7d7225e2-416e-4d99-a987-15e08a7dce39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141987 Aug 30 19:20:09.133038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3668/7187] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:09.183386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lazy-loading 'services' on Instance uuid 638d76f8-afc1-4740-b428-5ac1ed1999d1 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:20:09.262547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7ef3bfa9-2a41-4118-a5a4-9b7773ac1095 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments/8a449249-5c09-4781-b4bd-7a3f72c2528a" status: 202 len: 0 microversion: 2.1 time: 0.217179 Aug 30 19:20:09.263615 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3520/7188] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:20:09 2022] DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments/8a449249-5c09-4781-b4bd-7a3f72c2528a => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:20:09.273238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:09.276039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:09.283284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:09.286196 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:09.287435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:09.288632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:09.290027 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:09.291090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:09.328685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-415df890-332d-4ea5-9ce2-9e6a541b7ed1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060131 Aug 30 19:20:09.329842 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3669/7189] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:09 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:10.345048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:10.348216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:10.354539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:10.355013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:10.355671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:10.356411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:10.357045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:10.357701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:10.391283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c14c16c3-2e29-4a4c-a18f-9c7a4ebc64d0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053069 Aug 30 19:20:10.396778 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3521/7190] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:10 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:20:11.404792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:11.407072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:11.414673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:11.415178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:11.415620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:11.416345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:11.417172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:11.417660 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:11.451626 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-23411ff3-7329-4f8e-bb2f-80e7e93c290a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051052 Aug 30 19:20:11.452219 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3670/7191] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:11 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:12.464738 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:12.467156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:12.474527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:12.475025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:12.475476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:12.476236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:12.476705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:12.477145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:12.511045 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-caad23d8-3e4a-42ff-a28d-2bb7e4025bcf tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050736 Aug 30 19:20:12.511646 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3522/7192] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:12 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:13.523244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:13.525819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:13.533364 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:13.533967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:13.534509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:13.535591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:13.535886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:13.536378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:13.573415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b3b3ffbc-029f-432a-9bfc-500649f4495f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054156 Aug 30 19:20:13.573970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3671/7193] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:13 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:14.587581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:14.589837 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:14.597395 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:14.597904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:14.598387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:14.599116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:14.599588 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:14.600031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:14.629875 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cecc4efd-5efb-4ac7-abb8-16a963b72042 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046519 Aug 30 19:20:14.630474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3523/7194] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:20:14 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 19:20:14.646493 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:14.647039 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:14.654215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:14.654751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:14.655193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:14.655897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:14.656356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:14.656786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:14.735368 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] HTTP exception thrown: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 is not attached to volume 8a449249-5c09-4781-b4bd-7a3f72c2528a Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Request method failure captured: Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: request: DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments/8a449249-5c09-4781-b4bd-7a3f72c2528a HTTP/1.1 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmICQImKqc3uHTMVNHebIRSoy32unzKDBZHoMpJ491qYmP5-sNn6cwN1KgNrw6--wdeIUu71wONWVuYnvK-yfO-SLlAXDQ7m6cavFaD2Q4l4kftnb4f9nnBH0yE_G1IT6n4eUbf3zV7Sb4Rg31jFXyWV9RblJ7Xr_aRKpZOVW3T_T2w Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36b54ee3d151449385890093ec18f539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36b54ee3d151449385890093ec18f539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 64ee4e46e10c47609ba89bd2d92da1f1 Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 is not attached to volume 8a449249-5c09-4781-b4bd-7a3f72c2528a Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'server_id': '638d76f8-afc1-4740-b428-5ac1ed1999d1', 'id': '8a449249-5c09-4781-b4bd-7a3f72c2528a'} Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8a449249-5c09-4781-b4bd-7a3f72c2528a. Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 is not attached to volume 8a449249-5c09-4781-b4bd-7a3f72c2528a Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:20:14.737020 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 is not attached to volume 8a449249-5c09-4781-b4bd-7a3f72c2528a Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Returning 404 to user: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 is not attached to volume 8a449249-5c09-4781-b4bd-7a3f72c2528a {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-41d505b4-ad64-4e15-aa0f-1c0e7477a0bc tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments/8a449249-5c09-4781-b4bd-7a3f72c2528a" status: 404 len: 154 microversion: 2.1 time: 0.098835 Aug 30 19:20:14.742012 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3672/7195] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:20:14 2022] DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1/os-volume_attachments/8a449249-5c09-4781-b4bd-7a3f72c2528a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 19:20:18.004231 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:18.004812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:18.012299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:18.012814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:18.013266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:18.014002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:18.014513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:18.014961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:18.042117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:20:18.126841 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ea4e74dc-b058-4fba-92d0-26acdb477822 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 204 len: 0 microversion: 2.1 time: 0.126275 Aug 30 19:20:18.127371 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3524/7196] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:20:17 2022] DELETE /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:20:18.136159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:18.136756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:18.146380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:18.146894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:18.147770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:18.148064 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:18.148515 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:18.148943 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:18.293150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:18.307884 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bd10e8a6-e966-4bcd-883b-5dc46e5f45a4 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1555 microversion: 2.1 time: 0.175632 Aug 30 19:20:18.308473 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3673/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:18 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:19.330508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:19.331288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:19.338823 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:19.339255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:19.339848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:19.340434 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:19.340907 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:19.341355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:19.487108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:19.495493 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2d54cb8b-f205-46f1-826a-2f9526ca3161 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1555 microversion: 2.1 time: 0.169475 Aug 30 19:20:19.496078 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3525/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:19 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:20.218778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638d76f8-afc1-4740-b428-5ac1ed1999d1", "name": "network-vif-deleted", "tag": "aaf86229-131b-4b43-857a-450e18069115"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:20.236935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:20.237776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:20.238575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:20.255163 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] Creating event network-vif-deleted:aaf86229-131b-4b43-857a-450e18069115 for instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 on n-h1-854119-10 Aug 30 19:20:20.260413 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-eff37569-8742-4b2f-b2f0-edfee7778c23 req-21f1de08-af15-42bd-89db-33c9d394c2df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048272 Aug 30 19:20:20.260795 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3674/7199] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:20.516827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:20.517655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:20.526536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:20.527339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:20.527820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:20.528552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:20.528993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:20.529466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:20.566447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:20.567159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:20.567616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:20.568095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lazy-loading 'fault' on Instance uuid 638d76f8-afc1-4740-b428-5ac1ed1999d1 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:20:20.614988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:20.623864 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5b514726-071e-445b-8cc4-1390b76c174e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 200 len: 1349 microversion: 2.1 time: 0.111454 Aug 30 19:20:20.624527 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3526/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:20 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 1349 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:21.647618 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:21.648298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 638d76f8-afc1-4740-b428-5ac1ed1999d1] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:21.655243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:21.655728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:21.656170 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:21.656880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:21.657334 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:21.657764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:21.671984 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] HTTP exception thrown: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Request method failure captured: Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 HTTP/1.1 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmICQImKqc3uHTMVNHebIRSoy32unzKDBZHoMpJ491qYmP5-sNn6cwN1KgNrw6--wdeIUu71wONWVuYnvK-yfO-SLlAXDQ7m6cavFaD2Q4l4kftnb4f9nnBH0yE_G1IT6n4eUbf3zV7Sb4Rg31jFXyWV9RblJ7Xr_aRKpZOVW3T_T2w Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36b54ee3d151449385890093ec18f539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36b54ee3d151449385890093ec18f539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: 64ee4e46e10c47609ba89bd2d92da1f1 Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '638d76f8-afc1-4740-b428-5ac1ed1999d1'} Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:20:21.673762 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Returning 404 to user: Instance 638d76f8-afc1-4740-b428-5ac1ed1999d1 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-826fa57e-a402-4509-a09c-7218ad6d2019 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1" status: 404 len: 111 microversion: 2.1 time: 0.033027 Aug 30 19:20:21.678168 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3675/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:21 2022] GET /compute/v2.1/servers/638d76f8-afc1-4740-b428-5ac1ed1999d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:20:21.684430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d79861b0-6c0a-4792-8821-06b3b4cfceab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '.version_select at 0x7f4e5aeaa430>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:21.723103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d79861b0-6c0a-4792-8821-06b3b4cfceab tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1542411729" status: 202 len: 0 microversion: 2.1 time: 0.041695 Aug 30 19:20:21.723714 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3527/7202] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 19:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1542411729 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:20:30.760258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f9f44ce0-88d1-4239-bbbe-2bb7575b11e6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: .version_select at 0x7f4e55a809d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1396080226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMemqhmWy46LyRKmSFFVg3o3CNanQBbdMmQ7Xdvlo+pCsFCPO1bjd6UrqAJKC7MyrOQbPnosdt9XUJfZ9Hlqb+/ez44+V8RpYUXXfRd6HTIdFSNIVRME1bdXRNnX9z8d+w=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:30.779149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f9f44ce0-88d1-4239-bbbe-2bb7575b11e6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for project 36b54ee3d151449385890093ec18f539. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:20:30.785405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-f9f44ce0-88d1-4239-bbbe-2bb7575b11e6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for user 64ee4e46e10c47609ba89bd2d92da1f1 and project 36b54ee3d151449385890093ec18f539. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:20:30.819144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f9f44ce0-88d1-4239-bbbe-2bb7575b11e6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062965 Aug 30 19:20:30.819764 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3676/7203] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:20:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:30.871260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1117603731", "imageRef": "6df73f5d-b4d9-4a96-bdec-ae44c231cfb9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1396080226", "networks": [{"uuid": "282f9ca5-ce82-4cb2-bd5e-210dd58cde9e"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:30.881677 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:20:30.881844 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:20:30.883120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:30.933747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] validate_networks() for [('282f9ca5-ce82-4cb2-bd5e-210dd58cde9e', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:20:31.390659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:20:31.391308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:20:31.391870 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:20:31.392374 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:20:31.392959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:20:31.407505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:31.408008 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:31.408456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:31.409573 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:31.410059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:31.410535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:31.429214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for project 36b54ee3d151449385890093ec18f539. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:20:31.434821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Getting quotas for user 64ee4e46e10c47609ba89bd2d92da1f1 and project 36b54ee3d151449385890093ec18f539. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:20:31.448294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:20:31.450616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6df73f5d-b4d9-4a96-bdec-ae44c231cfb9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:20:31.508657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bfe5f679-46ef-4ee7-be52-fffb419ce25e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641325 Aug 30 19:20:31.509340 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3528/7204] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:20:31.520814 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8550ad5a-d8be-4f7b-b832-4faaa54f5613 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:31.521429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8550ad5a-d8be-4f7b-b832-4faaa54f5613 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:31.583145 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8550ad5a-d8be-4f7b-b832-4faaa54f5613 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:31.590281 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8550ad5a-d8be-4f7b-b832-4faaa54f5613 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1259 microversion: 2.1 time: 0.073678 Aug 30 19:20:31.590874 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3677/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:31 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:32.613274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c6b5687f-eef9-4ebc-86ae-c028263d816e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:32.613966 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c6b5687f-eef9-4ebc-86ae-c028263d816e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:32.670389 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c6b5687f-eef9-4ebc-86ae-c028263d816e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:32.678753 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c6b5687f-eef9-4ebc-86ae-c028263d816e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1259 microversion: 2.1 time: 0.070338 Aug 30 19:20:32.679522 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3529/7206] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:32 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:33.700223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a29fa661-d5cf-4d6a-99c2-8c9b1a7af8f0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:33.700838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a29fa661-d5cf-4d6a-99c2-8c9b1a7af8f0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:33.702852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=40 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:33.767404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a29fa661-d5cf-4d6a-99c2-8c9b1a7af8f0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:33.777865 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a29fa661-d5cf-4d6a-99c2-8c9b1a7af8f0 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1259 microversion: 2.1 time: 0.081542 Aug 30 19:20:33.778689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3678/7207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:33 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:34.803428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d33f66bc-d357-47e0-9085-b930ac052ca6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:34.804077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d33f66bc-d357-47e0-9085-b930ac052ca6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:34.861769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d33f66bc-d357-47e0-9085-b930ac052ca6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:34.869261 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d33f66bc-d357-47e0-9085-b930ac052ca6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1259 microversion: 2.1 time: 0.070451 Aug 30 19:20:34.869818 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3530/7208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:34 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:35.891080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:35.891690 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:35.898996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:35.899477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:35.899906 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:35.900594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:35.901045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:35.901467 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:35.964212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:35.974582 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cb37d2ef-d9d3-4e5e-b74d-c041d99c103a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1263 microversion: 2.1 time: 0.087355 Aug 30 19:20:35.975141 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3679/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:35 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:36.995760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:36.996377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:37.008365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:37.009507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:37.009983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:37.010749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:37.011240 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:37.011704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:37.078124 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:37.086540 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98e0a0f5-8686-4455-97f4-2c6ead751f02 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1329 microversion: 2.1 time: 0.094726 Aug 30 19:20:37.087068 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3531/7210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:36 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:38.107292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:38.108083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:38.111081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:38.117252 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:38.117751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:38.118172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:38.118912 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:38.119367 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:38.119788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:38.263632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:38.272665 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-015e6719-2a63-47cb-91a7-b801dc7c4628 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.169343 Aug 30 19:20:38.273595 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3680/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:38 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:39.296981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:39.297716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:39.300971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:39.306792 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:39.307531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:39.307998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:39.308801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:39.309208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:39.309652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:39.455739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:39.464592 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2da1f370-13ec-4edd-b7f7-73a2cdcb2216 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.171910 Aug 30 19:20:39.465521 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3532/7212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:39 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:40.486259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:40.486891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:40.495510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:40.495510 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:40.495694 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:40.496375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:40.496833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:40.497278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:40.653858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:40.663410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1d2b215-6033-4c1e-835d-6f872291a5d2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.180804 Aug 30 19:20:40.664275 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3681/7213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:40 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:41.685689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:41.686365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:41.688995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:41.695298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:41.695804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:41.696252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:41.696978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:41.697446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:41.697855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:41.846024 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:41.854147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9708b216-8584-4e62-a03b-9c073c09c525 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.172435 Aug 30 19:20:41.862893 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3533/7214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:41 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:42.877439 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:42.878217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:42.887379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:42.887379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:42.887379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:42.887379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:42.887921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:42.887921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:43.054702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:43.062743 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c8f0638-5ba6-4ae4-981d-2f895e60d96e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.189353 Aug 30 19:20:43.063399 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3682/7215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:42 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:44.084544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:44.085188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:44.092482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:44.093157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:44.093557 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:44.094286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:44.094790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:44.095234 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:44.239210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:44.248409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-73d92e4a-1fee-4228-b10a-baf0fba776ba tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.167990 Aug 30 19:20:44.249257 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3534/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:44 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:45.269865 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:45.270543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:45.272522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:45.279466 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:45.279962 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:45.280402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:45.281146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:45.281608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:45.282014 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:45.463608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:45.471629 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-71275ace-4b48-481a-a3e0-814d8d85e572 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.206046 Aug 30 19:20:45.472331 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3683/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:45 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:46.031202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:46.037016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:20:46.045278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:46.046392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:46.046849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:46.059699 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] Creating event network-changed:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:20:46.065624 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f3cca32c-7f78-4b1e-8aca-38df3276bc6a req-873be118-d385-45bd-bd92-27863037192e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039604 Aug 30 19:20:46.066881 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3535/7218] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:46.492172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:46.492788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:46.500650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:46.501184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:46.501591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:46.502316 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:46.503080 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:46.503989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:46.648048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:46.659648 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-727566a1-13f5-483d-8134-2da1620204d7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.171350 Aug 30 19:20:46.660285 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3684/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:46 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:47.691104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:47.691790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:47.698262 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:47.698806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:47.699276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:47.699997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:47.700469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:47.700904 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:47.839944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:47.849496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-844ef560-58b4-4c01-bf58-8e8579fb21eb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.163809 Aug 30 19:20:47.850157 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3536/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:47 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:48.874420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:48.874838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:48.882073 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:48.882607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:48.883042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:48.883741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:48.884190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:48.884605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:49.025980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:49.034670 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5458c74e-d4a1-4151-9e2a-12cb5b05d7d6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.165757 Aug 30 19:20:49.035259 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3685/7221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:48 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:20:50.056716 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:50.057283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:50.064868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:50.065431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:50.065892 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:50.066691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:50.067147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:50.067598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:50.214271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:50.222880 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-abff1ef0-7fb8-4a54-91ab-0bcad5cb02b6 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.170152 Aug 30 19:20:50.223474 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3537/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:50 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:51.244416 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:51.245050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:51.252380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:51.252897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:51.253475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:51.254198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:51.254674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:51.255098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:51.395297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:51.403209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32ce7c11-9b8f-4e3f-875d-e19b84998fa2 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.162811 Aug 30 19:20:51.403793 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3686/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:51 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:52.427092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:52.434923 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:52.440841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "name": "network-vif-plugged", "status": "completed", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:52.444024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:52.444525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:52.445216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:52.445926 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:52.446421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:52.446855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:52.457590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:52.457997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:52.458539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:52.474409 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] Creating event network-vif-plugged:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:20:52.479913 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-d640f807-27f3-4b74-ba67-b761d671a7bd req-ae8061f9-92a9-4c79-b6e7-9fca38ec05bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107992 Aug 30 19:20:52.480526 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3538/7224] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:52.586702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:52.595338 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ab70369d-0e55-4399-bf21-b6f983b5b41b tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.174864 Aug 30 19:20:52.595923 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3687/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:52 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:53.618202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:53.618960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:53.626523 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:53.627028 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:53.627463 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:53.629205 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:53.629733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:53.630186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:53.769544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:53.778367 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ae89398f-ba71-484b-9ef0-688072284c2e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1359 microversion: 2.1 time: 0.164575 Aug 30 19:20:53.778955 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3539/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:53 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:54.803000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:54.803760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:54.814801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:54.815352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:54.815974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:54.817410 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:54.817553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:54.818605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:54.969217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:54.981341 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c71601e7-6539-4645-a42b-1d28fa80110c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1549 microversion: 2.1 time: 0.184505 Aug 30 19:20:54.982092 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3688/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:54 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:55.004860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:55.005487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:55.012818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.013324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.013777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.014526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.014998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.015439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.161409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:55.169831 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c80b3174-a0c6-4f3f-8222-62e0735ebfc5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1549 microversion: 2.1 time: 0.168966 Aug 30 19:20:55.170761 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3540/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:54 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:55.191244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:55.195921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:55.196697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Searching by: {'deleted': False, 'project_id': '36b54ee3d151449385890093ec18f539'} {{(pid=122589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 19:20:55.202585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.203072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.203513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.204251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.204728 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.205259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.231151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.multi_cell_list [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 19:20:55.260871 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e9e4ba35-5f2c-4e55-b01c-fab2cfa332ac tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073657 Aug 30 19:20:55.261466 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3689/7229] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 19:20:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:20:55.273168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:20:55.273826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:55.280506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.281009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.281454 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.282170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:55.282671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:55.283109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:55.426820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:20:55.439202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7549b104-a37e-49e4-b148-9f4009993d10 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1549 microversion: 2.1 time: 0.169780 Aug 30 19:20:55.440106 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3541/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:20:55 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:20:56.990116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228805d9-f11a-401b-b74f-6cfc57a84503"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:20:56.993658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:20:57.003899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:57.004594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:57.005142 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:57.005853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:20:57.006306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:20:57.006758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:20:57.312029 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-158eea5b-3001-4d17-8c8e-5e9a90b5b585 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327879 Aug 30 19:20:57.312654 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3690/7231] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 19:20:56 2022] POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:21:08.163572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:08.164211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:08.167675 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=19 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:08.168361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=60 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:08.174318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:08.174846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:08.175300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:08.176026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:08.176498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:08.176945 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:08.318561 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:08.327065 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-08629da5-9629-426f-a5b5-0f17d673f849 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1595 microversion: 2.1 time: 0.169928 Aug 30 19:21:08.327690 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3542/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:08 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:10.393737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:21:10.401329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:10.402686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=21 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:10.403633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:10.409753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:10.410676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:10.411355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:10.426209 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] Creating event network-changed:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:21:10.431634 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b8c698d3-a4fe-49cf-aef5-ecd4f7025614 req-e53a343f-51c6-4740-aee4-24dea0062873 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042058 Aug 30 19:21:10.432733 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3691/7233] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:21:11.629783 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-393356782"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:21:11.631142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:11.638799 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:11.639308 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:11.639761 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:11.640516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:11.641131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:11.641587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:11.786711 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.network.security_group_api [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Adding security group b91d89d9-e912-4e13-80ba-f1a677689da8 to port 5ebc4579-d74a-4c11-81c0-2d3095df080b Aug 30 19:21:12.126374 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6229b6d8-190e-433c-a7ed-30feda84bfde tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action" status: 202 len: 0 microversion: 2.1 time: 0.502306 Aug 30 19:21:12.127047 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3543/7234] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:21:11 2022] POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:21:12.141699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:12.142443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:12.152745 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:12.153248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:12.153674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:12.154411 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:12.154870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:12.155486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:12.313192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:12.322850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-dfe4419c-20f1-4e76-be8f-28b21aead5d1 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1760 microversion: 2.1 time: 0.190971 Aug 30 19:21:12.323450 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3692/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:12 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:21:12.450011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:21:12.461294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:12.461821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:12.462267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:12.474042 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] Creating event network-changed:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:21:12.479338 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-edb156ce-2022-4a99-8a10-bca7a5811a7b req-6f66830c-4821-413a-b677-120e180edac7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Aug 30 19:21:12.479938 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3544/7236] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:21:26.330437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:26.331236 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=8 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:26.403647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:21:26.405986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:26.412604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:26.413249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:26.413676 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:26.414632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:26.415095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:26.415516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:26.499011 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e42c165d-21ff-4d04-8bc1-792f363c685c tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action" status: 202 len: 0 microversion: 2.1 time: 0.176039 Aug 30 19:21:26.500035 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3693/7237] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:21:26 2022] POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:21:26.508223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:26.509753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:21:26.516858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:26.518109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:26.529309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:26.530070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:26.530743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:26.531685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:26.532248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:26.532782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:26.694848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:26.704716 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28c05514-cd52-4784-9307-1a12fc407764 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1752 microversion: 2.1 time: 0.199692 Aug 30 19:21:26.705304 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3545/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:26 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:27.728352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:27.729030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:27.735710 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:27.736207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:27.736648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:27.737359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:27.737815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:27.738246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:27.896164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:27.906331 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8dea1d87-6ac9-4804-92aa-e98bb2e573a9 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.183775 Aug 30 19:21:27.906952 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3694/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:27 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:28.928936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:28.929860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:28.938397 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:28.939041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:28.939526 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:28.940338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:28.940835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:28.941318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:29.103562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:29.118719 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-727749b7-0eb4-4f73-99d8-f66b62a2113f tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.194106 Aug 30 19:21:29.119386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3546/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:28 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:30.150650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:30.151750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:30.159833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:30.160324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:30.160770 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:30.161571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:30.161967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:30.162399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:30.340757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:30.349443 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-28546b39-fcac-4f3a-a662-1ba469af28da tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.204351 Aug 30 19:21:30.349936 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3695/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:30 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:31.373865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:31.374536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:31.381905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:31.382455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:31.382917 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:31.383638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:31.384107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:31.384576 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:31.535563 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:31.544780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b45b5791-7990-4936-83d4-d49cd47d0563 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.175023 Aug 30 19:21:31.545671 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3547/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:31 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:32.566758 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:32.567398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:32.575127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:32.575612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:32.576052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:32.576762 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:32.577219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:32.577648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:32.739607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:32.748890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4421e6a2-2806-4103-8083-79ecd2554326 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.186265 Aug 30 19:21:32.749473 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3696/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:32 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:33.770928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:33.771534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:33.779371 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:33.779923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:33.780396 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:33.781119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:33.781604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:33.782055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:33.939343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:33.950615 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-46d9c2ce-3228-49ff-9cea-6091d117f8f7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.183790 Aug 30 19:21:33.951189 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3548/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:33 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:34.973733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:34.974322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:34.982097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:34.982619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:34.983052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:34.983761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:34.984212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:34.984636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:35.156390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:35.166086 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c4ef909-3a38-42ae-be12-8336eccfcd89 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.196342 Aug 30 19:21:35.166727 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3697/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:34 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:36.194758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:36.195382 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:36.203191 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:36.203693 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:36.204153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:36.204871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:36.205345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:36.205790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:36.374604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:36.384085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-64337ceb-7f02-4211-afb1-6488af04af0e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.195389 Aug 30 19:21:36.384711 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3549/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:36 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:37.407489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:37.408108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:37.416036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:37.417199 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:37.417649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:37.418383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:37.418844 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:37.419269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:37.571968 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:37.581336 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a5a60999-5454-44b3-812f-3914d87b2d1e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1757 microversion: 2.1 time: 0.177832 Aug 30 19:21:37.581947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3698/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:37 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:21:38.603910 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:21:38.604501 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:21:38.612173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:38.612705 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:38.613148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:38.613869 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:21:38.614335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:21:38.614807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:21:38.777372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:21:38.786166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-98dc919d-3014-4d20-ad1f-61fb91bf73b5 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1760 microversion: 2.1 time: 0.186391 Aug 30 19:21:38.786771 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3550/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:21:38 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:11.214956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-393356782"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:11.215607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:11.217863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=12 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:11.218568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:11.219899 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:22:11.220042 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action (ip 10.222.0.25) !!! Aug 30 19:22:11.227785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:11.228363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:11.229090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:11.230078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:11.230566 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:11.231030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:11.377149 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.network.security_group_api [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Removing security group b91d89d9-e912-4e13-80ba-f1a677689da8 from port 5ebc4579-d74a-4c11-81c0-2d3095df080b Aug 30 19:22:11.705899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fdfb3427-64a2-46dd-9ec9-c8237d8e7768 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action" status: 202 len: 0 microversion: 2.1 time: 0.495663 Aug 30 19:22:11.706976 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3699/7249] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:22:11 2022] POST /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:22:11.715605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:11.721381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:11.722795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=36 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:11.730580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:11.731080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:11.731531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:11.743836 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] Creating event network-changed:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:22:11.750822 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-106d33e6-3b74-4b6c-ad12-6ad7c3da8edd req-d13c24d2-3814-425c-98a5-296c3e9e470b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038039 Aug 30 19:22:11.751780 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3551/7250] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:22:12.986689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:12.987214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:12.990000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:12.993987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:12.994713 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:12.994921 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:12.995838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:12.996271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:12.996709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:13.000639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:13.001339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:13.001793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:13.013931 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] Creating event network-changed:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:22:13.019406 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-bb5083a2-2edc-4771-b3c0-0d2291cdf473 req-c329421d-81f3-42eb-a298-63d5b6bbd9bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034576 Aug 30 19:22:13.020298 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3552/7251] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:13.088436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lazy-loading 'services' on Instance uuid 97789f6a-df76-448f-b998-073ceadde151 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:22:13.172024 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-90ba8a93-66d5-4845-9606-c6901b2f9f39 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments/228805d9-f11a-401b-b74f-6cfc57a84503" status: 202 len: 0 microversion: 2.1 time: 0.190644 Aug 30 19:22:13.173318 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3700/7252] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:22:12 2022] DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments/228805d9-f11a-401b-b74f-6cfc57a84503 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:22:13.184354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:13.187145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:13.194159 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:13.195113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:13.195750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:13.196704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:13.197163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:13.198931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:13.243271 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d1f8d7b4-32e3-46d1-a798-6658f8d87aaa tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064348 Aug 30 19:22:13.244417 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3553/7253] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:13 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:14.258579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:14.261522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:14.268272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:14.268734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:14.269174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:14.269882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:14.270378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:14.270824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:14.303461 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f578015-e1fe-4a07-9975-07f0c739db9d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050074 Aug 30 19:22:14.304088 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3701/7254] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:14 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:15.317484 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:15.321015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:15.336974 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:15.338078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:15.338743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:15.339551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:15.340046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:15.340491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:15.379017 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c493d783-15df-4406-a661-d187aa4758af tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066472 Aug 30 19:22:15.380073 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3554/7255] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:15 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:16.392479 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:16.394848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:16.403295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:16.403788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:16.404227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:16.404932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:16.405379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:16.405802 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:16.438973 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c68661ce-bceb-488e-bf08-ee37a073c6a7 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050387 Aug 30 19:22:16.439513 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3702/7256] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:16 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:17.452299 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:17.454568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:17.461895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:17.462426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:17.462951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:17.463809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:17.464232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:17.464682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:17.496289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-61411d28-0282-40dd-8a11-0bd13e3c963e tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048272 Aug 30 19:22:17.496869 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3555/7257] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:17 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:18.508449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:18.511576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:18.519033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:18.519609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:18.520298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:18.521473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:18.522226 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:18.522931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:18.555328 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3968c39a-4dec-4ce6-bdc9-0b53bcf86127 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050958 Aug 30 19:22:18.555910 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3703/7258] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 19:22:18 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 19:22:18.566854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:18.567394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:18.575009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:18.575515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:18.575972 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:18.576696 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:18.577171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:18.577613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:18.662721 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] HTTP exception thrown: Instance 97789f6a-df76-448f-b998-073ceadde151 is not attached to volume 228805d9-f11a-401b-b74f-6cfc57a84503 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Request method failure captured: Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: request: DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments/228805d9-f11a-401b-b74f-6cfc57a84503 HTTP/1.1 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmICQImKqc3uHTMVNHebIRSoy32unzKDBZHoMpJ491qYmP5-sNn6cwN1KgNrw6--wdeIUu71wONWVuYnvK-yfO-SLlAXDQ7m6cavFaD2Q4l4kftnb4f9nnBH0yE_G1IT6n4eUbf3zV7Sb4Rg31jFXyWV9RblJ7Xr_aRKpZOVW3T_T2w Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36b54ee3d151449385890093ec18f539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36b54ee3d151449385890093ec18f539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 64ee4e46e10c47609ba89bd2d92da1f1 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 97789f6a-df76-448f-b998-073ceadde151 is not attached to volume 228805d9-f11a-401b-b74f-6cfc57a84503 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'server_id': '97789f6a-df76-448f-b998-073ceadde151', 'id': '228805d9-f11a-401b-b74f-6cfc57a84503'} Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 228805d9-f11a-401b-b74f-6cfc57a84503. Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97789f6a-df76-448f-b998-073ceadde151 is not attached to volume 228805d9-f11a-401b-b74f-6cfc57a84503 Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:22:18.665183 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97789f6a-df76-448f-b998-073ceadde151 is not attached to volume 228805d9-f11a-401b-b74f-6cfc57a84503 Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Returning 404 to user: Instance 97789f6a-df76-448f-b998-073ceadde151 is not attached to volume 228805d9-f11a-401b-b74f-6cfc57a84503 {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd315ab4-920d-48f1-9f60-2fbdfe2c018d tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments/228805d9-f11a-401b-b74f-6cfc57a84503" status: 404 len: 154 microversion: 2.1 time: 0.104259 Aug 30 19:22:18.671050 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3556/7259] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 19:22:18 2022] DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151/os-volume_attachments/228805d9-f11a-401b-b74f-6cfc57a84503 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:22:21.947051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:21.947967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:21.955221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:21.955712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:21.956146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:21.956850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:21.957301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:21.957738 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:21.985727 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:22:22.069369 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7b7155df-ca13-4a11-b6e7-9ae8f09aaa44 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 204 len: 0 microversion: 2.1 time: 0.126287 Aug 30 19:22:22.070215 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3704/7260] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:22:21 2022] DELETE /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:22:22.078950 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:22.079589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:22.089660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:22.090177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:22.090757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:22.091511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:22.091989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:22.092457 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:22.240915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:22.249853 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-567ab008-5831-4f31-a650-f2f25012602a tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1555 microversion: 2.1 time: 0.174871 Aug 30 19:22:22.250459 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3557/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:22 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:23.272825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:23.273557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:23.282042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:23.282583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:23.283025 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:23.283744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:23.284193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:23.284622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:23.421391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:23.429673 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-035530c0-c088-455a-b0b1-a07fedc6a5cb tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1555 microversion: 2.1 time: 0.161242 Aug 30 19:22:23.430245 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3705/7262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:23 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:24.386673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97789f6a-df76-448f-b998-073ceadde151", "name": "network-vif-deleted", "tag": "5ebc4579-d74a-4c11-81c0-2d3095df080b"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:24.397575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:24.398041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:24.398555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:24.411821 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] Creating event network-vif-deleted:5ebc4579-d74a-4c11-81c0-2d3095df080b for instance 97789f6a-df76-448f-b998-073ceadde151 on n-h2-854119-10 Aug 30 19:22:24.418103 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0013e47c-333e-47a7-bc38-394c97dc3bb7 req-79b25fe7-cebb-4629-9e8f-978b25452e24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036535 Aug 30 19:22:24.418777 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3558/7263] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:22:24.452265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:24.452880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:24.461994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:24.462532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:24.463072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:24.463936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:24.464369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:24.464811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:24.535622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ee4e46e10c47609ba89bd2d92da1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b54ee3d151449385890093ec18f539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:24.544127 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fb83b072-83cb-4250-bff2-c264b4422cad tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 200 len: 1344 microversion: 2.1 time: 0.097042 Aug 30 19:22:24.544798 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3706/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:24 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 1344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:25.567506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:25.568223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] [instance: 97789f6a-df76-448f-b998-073ceadde151] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:25.575355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:25.575762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:25.576217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:25.576946 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:25.577420 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:25.577862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:25.591987 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] HTTP exception thrown: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Request method failure captured: Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 HTTP/1.1 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmICQImKqc3uHTMVNHebIRSoy32unzKDBZHoMpJ491qYmP5-sNn6cwN1KgNrw6--wdeIUu71wONWVuYnvK-yfO-SLlAXDQ7m6cavFaD2Q4l4kftnb4f9nnBH0yE_G1IT6n4eUbf3zV7Sb4Rg31jFXyWV9RblJ7Xr_aRKpZOVW3T_T2w Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36b54ee3d151449385890093ec18f539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36b54ee3d151449385890093ec18f539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36b54ee3d151449385890093ec18f539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: 36b54ee3d151449385890093ec18f539 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestMinimumBasicScenario-708185941 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 64ee4e46e10c47609ba89bd2d92da1f1 Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestMinimumBasicScenario-708185941-project Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '97789f6a-df76-448f-b998-073ceadde151'} Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:22:25.593679 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Returning 404 to user: Instance 97789f6a-df76-448f-b998-073ceadde151 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-869c2684-622e-4486-94aa-3d013232cf03 tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151" status: 404 len: 111 microversion: 2.1 time: 0.033030 Aug 30 19:22:25.598819 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3559/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:25 2022] GET /compute/v2.1/servers/97789f6a-df76-448f-b998-073ceadde151 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:22:25.604486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d83798e7-7619-4bf3-84cf-fe3e9fd749ae tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] Calling method '.version_select at 0x7f4e55dc1e50>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:25.628933 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d83798e7-7619-4bf3-84cf-fe3e9fd749ae tempest-TestMinimumBasicScenario-708185941 tempest-TestMinimumBasicScenario-708185941-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1396080226" status: 202 len: 0 microversion: 2.1 time: 0.028178 Aug 30 19:22:25.630162 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3707/7266] 10.222.0.25 () {58 vars in 1272 bytes} [Tue Aug 30 19:22:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1396080226 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:22:35.373033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f464eca7-5f0c-4ee3-8b07-926b5a90e20c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: .version_select at 0x7f4e568ff550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1527981146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9VeNTcbkvKakjUwNMGctNQ0uoaPjZKgNQ+J+DP86SfK/xeB89XBX9kWN2lSPcLg+iFFrBZ2PZ8YTnrvODeHAUv23tjB+mzU36FMDFQ5XEZod+gmEtJRrRH1As2yRpuHQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:35.394542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f464eca7-5f0c-4ee3-8b07-926b5a90e20c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:22:35.399751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f464eca7-5f0c-4ee3-8b07-926b5a90e20c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:22:35.425780 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f464eca7-5f0c-4ee3-8b07-926b5a90e20c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.245378 Aug 30 19:22:35.426620 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3560/7267] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:22:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:42.070428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:42.071826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:42.075953 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-926424953", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "df6978a8-cc01-4b17-9d59-cb0ea8d0619a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1527981146", "security_groups": [{"name": "tempest-secgroup-smoke-1654784343"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:42.203264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] validate_networks() for [('df6978a8-cc01-4b17-9d59-cb0ea8d0619a', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:22:42.676351 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:22:42.676793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:22:42.677297 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:22:42.677824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:22:42.678137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:22:42.688321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:42.688821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:42.689154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:42.689896 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:42.690356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:42.690818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:42.708818 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:22:42.714702 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:22:42.728663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:22:42.731190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:22:42.785411 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-994ec3c0-1555-495f-a595-12dea1e5b817 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716941 Aug 30 19:22:42.786073 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3708/7268] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:22:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 19:22:42.794967 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=38 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:42.803504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b3a2d1f-86cb-4493-a97f-dcc6f8d6a76c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:42.804521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b3a2d1f-86cb-4493-a97f-dcc6f8d6a76c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:42.806961 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:42.878510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7b3a2d1f-86cb-4493-a97f-dcc6f8d6a76c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:42.886541 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b3a2d1f-86cb-4493-a97f-dcc6f8d6a76c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1266 microversion: 2.1 time: 0.092379 Aug 30 19:22:42.887486 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3561/7269] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:42 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:43.910380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:43.911088 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:43.925291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:43.926018 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:43.927272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:43.932058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:43.933231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:43.933842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:44.022021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:44.037424 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cacf9c6f-cb2c-4107-91c4-8d6b090a42ca tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1318 microversion: 2.1 time: 0.133088 Aug 30 19:22:44.038262 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3709/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:43 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1318 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:45.061281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:45.062172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:45.076663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:45.078565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:45.079328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:45.080354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:45.081098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:45.081843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:45.331444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:45.344008 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac63400c-79d0-4f4a-a971-e7a70cc88fdb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.287500 Aug 30 19:22:45.345577 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3562/7271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:45 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:45.627718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d83061f-52bd-4756-8262-aa6ff0190ad2", "tag": "3d0739fb-78e9-4a56-bfb9-ad8e09279687"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:45.641735 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:45.642823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:45.642823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:45.660553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] Creating event network-changed:3d0739fb-78e9-4a56-bfb9-ad8e09279687 for instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 on n-h1-854119-10 Aug 30 19:22:45.666114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7198abc0-4e94-44c7-8cd2-37bb07b6d30e req-4cdbe80a-165b-42b4-849b-9584e70a5060 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050662 Aug 30 19:22:45.667086 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3710/7272] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:22:46.366117 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:46.366777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:46.375173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:46.375678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:46.376133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:46.376866 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:46.377339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:46.377781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:46.521766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:46.530368 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a370c2e6-a256-46f9-b991-728633db4c5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.168437 Aug 30 19:22:46.531018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3563/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:46 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:47.552853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:47.553558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:47.562136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:47.562652 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:47.563101 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:47.563822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:47.564268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:47.564705 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:47.711394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:47.721081 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-12d90e70-9221-4cea-9e04-778a3acf404a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.172653 Aug 30 19:22:47.721660 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3711/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:47 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:48.743762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:48.745025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:48.752472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:48.752979 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:48.753425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:48.754146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:48.754639 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:48.755059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:48.904824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:48.913460 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e18d9800-2f30-45b3-9241-7f4f500db985 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.174020 Aug 30 19:22:48.914044 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3564/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:48 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:49.941733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:49.942405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:49.951210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:49.951701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:49.952109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:49.952815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:49.953269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:49.953720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:50.097543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:50.106902 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3f289c79-d1b9-4c4d-be1a-b5c32352f9d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.169162 Aug 30 19:22:50.107490 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3712/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:49 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:50.343683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d83061f-52bd-4756-8262-aa6ff0190ad2", "name": "network-vif-plugged", "status": "completed", "tag": "3d0739fb-78e9-4a56-bfb9-ad8e09279687"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:50.354959 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:50.356168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:50.356614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:50.369066 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] Creating event network-vif-plugged:3d0739fb-78e9-4a56-bfb9-ad8e09279687 for instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 on n-h1-854119-10 Aug 30 19:22:50.374770 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-b5944ff1-d1d8-4e74-a23a-02c3d005dcf4 req-abb53167-c811-4dd5-91d5-f1ce3d3e2018 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Aug 30 19:22:50.375386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3565/7277] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:51.129910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:51.131016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:51.140878 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:51.141372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:51.141810 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:51.142564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:51.143026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:51.143448 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:51.284915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:51.293808 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e98fff65-cb9c-4078-a384-26201b39d254 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1392 microversion: 2.1 time: 0.169092 Aug 30 19:22:51.294448 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3713/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:51 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:52.317448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:52.318173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:52.325271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:52.325786 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:52.326222 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:52.326989 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:52.327459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:52.327906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:52.467053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:52.475962 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f26b087-f173-4a40-b52a-64191d7605e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1564 microversion: 2.1 time: 0.163701 Aug 30 19:22:52.476555 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3566/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:52 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:52.497877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:52.498520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:52.506138 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:52.506649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:52.507089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:52.507784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:52.508243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:52.508670 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:52.646673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:52.655329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6731d437-c64f-40e9-b532-8f621d8c046f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1564 microversion: 2.1 time: 0.161976 Aug 30 19:22:52.655951 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3714/7280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:52 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:22:54.311153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d83061f-52bd-4756-8262-aa6ff0190ad2", "tag": "3d0739fb-78e9-4a56-bfb9-ad8e09279687"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:22:54.312134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:22:54.313293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:22:54.315418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:54.317643 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:54.318390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:22:54.323940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:54.324150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:54.324404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:54.324520 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:54.324822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:54.324948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:54.325605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:22:54.326235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:22:54.326714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:22:54.337360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] Creating event network-changed:3d0739fb-78e9-4a56-bfb9-ad8e09279687 for instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 on n-h1-854119-10 Aug 30 19:22:54.343734 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c1f6acf3-7666-44f5-9a83-2803690dd4eb req-b2f6b544-d89c-44c2-847b-0a16d059180c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036065 Aug 30 19:22:54.348771 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3715/7281] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:22:54.565623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:22:54.575339 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ba1cb915-6670-41a5-829f-4b3f5cd37c2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1564 microversion: 2.1 time: 0.268896 Aug 30 19:22:54.575946 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3567/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:22:54 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1564 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:16.256591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:16.257419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=36 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:16.262630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:16.264967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:16.274102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:16.274597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:16.275032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:16.275760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:16.276221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:16.276647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:16.335824 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e834c16e-ba47-4885-8345-a3fc3eb6ced1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action" status: 200 len: 24572 microversion: 2.1 time: 0.079931 Aug 30 19:23:16.337335 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3716/7283] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:23:16 2022] POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action => generated 24572 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:23:27.328473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:27.329175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:27.331912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=15 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:27.332762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=32 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:27.339103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:27.339731 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:27.340623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:27.341365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:27.341841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:27.342288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:27.416922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52ccb57a-615c-441b-9b27-cde863bdc098 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action" status: 202 len: 0 microversion: 2.1 time: 0.092633 Aug 30 19:23:27.418204 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3568/7284] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:23:27 2022] POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:23:27.428106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:27.428788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:27.439327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:27.440096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=4 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:27.445851 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:27.446369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:27.446821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:27.447535 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:27.447995 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:27.448431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:27.592840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:27.601190 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8c4dbeb5-5ac8-456c-863e-81e6ebd6d897 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1687 microversion: 2.1 time: 0.177441 Aug 30 19:23:27.601863 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3717/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:27 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:28.627378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:28.628295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:28.636094 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:28.636594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:28.637060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:28.637781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:28.638258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:28.638734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:28.785430 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:28.793788 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-013006ed-7f24-4881-92b8-37176069225b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1667 microversion: 2.1 time: 0.173902 Aug 30 19:23:28.794369 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3569/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:28 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1667 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:29.896449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:29.898672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:29.906852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:29.907340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:29.907778 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:29.909173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:29.909633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:29.910061 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:29.962899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7fc592e9-d232-46c4-adf1-c8067ced681d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action" status: 200 len: 32645 microversion: 2.1 time: 0.070089 Aug 30 19:23:29.963426 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3718/7287] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:23:29 2022] POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action => generated 32645 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:23:29.976170 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:29.976990 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:29.984932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:29.985480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:29.985956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:29.986758 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:29.987343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:29.987788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:30.062691 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1779a7e1-0634-4b66-902d-b478dd0b7f8d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action" status: 202 len: 0 microversion: 2.1 time: 0.090528 Aug 30 19:23:30.063327 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3570/7288] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:23:29 2022] POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:23:30.072292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:30.073060 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:30.080189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:30.080682 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:30.081123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:30.081889 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:30.082314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:30.082774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:30.230267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:30.240074 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e2a232d9-fcf8-4df1-99d0-c56a423f5754 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1674 microversion: 2.1 time: 0.171970 Aug 30 19:23:30.240653 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3719/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:30 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:31.265595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:31.266366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:31.274552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:31.275029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:31.275518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:31.276215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:31.276683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:31.277132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:31.432450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:31.443705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-be53e803-f3a4-4f59-b55a-2dc7cc69180d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1674 microversion: 2.1 time: 0.184459 Aug 30 19:23:31.444284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3571/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:31 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:32.465891 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:32.466541 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:32.475153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:32.475650 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:32.476086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:32.476792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:32.477245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:32.477671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:32.615413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:32.623658 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ccd934b8-abb0-4d28-9e56-fe146e0d4f2d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1674 microversion: 2.1 time: 0.161714 Aug 30 19:23:32.624451 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3720/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:32 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:33.646471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:33.647048 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:33.654486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:33.655011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:33.655507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:33.656273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:33.656781 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:33.657233 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:33.801686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:33.813411 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a361cb20-707b-49b2-bd8f-da6667195f09 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1674 microversion: 2.1 time: 0.171115 Aug 30 19:23:33.814068 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3572/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:33 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:34.837706 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:34.838338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:34.848830 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:34.849402 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:34.849958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:34.851062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:34.851646 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:34.852214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:35.006186 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:35.016452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a9cd04a4-d967-42c3-8d1c-f6cfb9aeaa48 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1674 microversion: 2.1 time: 0.184353 Aug 30 19:23:35.017105 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3721/7293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:34 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:36.047968 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:36.048605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:36.056163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:36.056666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:36.057266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:36.057980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:36.058480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:36.058987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:36.205838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:36.214044 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4abeb0e0-e834-4f7b-a8a6-519a190d7451 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1682 microversion: 2.1 time: 0.172288 Aug 30 19:23:36.214658 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3573/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:36 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:36.312975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:36.315189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:36.322478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:36.322967 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:36.323404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:36.324111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:36.324560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:36.324981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:36.376545 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-663e5f13-76e4-4208-a485-27064576384a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action" status: 200 len: 38586 microversion: 2.1 time: 0.067422 Aug 30 19:23:36.377227 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3722/7295] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:23:36 2022] POST /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2/action => generated 38586 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:23:37.437211 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d83061f-52bd-4756-8262-aa6ff0190ad2", "tag": "3d0739fb-78e9-4a56-bfb9-ad8e09279687"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:37.445760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:37.446307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:37.453803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:37.454482 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:37.455069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:37.455919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:37.456403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:37.456743 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:37.456864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:37.457278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:37.457436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:37.472026 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] Creating event network-changed:3d0739fb-78e9-4a56-bfb9-ad8e09279687 for instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 on n-h1-854119-10 Aug 30 19:23:37.479590 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c005d4dd-9513-413e-b47f-eec4dda307b0 req-17994fef-8a98-4004-8b65-cf58eb98d259 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046378 Aug 30 19:23:37.481044 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3723/7296] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:23:37.487541 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:23:37.590814 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9f225111-0bd3-46e2-8624-794259fdf5bd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 204 len: 0 microversion: 2.1 time: 0.160149 Aug 30 19:23:37.591429 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3574/7297] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:23:37 2022] DELETE /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:23:37.601907 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:37.602837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:37.611048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:37.611885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:37.612417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:37.613249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:37.613905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:37.614453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:37.759935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:37.770937 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0378d74-20e7-428b-a05d-debe56e7ff96 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1688 microversion: 2.1 time: 0.174033 Aug 30 19:23:37.771721 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3724/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:37 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:38.794546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:38.795264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:38.803063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:38.803570 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:38.804031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:38.804755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:38.805230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:38.805680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:39.006970 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:39.015460 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-33038a48-202b-4760-8f18-9c8c5ce40485 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1688 microversion: 2.1 time: 0.225408 Aug 30 19:23:39.016048 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3575/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:38 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:39.735214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d83061f-52bd-4756-8262-aa6ff0190ad2", "name": "network-vif-deleted", "tag": "3d0739fb-78e9-4a56-bfb9-ad8e09279687"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:39.747494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:39.747978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:39.748415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:39.760776 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] Creating event network-vif-deleted:3d0739fb-78e9-4a56-bfb9-ad8e09279687 for instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 on n-h1-854119-10 Aug 30 19:23:39.765857 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c487a1b1-0739-43bf-9a43-e1105d0b021f req-0d15af83-0284-47f7-ad95-79c430d6efc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Aug 30 19:23:39.766636 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3725/7300] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:23:40.037566 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:40.038437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:40.046553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:40.047067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:40.047527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:40.048265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:40.048749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:40.049333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:40.083650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:40.084156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:40.084689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:40.085144 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lazy-loading 'fault' on Instance uuid 1d83061f-52bd-4756-8262-aa6ff0190ad2 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:23:40.128801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:40.138589 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97406d64-dda9-4d95-98b2-cadf52493c10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 200 len: 1356 microversion: 2.1 time: 0.104904 Aug 30 19:23:40.139186 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3576/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:40 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:41.165230 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:41.165959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 1d83061f-52bd-4756-8262-aa6ff0190ad2] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:41.173184 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:41.173678 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:41.174116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:41.174862 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:41.175324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:41.175751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:41.189864 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] HTTP exception thrown: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Request method failure captured: Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 HTTP/1.1 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmN6ul6n3L7wvc_3698wFJi91YDcZurRMRFLjTuBSDFDc1vdTNK3jMJB2gcj8nTDrsq1-CLEJ4KSooyJfTBSuGBErbQpvx9ToQKjEIs9GDjm-3plHfF9YH3DEc6Wv4Z0CB7lsrExP47LzCMizENhfuyZ21YSbZd7z811um62gFVO0HU Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a64e346cf03b4e099835f96c6e763322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: e3bb96ea667f4cb8beb46b4c9812fb9d Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '1d83061f-52bd-4756-8262-aa6ff0190ad2'} Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:23:41.191572 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Returning 404 to user: Instance 1d83061f-52bd-4756-8262-aa6ff0190ad2 could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8b1b9263-8b57-4f8d-9d24-dd013259d394 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2" status: 404 len: 111 microversion: 2.1 time: 0.034612 Aug 30 19:23:41.196489 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3726/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:41 2022] GET /compute/v2.1/servers/1d83061f-52bd-4756-8262-aa6ff0190ad2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:23:44.666210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-938ceb8e-78ee-4c43-9a64-b7ea5415c6c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '.version_select at 0x7f4e569024c0>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:44.690089 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-938ceb8e-78ee-4c43-9a64-b7ea5415c6c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1527981146" status: 202 len: 0 microversion: 2.1 time: 0.028346 Aug 30 19:23:44.694390 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3577/7303] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 19:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1527981146 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:23:44.717875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-98871ea8-1be3-4afd-81d5-890df046a0fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: .version_select at 0x7f4e55dc1e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2030483706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz3R/v864I2bzwqtiY6vk//QU3zPEw+37UWFf/xqRDtgZmOJgbYZ5C8JfAWga0iZxGjp+2tbZyKDi+RbIgFwmBxW9BVzksSqzgPPioRklCMBCpylUYqiizI5U4B20Dnew=="}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:44.735626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-98871ea8-1be3-4afd-81d5-890df046a0fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:23:44.740792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-98871ea8-1be3-4afd-81d5-890df046a0fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:23:44.770159 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-98871ea8-1be3-4afd-81d5-890df046a0fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056237 Aug 30 19:23:44.770737 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3727/7304] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:23:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:23:50.849385 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:50.855011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1110284132", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "14e4010b-1619-4e0e-bd47-0d784a81412e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2030483706", "security_groups": [{"name": "tempest-secgroup-smoke-875121814"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:51.236032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] validate_networks() for [('14e4010b-1619-4e0e-bd47-0d784a81412e', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:23:51.699407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:23:51.699844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:23:51.700326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:23:51.700742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:23:51.701189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:23:51.710690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:51.711437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:51.711883 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:51.712621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:51.713083 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:51.713515 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:51.728283 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:23:51.728579 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:23:51.743508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:23:51.750919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:23:51.765007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:23:51.767343 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:23:51.821085 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0dff1d1-b8ed-4618-a9fb-547ac07c344e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973492 Aug 30 19:23:51.828258 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3578/7305] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:23:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:23:51.831273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=44 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:51.836219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-afc8697c-dc6f-4dfb-bab8-48d928ed96c7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:51.836821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-afc8697c-dc6f-4dfb-bab8-48d928ed96c7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:51.968180 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-afc8697c-dc6f-4dfb-bab8-48d928ed96c7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:51.975680 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-afc8697c-dc6f-4dfb-bab8-48d928ed96c7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1267 microversion: 2.1 time: 0.146263 Aug 30 19:23:51.976264 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3728/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:51 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:52.997225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:52.998175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:53.015263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:53.017219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:53.018766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:53.020421 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:53.021153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:53.022046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:53.149682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:53.160135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eb1b5295-3459-4f8d-8584-561f4a641d5d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1327 microversion: 2.1 time: 0.167257 Aug 30 19:23:53.180098 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3579/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:52 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:54.186004 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:54.186792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:54.196513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:54.197164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:54.197708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:54.198534 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:54.199108 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:54.200042 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:54.398788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:54.408026 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89b5f905-1b2e-4f3c-b018-5006f73d4099 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.226621 Aug 30 19:23:54.409110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3729/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:54 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:54.944939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9bd01f-77b8-42ca-9192-16d07f5ec354", "tag": "1122be81-a4b3-4b35-8654-1908a46a4a6e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:23:54.962493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:54.963012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:54.964224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:54.978200 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] Creating event network-changed:1122be81-a4b3-4b35-8654-1908a46a4a6e for instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 on n-h2-854119-10 Aug 30 19:23:54.984717 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f118eb4f-e415-40d2-9f3c-de5dcad9c4f6 req-1a694674-2a74-4ba0-96f6-03a5f9066de0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044019 Aug 30 19:23:54.985659 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3580/7309] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:23:55.430932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:55.431589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:55.440717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:55.441204 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:55.441640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:55.442394 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:55.442823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:55.443244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:55.585911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:55.594531 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6dc77e89-d16c-4021-aa2e-222d018c72e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.168875 Aug 30 19:23:55.595141 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3730/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:55 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:56.617687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:56.618513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:56.625428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:56.625944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:56.626437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:56.627171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:56.627649 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:56.628095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:56.774575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:56.782657 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9489eba0-64a2-48ba-8559-164fcb0190d2 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.170492 Aug 30 19:23:56.783245 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3581/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:56 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:57.806005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:57.806798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:57.809293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:57.815498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:57.815988 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:57.816421 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:57.817123 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:57.817576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:57.817970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:57.969443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:57.977853 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-50d5080c-4c71-4bb3-a0dd-7afa6406be9d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.176619 Aug 30 19:23:57.978474 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3731/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:57 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:23:58.999105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:23:58.999740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:23:59.002723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:23:59.008451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:59.008971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:59.009539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:59.010268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:23:59.010772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:23:59.011248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:23:59.178572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:23:59.187950 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-07dddac2-f189-4290-b002-b945f915b4d9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.192825 Aug 30 19:23:59.188547 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3582/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:23:58 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:00.213110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:00.213759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:00.221461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:00.221964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:00.222432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:00.223144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:00.223603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:00.224032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:00.373278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:00.387237 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e983e603-d55e-4a0a-82a3-3844a5a80663 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.179325 Aug 30 19:24:00.387814 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3732/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:00 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:01.171294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bd01f-77b8-42ca-9192-16d07f5ec354", "name": "network-vif-plugged", "status": "completed", "tag": "1122be81-a4b3-4b35-8654-1908a46a4a6e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:24:01.182239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:01.182726 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:01.183193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:01.199478 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] Creating event network-vif-plugged:1122be81-a4b3-4b35-8654-1908a46a4a6e for instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 on n-h2-854119-10 Aug 30 19:24:01.204667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e341e79b-9500-4027-8b37-472d1cedf9bd req-ef817a49-a785-45df-b882-723b6d86c142 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037810 Aug 30 19:24:01.205662 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3583/7315] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:24:01.410269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:01.411215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:01.420711 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:01.421209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:01.421653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:01.422372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:01.422853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:01.423281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:01.572348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:01.585300 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c03ba83-01ac-4985-94d4-fc4fad5bab5f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1392 microversion: 2.1 time: 0.179711 Aug 30 19:24:01.586033 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3733/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:01 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:02.608431 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:02.609150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:02.614157 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:02.614893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:02.623074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:02.623568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:02.624022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:02.624757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:02.625218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:02.625659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:02.793097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:02.805560 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ac3f80fd-2ef6-4250-bf0f-81e5c1532d5b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1564 microversion: 2.1 time: 0.197891 Aug 30 19:24:02.806483 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3584/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:02 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:02.835867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:02.836461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:02.839256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:02.850372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:02.850867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:02.851302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:02.852012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:02.852602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:02.853026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:03.015518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:03.023775 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7dafe5b4-a47f-48ff-a774-aa44bc70d4cd tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1564 microversion: 2.1 time: 0.192773 Aug 30 19:24:03.024368 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3734/7318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:02 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1564 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:04.850881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:04.851507 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:04.853288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9bd01f-77b8-42ca-9192-16d07f5ec354", "tag": "1122be81-a4b3-4b35-8654-1908a46a4a6e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:24:04.859349 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:04.859858 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:04.860269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:04.861185 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:04.861801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:04.862544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:04.864742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:04.865272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:04.865928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:04.882795 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] Creating event network-changed:1122be81-a4b3-4b35-8654-1908a46a4a6e for instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 on n-h2-854119-10 Aug 30 19:24:04.888308 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-96e58afe-0933-428d-b18e-78622b1cdf0c req-a32d18e5-4ab6-4a94-8eb6-c156f3bc5f4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039091 Aug 30 19:24:04.889241 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3735/7319] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:24:05.019064 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:05.028077 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f5647fd3-7cdb-40b8-80ed-a435258e7435 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1564 microversion: 2.1 time: 0.181293 Aug 30 19:24:05.030405 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3585/7320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:04 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:28.291839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=9 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:28.292624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=38 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:28.298593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:24:28.300905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:28.308431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:28.308918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:28.309353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:28.310056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:28.310554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:28.310981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:28.390015 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4322fdb-cecf-4cd0-99cd-481de97c2e4b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action" status: 200 len: 24563 microversion: 2.1 time: 0.100450 Aug 30 19:24:28.390900 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3736/7321] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:24:28 2022] POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action => generated 24563 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:24:34.779321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:24:34.781661 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:34.783834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:34.784899 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=36 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:24:34.791274 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:34.791787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:34.792242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:34.792981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:34.793453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:34.793890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:34.879359 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7a218784-14de-4aa5-84bb-1e60c27173a8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action" status: 202 len: 0 microversion: 2.1 time: 0.103837 Aug 30 19:24:34.880153 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3586/7322] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:24:34 2022] POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:24:34.891164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:34.892203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:34.900583 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:34.901076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:34.901575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:34.902249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:34.902734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:34.903219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:35.128701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:35.137001 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2fa2f957-7583-4eb2-a8ae-5def8d4a0f12 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1675 microversion: 2.1 time: 0.251780 Aug 30 19:24:35.137617 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3737/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:34 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:24:36.161540 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:36.162141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:36.169209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:36.169711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:36.170177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:36.171341 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:36.171831 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:36.172267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:36.322793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:36.331249 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a4cb85d-4892-4340-9fd3-0fac67041c18 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.175079 Aug 30 19:24:36.331789 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3587/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:36 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:37.354662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:37.355280 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:37.362760 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:37.363277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:37.363718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:37.364418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:37.364876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:37.365306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:37.506098 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:37.515122 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0c62d4f8-9fb3-4722-8c2b-69b87b338106 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.164661 Aug 30 19:24:37.515729 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3738/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:37 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:38.545300 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:38.546439 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:38.556746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:38.557242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:38.557838 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:38.558916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:38.559574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:38.560034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:38.708863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:38.717352 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d761f81d-006b-4b28-b8b4-c00d9e3657d6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.178058 Aug 30 19:24:38.717926 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3588/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:38 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:39.742134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:39.742798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:39.750200 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:39.750733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:39.751165 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:39.751867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:39.752322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:39.752751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:39.922107 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:39.935248 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1479d9e2-4737-44fa-92e9-15a42be8f556 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.197271 Aug 30 19:24:39.935831 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3739/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:39 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:40.958479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:40.959238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:40.966517 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:40.967030 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:40.967505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:40.968230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:40.968699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:40.969139 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:41.114597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:41.122709 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a6bfa66d-d684-44d8-ba48-f03898e21c79 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.169253 Aug 30 19:24:41.123340 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3589/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:40 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:42.145602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:42.146190 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:42.153718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:42.154214 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:42.154687 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:42.155399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:42.155864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:42.156292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:42.300169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:42.308745 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-71db4d46-d3cd-4251-9d87-fbaaaf8e390c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.167850 Aug 30 19:24:42.309334 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3740/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:42 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:43.332250 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:43.333641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:43.340215 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:43.340723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:43.341180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:43.341902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:43.342380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:43.342940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:43.488994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:43.497162 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b7dad8d6-ec39-4292-926a-25fcdc76d1d7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.169480 Aug 30 19:24:43.497744 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3590/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:43 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:44.518638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:44.519265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:44.526751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:44.527244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:44.527675 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:44.528374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:44.528827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:44.529253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:44.681599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:44.692836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d9fd673d-4688-4d84-897c-aadfb12478ae tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.177607 Aug 30 19:24:44.693485 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3741/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:44 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:45.719380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:45.720324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:45.731021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:45.731913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:45.732498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:45.733394 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:45.734106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:45.734863 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:45.882375 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:45.890765 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-63ba4f05-06e2-48f7-832f-8407fff1ce9e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1680 microversion: 2.1 time: 0.177768 Aug 30 19:24:45.891459 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3591/7332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:45 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:24:46.913456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:24:46.914030 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:24:46.922111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:46.922638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:46.923072 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:46.923783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:24:46.924239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:24:46.924663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:24:47.078741 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:24:47.088833 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-af91f6e7-fa9b-4bb1-812d-ce3c41755175 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1683 microversion: 2.1 time: 0.179268 Aug 30 19:24:47.089505 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3742/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:24:46 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:11.320847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:11.323134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:11.326742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:11.327422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:11.333662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:11.334164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:11.334635 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:11.335351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:11.335822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:11.336260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:11.415424 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1a1f7754-94cd-4356-b3a1-73e823ef6208 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action" status: 200 len: 69099 microversion: 2.1 time: 0.097967 Aug 30 19:25:11.416302 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3592/7334] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:25:11 2022] POST /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354/action => generated 69099 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:25:18.542228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:18.542805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:18.545916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=14 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:18.546783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=40 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:18.552385 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:18.552671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:18.553093 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:18.554015 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:18.554486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:18.555264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:18.582937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:25:18.610253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9bd01f-77b8-42ca-9192-16d07f5ec354", "tag": "1122be81-a4b3-4b35-8654-1908a46a4a6e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:18.624027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:18.624537 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:18.624995 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:18.638752 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] Creating event network-changed:1122be81-a4b3-4b35-8654-1908a46a4a6e for instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 on n-h2-854119-10 Aug 30 19:25:18.643685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-6b2cbf5b-8ddc-4f5a-87d8-4385d2c81423 req-980b0934-cbe1-47f4-ab12-0961b1316a4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099258 Aug 30 19:25:18.644492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3593/7335] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:18.678415 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-077f5f2d-e454-4455-98b7-6d807092d17e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 204 len: 0 microversion: 2.1 time: 0.140093 Aug 30 19:25:18.679127 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3743/7336] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:25:18 2022] DELETE /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:25:18.696782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:18.698663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:18.708315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:18.709774 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:18.710321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:18.711172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:18.711720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:18.712297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:18.854116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:18.862563 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7db83acf-32cc-42c6-b887-4b5ab5fa1cb7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1689 microversion: 2.1 time: 0.174328 Aug 30 19:25:18.863287 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3594/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:18 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:19.890549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:19.891739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:19.903888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:19.904286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:19.904722 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:19.905420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:19.905870 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:19.906294 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:20.118974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:20.128750 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5c4cb61-741e-4d56-b127-cc6f21353711 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1689 microversion: 2.1 time: 0.245426 Aug 30 19:25:20.129392 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3744/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:19 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1689 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:20.982325 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9bd01f-77b8-42ca-9192-16d07f5ec354", "name": "network-vif-deleted", "tag": "1122be81-a4b3-4b35-8654-1908a46a4a6e"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:20.992058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:20.992542 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:20.992996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:21.005580 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] Creating event network-vif-deleted:1122be81-a4b3-4b35-8654-1908a46a4a6e for instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 on n-h2-854119-10 Aug 30 19:25:21.011726 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ed4bdd7d-25d6-4650-9968-cdbc891bfe6c req-22b2b9b2-da6d-4885-9e81-56fb6b94d4f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102980 Aug 30 19:25:21.013057 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3595/7339] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:21.151869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:21.152482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:21.159871 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:21.160399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:21.160809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:21.161543 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:21.162003 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:21.162468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:21.197412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:21.197897 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:21.198333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:21.198827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lazy-loading 'fault' on Instance uuid 4d9bd01f-77b8-42ca-9192-16d07f5ec354 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:25:21.241260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:21.250040 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e74b5e97-7e61-43f8-88fd-1702228bdbb4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 200 len: 1357 microversion: 2.1 time: 0.101950 Aug 30 19:25:21.251316 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3745/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:21 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:22.274479 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:22.275227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 4d9bd01f-77b8-42ca-9192-16d07f5ec354] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:22.282142 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:22.282747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:22.283167 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:22.283922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:22.284393 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:22.284849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:22.299216 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] HTTP exception thrown: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Request method failure captured: Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 HTTP/1.1 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmN6ul6n3L7wvc_3698wFJi91YDcZurRMRFLjTuBSDFDc1vdTNK3jMJB2gcj8nTDrsq1-CLEJ4KSooyJfTBSuGBErbQpvx9ToQKjEIs9GDjm-3plHfF9YH3DEc6Wv4Z0CB7lsrExP47LzCMizENhfuyZ21YSbZd7z811um62gFVO0HU Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a64e346cf03b4e099835f96c6e763322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e3bb96ea667f4cb8beb46b4c9812fb9d Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '4d9bd01f-77b8-42ca-9192-16d07f5ec354'} Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:25:22.300879 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Returning 404 to user: Instance 4d9bd01f-77b8-42ca-9192-16d07f5ec354 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68216737-7b25-4866-9f06-f973d1e2ab57 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354" status: 404 len: 111 microversion: 2.1 time: 0.033278 Aug 30 19:25:22.305944 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3596/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:22 2022] GET /compute/v2.1/servers/4d9bd01f-77b8-42ca-9192-16d07f5ec354 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:25:26.057850 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4d4e8939-8f75-470c-b7fb-162a31a6ff77 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '.version_select at 0x7f4e5af69e50>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:26.079921 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4d4e8939-8f75-470c-b7fb-162a31a6ff77 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030483706" status: 202 len: 0 microversion: 2.1 time: 0.025825 Aug 30 19:25:26.080675 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3746/7342] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 19:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030483706 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:25:26.109603 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ab427f72-1a7c-44fd-9804-f6efaeb4775a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: .version_select at 0x7f4e56f38550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1813487729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW3XOAj3jQIIUfnidOB5CBHkDERvWmb5ImYGBEKeTT/7RHm6FaMy/uaJadPu+pgBlpI8eHmboPqU4xx+KeHPdc8dUZTM977EY3auZrYEzZaCoagQDxKM1PTmi5bqbs21w=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:26.126368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ab427f72-1a7c-44fd-9804-f6efaeb4775a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:25:26.131494 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-ab427f72-1a7c-44fd-9804-f6efaeb4775a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:25:26.157849 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ab427f72-1a7c-44fd-9804-f6efaeb4775a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052370 Aug 30 19:25:26.158475 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3597/7343] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:25:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:31.825595 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:31.830033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1050776376", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "11a91b64-9281-4e3d-bf56-b2c7a0032f1e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1813487729", "security_groups": [{"name": "tempest-secgroup-smoke-2098326587"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:31.852015 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:25:31.852163 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Aug 30 19:25:31.946487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] validate_networks() for [('11a91b64-9281-4e3d-bf56-b2c7a0032f1e', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:25:32.364761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:25:32.365640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:25:32.366537 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:25:32.367173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:25:32.367689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:25:32.379608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:32.380800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:32.381335 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:32.382215 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:32.382795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:32.383398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:32.404985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:25:32.410872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:25:32.424765 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:25:32.427371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:25:32.483471 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1dac9f03-cf0c-48e2-a491-81beb2d46a43 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.659548 Aug 30 19:25:32.484569 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3747/7344] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:25:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 19:25:32.494289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:32.500832 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ffa5e730-9599-4966-b835-9f74d22a2bff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:32.501221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ffa5e730-9599-4966-b835-9f74d22a2bff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:32.575012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ffa5e730-9599-4966-b835-9f74d22a2bff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:32.584108 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ffa5e730-9599-4966-b835-9f74d22a2bff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1267 microversion: 2.1 time: 0.092267 Aug 30 19:25:32.584951 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3598/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:32 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:33.619261 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:33.622833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:33.633546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:33.638620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:33.639164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:33.639924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:33.640395 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:33.640834 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:33.706436 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:33.715040 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-622c7a8b-1ab8-4cf4-ac7d-cdae79d93597 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1337 microversion: 2.1 time: 0.111915 Aug 30 19:25:33.716210 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3748/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:33 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:34.737136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:34.737768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:34.748647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:34.749447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:34.749894 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:34.750651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:34.751310 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:34.751753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:35.012296 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:35.023359 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3690f25b-f5a8-4042-b179-542161f916e1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1393 microversion: 2.1 time: 0.290128 Aug 30 19:25:35.024594 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3599/7347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:34 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1393 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:35.163052 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:35.178277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:35.179426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:35.180096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:35.205827 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] Creating event network-changed:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h1-854119-10 Aug 30 19:25:35.215677 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-b85a3049-c37f-4d05-9736-7ebdfb56d72d req-05f1c3b3-3d4a-4109-8120-80c628aec47d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057541 Aug 30 19:25:35.216631 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3749/7348] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:36.048708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:36.049445 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:36.058189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:36.058814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:36.059752 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:36.060164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:36.060713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:36.061228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:36.204315 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:36.212659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ee1e8073-7b62-4ac8-9b12-05ed1553971e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1393 microversion: 2.1 time: 0.169374 Aug 30 19:25:36.213219 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3600/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:36 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:37.234902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:37.235597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:37.242182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:37.242757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:37.243193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:37.243903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:37.244356 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:37.244885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:37.394296 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:37.402071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7deb120-2268-4b63-929e-e37d483ed3a7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1393 microversion: 2.1 time: 0.172538 Aug 30 19:25:37.402685 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3750/7350] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:37 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:38.428506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:38.429546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:38.441679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:38.442687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:38.443460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:38.444655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:38.445455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:38.446199 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:38.584686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:38.592955 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2ae898b1-83c5-47db-a35b-90cb63088cb6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1393 microversion: 2.1 time: 0.171525 Aug 30 19:25:38.593550 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3601/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:38 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:39.251569 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "name": "network-vif-plugged", "status": "completed", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:39.262750 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:39.263318 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:39.263877 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:39.278521 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] Creating event network-vif-plugged:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h1-854119-10 Aug 30 19:25:39.284305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-c8123ef1-2fcb-4326-b128-b871d88c9974 req-befbb7ed-724a-4375-9d6a-df9a60ca644e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036129 Aug 30 19:25:39.284570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3751/7352] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:39.616025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:39.616771 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:39.625516 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:39.626021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:39.626531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:39.627219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:39.627720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:39.628160 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:39.768276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:39.776289 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1c6c21fe-4843-4e27-be27-2eac44343774 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1393 microversion: 2.1 time: 0.165285 Aug 30 19:25:39.776870 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3602/7353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:39 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:40.805278 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:40.805961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:40.812651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:40.813133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:40.813572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:40.814256 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:40.814746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:40.815166 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:40.950989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:40.959359 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f616441b-7e90-410f-a572-1afce5bf03e6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1565 microversion: 2.1 time: 0.159250 Aug 30 19:25:40.959939 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3752/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:40 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:40.981702 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:40.982337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:40.989901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:40.990449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:40.990900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:40.991620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:40.992100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:40.992546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:41.138101 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:41.147227 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8f680f9-15b9-44c6-a01c-4806b57b8a2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1565 microversion: 2.1 time: 0.169616 Aug 30 19:25:41.147801 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3603/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:40 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:25:42.817011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:25:42.817637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:25:42.820531 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:42.821353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:42.825221 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:25:42.831095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:42.831793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:25:42.839035 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:42.839526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:42.839955 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:42.847289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:42.847778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:42.848216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:42.853220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:25:42.853815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:25:42.854257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:25:42.865927 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] Creating event network-changed:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h1-854119-10 Aug 30 19:25:42.871944 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-96bdc37f-622f-4c21-b0fd-f2e4e5e98495 req-dd9ff63e-922e-4f9e-9850-72276614e7c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059186 Aug 30 19:25:42.876984 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3604/7356] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:25:43.008693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:25:43.019465 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6173d484-e3e8-4f2a-9cb2-dfc14314f310 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1565 microversion: 2.1 time: 0.209384 Aug 30 19:25:43.020384 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3753/7357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:25:42 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1565 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:06.294678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=32 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:06.295436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:06.300493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:06.302913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:06.310909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:06.311419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:06.311880 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:06.312604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:06.313272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:06.313725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:06.370943 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-113591ef-b43b-4558-80c7-1346d82899b6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action" status: 200 len: 24572 microversion: 2.1 time: 0.077903 Aug 30 19:26:06.371776 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3605/7358] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:26:06 2022] POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:26:12.806112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:12.808420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:12.810542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:12.811331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=30 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:12.817241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:12.817733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:12.818205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:12.818937 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:12.819564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:12.820239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:12.865268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:12.872922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Old instance type m1.heat2, new instance type m1.heat {{(pid=122589) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 19:26:12.879935 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:26:12.880359 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:26:12.880841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:26:12.881255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:26:12.881667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:26:12.965268 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-53a350bd-6305-49dc-b625-457e66783fed tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action" status: 202 len: 0 microversion: 2.1 time: 0.163293 Aug 30 19:26:12.966444 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3754/7359] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:26:12 2022] POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:26:12.976898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:12.977648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:12.985643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:12.986156 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:12.986669 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:12.987847 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:12.988673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:12.989460 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:13.131509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:13.140090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7142fd39-6cd2-44c2-8464-7d351ae7a95f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1693 microversion: 2.1 time: 0.168401 Aug 30 19:26:13.140651 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3606/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:12 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:14.162263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:14.163002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:14.169221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:14.169697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:14.170126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:14.171189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:14.171635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:14.172049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:14.563475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:14.574009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ff2735d9-992f-4541-b280-9bc886a314ff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1693 microversion: 2.1 time: 0.416532 Aug 30 19:26:14.574530 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3755/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:14 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1693 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:15.600879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:15.601718 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:15.613589 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:15.614486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:15.615267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:15.616446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:15.617266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:15.618174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:15.771447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:15.780278 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bc8ae923-4915-4ce8-ad6c-33c6fd3118f7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.186418 Aug 30 19:26:15.780846 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3607/7362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:15 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:16.807344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:16.808347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:16.824795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:16.825289 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:16.825732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:16.826478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:16.826947 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:16.827376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:16.980338 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:16.992498 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ac39edb0-5a16-4d91-baeb-df227471dda1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.191910 Aug 30 19:26:16.993295 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3756/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:16 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:18.019982 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:18.021025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:18.032962 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:18.033814 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:18.034636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:18.035862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:18.036690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:18.037432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:18.184392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:18.193244 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6c6eabe1-4b54-46b7-bc4f-3799284b4312 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.180178 Aug 30 19:26:18.193829 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3608/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:18 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:19.218882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:19.219840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:19.232255 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:19.233070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:19.233803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:19.235005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:19.235773 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:19.236486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:19.395759 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:19.404144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2717d667-e66d-44b7-b82a-bdcee72bdbff tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.192065 Aug 30 19:26:19.404723 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3757/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:19 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:20.430597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:20.431707 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:20.443478 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:20.444321 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:20.445125 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:20.446266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:20.446772 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:20.447219 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:20.586123 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:20.594378 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-acb774e6-a504-4613-aaaa-976a693a7da7 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.170747 Aug 30 19:26:20.594979 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3609/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:20 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:21.620495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:21.621202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:21.629612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:21.630156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:21.630673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:21.631447 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:21.631930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:21.632419 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:21.768012 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:21.776205 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-79719120-a1dd-4c7c-8bfc-4e781f30ff39 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.162151 Aug 30 19:26:21.776794 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3758/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:21 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:22.802977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:22.804151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:22.816549 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:22.817384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:22.818135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:22.819378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:22.820162 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:22.820983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:22.963093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:22.971644 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-eeb94395-4fe4-47af-82a7-8577ee8f694f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.175707 Aug 30 19:26:22.972225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3610/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:22 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:24.004977 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:24.005540 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:24.013518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:24.014007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:24.014478 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:24.015182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:24.015633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:24.016056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:24.158295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:24.167134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-224ad6a0-5d8b-491a-b78b-e716a37fd3bb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.165686 Aug 30 19:26:24.167427 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3759/7369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:23 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:25.193173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:25.194146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:25.205981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:25.206871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:25.207632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:25.208812 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:25.209605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:25.210399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:25.349449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:25.357834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-52d33ba3-5cd0-4275-9dde-196da40d1e27 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.171519 Aug 30 19:26:25.358436 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3611/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:25 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:26.387086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:26.387836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:26.395251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:26.395744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:26.396175 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:26.396888 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:26.397340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:26.397764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:26.538934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:26.548204 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9cecbc92-ff9f-4941-9c7f-53d15bd4ea41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1698 microversion: 2.1 time: 0.166642 Aug 30 19:26:26.548759 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3760/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:26 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:27.570732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:27.571257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:27.578256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:27.578806 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:27.579261 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:27.579980 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:27.580448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:27.580890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:27.796257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:27.804702 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3c1c7a3-d426-4340-8d04-bb6024315836 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1697 microversion: 2.1 time: 0.238087 Aug 30 19:26:27.805403 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3612/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:27 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1697 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:27.816950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "name": "network-vif-unplugged", "status": "completed", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:27.827568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:27.828250 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:27.828709 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:27.841302 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Creating event network-vif-unplugged:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h2-854119-10 Aug 30 19:26:27.847020 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:26:27.858123 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d4311c00-895c-4e39-bdc0-2ccdb895290d req-c781b22c-5da7-4057-b4e9-dfca94fce5ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045098 Aug 30 19:26:27.858770 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3761/7373] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:26:28.827643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:28.828268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:28.836268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:28.836884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:28.837338 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:28.838090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:28.838833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:28.839440 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:28.975011 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:28.983392 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-251aa939-3284-402c-ab4d-50129e84f549 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1697 microversion: 2.1 time: 0.159789 Aug 30 19:26:28.984000 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3613/7374] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:28 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:29.877909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:29.888128 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:29.888609 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:29.889051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:29.901267 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Creating event network-changed:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h2-854119-10 Aug 30 19:26:29.906989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854119-10', 'n-h2-854119-10'} {{(pid=122589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 19:26:29.918097 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-199fbdc1-b875-4913-b445-a07cba3f6bea req-40b0adf7-fba8-4151-af1c-34fd70b45530 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045158 Aug 30 19:26:29.918732 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3762/7375] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:26:30.005458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:30.006122 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:30.013787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:30.014298 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:30.014790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:30.015521 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:30.015997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:30.016443 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:30.341754 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:30.351202 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f80402ec-65fb-476b-b92d-5807720b789f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1695 microversion: 2.1 time: 0.349633 Aug 30 19:26:30.352124 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3614/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:30 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1695 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:31.380396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:31.381503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:31.392594 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.393417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.394133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.395406 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.396169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.396924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.535585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:31.543920 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c7c208d6-bdf1-4078-a2ff-1833129582e8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1692 microversion: 2.1 time: 0.172307 Aug 30 19:26:31.544504 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3763/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:31 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:31.565046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:31.565586 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:31.572855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.573701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.574194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.574943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.575416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.575862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.646795 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5cf8e59-55f0-4caa-9252-9896a619bf2c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action" status: 204 len: 0 microversion: 2.1 time: 0.085351 Aug 30 19:26:31.647346 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3615/7378] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:26:31 2022] POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:26:31.655671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:31.656285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:31.662503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.662994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.663401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.664130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.664581 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.665036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.808970 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:31.817425 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8fb16636-0948-46da-b467-384b78c9060a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1692 microversion: 2.1 time: 0.165462 Aug 30 19:26:31.822173 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3764/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:31 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:31.839272 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:31.840109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:31.846891 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.847686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.848239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:31.849040 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:31.849587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:31.850095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:32.077151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:32.085273 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8076b47-40db-4fb7-9695-4818044f977b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1692 microversion: 2.1 time: 0.250555 Aug 30 19:26:32.085969 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3616/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:31 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1692 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:33.109040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:26:33.109632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:33.116723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:33.117208 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:33.117677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:33.118370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:33.118853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:33.119282 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:33.257021 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:26:33.265969 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb19ba23-a91e-4ec1-9fe2-fcb8622b3d32 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1684 microversion: 2.1 time: 0.161659 Aug 30 19:26:33.266665 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3765/7381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:26:33 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:26:34.065900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "name": "network-vif-plugged", "status": "completed", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:34.076208 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:34.076706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:34.077155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:34.089155 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] Creating event network-vif-plugged:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h2-854119-10 Aug 30 19:26:34.094186 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-8b668ff8-2dcc-4e81-b3a6-f822bb604bee req-b3707795-9650-4584-9e46-68a91821cb09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088107 Aug 30 19:26:34.094851 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3617/7382] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:26:55.481218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:26:55.483490 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:26:55.485707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=28 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:55.486375 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:26:55.493102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:55.493590 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:55.494026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:55.494775 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:26:55.495272 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:26:55.495698 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:26:55.567889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2ba2edd5-56a5-4df2-adff-79454dda0413 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action" status: 200 len: 24578 microversion: 2.1 time: 0.090943 Aug 30 19:26:55.568543 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3766/7383] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:26:55 2022] POST /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8/action => generated 24578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:27:02.661446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=26 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:02.662628 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:02.664046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:02.669680 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:02.671018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:02.675866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:02.676423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:02.676836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:02.678530 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:02.679169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:02.679748 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:02.680677 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:02.681153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:02.681583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:02.691337 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] Creating event network-changed:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h2-854119-10 Aug 30 19:27:02.696802 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1b26d26d-7e06-4f88-9f78-cc78a35e6655 req-4cf0b3b0-37c8-445b-ab47-0b58fe22fdbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039045 Aug 30 19:27:02.700800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3767/7384] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:02.714636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:27:02.802845 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9aea9bb5-a166-4cfa-922a-1e531ba840b3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 204 len: 0 microversion: 2.1 time: 0.147693 Aug 30 19:27:02.803479 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3618/7385] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:27:02 2022] DELETE /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:27:02.812824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:02.813528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:02.820607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:02.821095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:02.821533 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:02.822269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:02.822752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:02.823174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:02.971635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:02.980865 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d20b615e-eff6-4eaf-8931-e2cd783a0a7b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1690 microversion: 2.1 time: 0.172440 Aug 30 19:27:02.986381 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3768/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:02 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:04.003766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:04.004492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:04.011971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:04.012466 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:04.012940 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:04.013659 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:04.014138 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:04.014617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:04.166625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:04.175426 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-39c4edd3-1193-4acd-bb06-83037814c31c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1690 microversion: 2.1 time: 0.176123 Aug 30 19:27:04.176008 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3619/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:03 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:05.198640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:05.199201 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:05.209664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:05.209664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:05.209664 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:05.211451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:05.212842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:05.213084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:05.267090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d958e3c5-a3e9-456b-89d2-10860b8329d8", "name": "network-vif-deleted", "tag": "a969da0a-fb74-4823-b0dc-0126d0356742"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:05.278868 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:05.279373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:05.279787 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:05.296237 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] Creating event network-vif-deleted:a969da0a-fb74-4823-b0dc-0126d0356742 for instance d958e3c5-a3e9-456b-89d2-10860b8329d8 on n-h2-854119-10 Aug 30 19:27:05.303631 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-14c25991-a1e2-4a89-97bf-123e1f7d27f4 req-50057ec2-efca-4d32-a58f-046a3a9342a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040996 Aug 30 19:27:05.304996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3620/7388] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:05.307699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:05.318018 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b7331199-c248-4c8a-a3b8-38625ae83ba1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 200 len: 1503 microversion: 2.1 time: 0.124748 Aug 30 19:27:05.318898 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3769/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:05 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 1503 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:06.347287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:06.348469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: d958e3c5-a3e9-456b-89d2-10860b8329d8] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:06.356223 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:06.356729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:06.357187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:06.357912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:06.358387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:06.358856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:06.373057 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] HTTP exception thrown: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Request method failure captured: Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 HTTP/1.1 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmN6ul6n3L7wvc_3698wFJi91YDcZurRMRFLjTuBSDFDc1vdTNK3jMJB2gcj8nTDrsq1-CLEJ4KSooyJfTBSuGBErbQpvx9ToQKjEIs9GDjm-3plHfF9YH3DEc6Wv4Z0CB7lsrExP47LzCMizENhfuyZ21YSbZd7z811um62gFVO0HU Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a64e346cf03b4e099835f96c6e763322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e3bb96ea667f4cb8beb46b4c9812fb9d Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'd958e3c5-a3e9-456b-89d2-10860b8329d8'} Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:27:06.374744 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Returning 404 to user: Instance d958e3c5-a3e9-456b-89d2-10860b8329d8 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f6e44441-2369-46c3-b9ba-8adc006dc8b9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8" status: 404 len: 111 microversion: 2.1 time: 0.037682 Aug 30 19:27:06.379232 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3621/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:06 2022] GET /compute/v2.1/servers/d958e3c5-a3e9-456b-89d2-10860b8329d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:27:09.821980 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-84d8bb88-c8de-447c-8d7f-ae2991420214 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '.version_select at 0x7f4e56ec2b80>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:09.845959 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-84d8bb88-c8de-447c-8d7f-ae2991420214 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1813487729" status: 202 len: 0 microversion: 2.1 time: 0.027919 Aug 30 19:27:09.850734 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3770/7391] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 19:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1813487729 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:27:09.874053 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2575fbf2-efa4-4d1f-bc83-c23b5102c603 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: .version_select at 0x7f4e569989d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1517735029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaXQIi2mOPAAU9Qd8iDi2yrr2yjbdO5BWWKg7GZ3aDuLG8aqxSiBR9D3T3qYFEs7S99Qn1NrB62Q1u8OvZnMbiKpVtBJX0phpv8bPGFyg+uAo8zdmqoKO2tgHOl7KpuAw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:09.894322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2575fbf2-efa4-4d1f-bc83-c23b5102c603 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:27:09.903016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-2575fbf2-efa4-4d1f-bc83-c23b5102c603 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:27:09.928063 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2575fbf2-efa4-4d1f-bc83-c23b5102c603 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058223 Aug 30 19:27:09.928675 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3622/7392] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:27:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:15.936116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:15.942094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1711887995", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "e514eba9-bdde-4b7c-915f-8bc8b7633bbb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1517735029", "security_groups": [{"name": "tempest-secgroup-smoke-508265226"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:16.066620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] validate_networks() for [('e514eba9-bdde-4b7c-915f-8bc8b7633bbb', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:27:16.511922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:27:16.512617 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:27:16.513076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:27:16.513715 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:27:16.514135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:27:16.523485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:16.523971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:16.524412 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:16.525146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:16.525608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:16.526172 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:16.544567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:27:16.551837 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:27:16.565173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:27:16.567598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:27:16.615664 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b9f9afe3-7ac1-4393-932d-591219678172 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681790 Aug 30 19:27:16.616508 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3771/7393] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:27:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:27:16.627802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-784e4442-67f2-4ef2-b588-3940d907fd08 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:16.628489 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-784e4442-67f2-4ef2-b588-3940d907fd08 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:16.631783 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:27:16.631925 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de (ip 10.222.0.25) !!! Aug 30 19:27:16.634822 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:16.720714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-784e4442-67f2-4ef2-b588-3940d907fd08 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:16.729435 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-784e4442-67f2-4ef2-b588-3940d907fd08 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1267 microversion: 2.1 time: 0.105693 Aug 30 19:27:16.730335 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3623/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:16 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:17.751585 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:17.752287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:17.760497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:17.761117 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:17.761601 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:17.762413 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:17.763090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:17.763739 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:17.869971 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:17.883135 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eb5bb55b-8628-41a1-890b-39dad6f561c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1327 microversion: 2.1 time: 0.136572 Aug 30 19:27:17.885293 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3772/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:17 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:27:18.905503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:18.906108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:18.913178 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:18.913682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:18.914244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:18.915192 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:18.915666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:18.916107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:19.061604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:19.079664 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d6a14cb0-550b-41fc-9ca7-109424468de9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.175471 Aug 30 19:27:19.080300 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3624/7396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:18 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:19.209173 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed40fa38-cdcd-4dfa-b103-8728074975de", "tag": "f52f3618-f87d-4dd5-9184-5fe58555c1b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:19.225684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:19.226268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:19.226930 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:19.238720 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] Creating event network-changed:f52f3618-f87d-4dd5-9184-5fe58555c1b3 for instance ed40fa38-cdcd-4dfa-b103-8728074975de on n-h2-854119-10 Aug 30 19:27:19.243949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bafc8afe-f0de-4388-90c0-b0be599ed5a0 req-f1d5b092-e79a-4df9-a019-004c4e6e8ba1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044444 Aug 30 19:27:19.245139 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3773/7397] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:20.104294 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:20.105217 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:20.115640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:20.116364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:20.117069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:20.118009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:20.118518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:20.118977 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:20.267255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:20.275682 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1e6f1426-8f4b-4195-a6a1-1222c2e75acb tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.177393 Aug 30 19:27:20.276543 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3625/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:20 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:21.304386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:21.305894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:21.316633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:21.317475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:21.318228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:21.319453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:21.320347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:21.320908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:21.459253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:21.467815 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b1f06fe0-8c14-4bb1-aea8-7ff633fe8b92 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.172731 Aug 30 19:27:21.468396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3774/7399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:21 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:22.492411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:22.493055 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:22.500764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:22.501256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:22.501699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:22.502399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:22.502890 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:22.503324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:22.651289 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:22.659052 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-16f8a3b4-e7e0-4868-a25c-fe61cd95477a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.173104 Aug 30 19:27:22.659875 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3626/7400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:22 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:23.685241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:23.686125 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:23.693329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:23.693813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:23.694273 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:23.695237 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:23.695475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:23.695899 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:23.826791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:23.834626 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-922ad0c0-7de6-4f15-bd3b-c34ce3ade5c1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.156119 Aug 30 19:27:23.835208 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3775/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:23 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:24.314922 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed40fa38-cdcd-4dfa-b103-8728074975de", "name": "network-vif-plugged", "status": "completed", "tag": "f52f3618-f87d-4dd5-9184-5fe58555c1b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:24.326618 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:24.328077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:24.328569 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:24.340433 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] Creating event network-vif-plugged:f52f3618-f87d-4dd5-9184-5fe58555c1b3 for instance ed40fa38-cdcd-4dfa-b103-8728074975de on n-h2-854119-10 Aug 30 19:27:24.345735 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2732c132-5cbd-46f9-ad51-d73d40873d9e req-d9f083b1-da1c-4bd8-ae33-13d1b03bb78c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035022 Aug 30 19:27:24.346329 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3627/7402] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:24.859986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:24.860828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:24.872578 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:24.873400 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:24.874069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:24.875306 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:24.876054 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:24.876756 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:25.017856 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:25.030114 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0123f302-1f72-4a23-b8cc-1f92d334625a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1392 microversion: 2.1 time: 0.176608 Aug 30 19:27:25.030915 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3776/7403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:24 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:26.052859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:26.053538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:26.061266 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:26.061762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:26.062210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:26.062947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:26.063413 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:26.063849 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:26.203546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:26.212430 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b8ee7989-1cd4-4737-a9e6-e12a43fb5c2e tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1565 microversion: 2.1 time: 0.163928 Aug 30 19:27:26.213029 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3628/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:26 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:26.233310 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:26.233919 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:26.236766 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:26.243059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:26.243546 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:26.243982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:26.244681 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:26.245132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:26.245554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:26.397983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:26.406716 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6cb2c527-c59a-4e65-a956-c612f52df682 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1565 microversion: 2.1 time: 0.177211 Aug 30 19:27:26.407217 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3777/7405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:26 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:28.354443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed40fa38-cdcd-4dfa-b103-8728074975de", "tag": "f52f3618-f87d-4dd5-9184-5fe58555c1b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:28.359238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:28.359876 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:28.361587 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:28.362287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:28.364764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:28.367902 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:28.368381 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:28.368787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:28.373802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:28.374376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:28.374826 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:28.375558 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:28.376031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:28.376480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:28.381614 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] Creating event network-changed:f52f3618-f87d-4dd5-9184-5fe58555c1b3 for instance ed40fa38-cdcd-4dfa-b103-8728074975de on n-h2-854119-10 Aug 30 19:27:28.386961 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-25f0819a-7ef9-443b-b6c4-90ebdc24a97e req-374c815b-50f4-4537-a071-89ee462610c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036216 Aug 30 19:27:28.387639 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3778/7406] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:27:28.512930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:28.521362 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50a22aa9-36d3-4495-8cf7-ca3eefd4981a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1565 microversion: 2.1 time: 0.173292 Aug 30 19:27:28.522180 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3629/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:28 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:27:51.812393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:51.813426 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=36 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:51.870603 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:51.873240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:51.879444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:51.879924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:51.880353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:51.881048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:51.881495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:51.881909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:51.954568 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5c98341-b046-440f-b9ee-96b24ce3d2be tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action" status: 200 len: 24568 microversion: 2.1 time: 0.143793 Aug 30 19:27:51.955243 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3779/7408] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:27:51 2022] POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action => generated 24568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:27:58.320671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:27:58.323746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:58.324415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=32 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:27:58.331307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:58.331813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:58.332268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:58.356152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Going to try to stop instance {{(pid=122590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 19:27:58.402922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-af02f89e-27d0-4749-a29b-2ed2e51fcf52 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action" status: 202 len: 0 microversion: 2.1 time: 0.089320 Aug 30 19:27:58.403535 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3630/7409] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:27:58 2022] POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:27:58.414244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:58.414961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:58.422632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:58.423111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:58.423571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:58.424235 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:58.424695 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:58.425206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:58.568723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:58.576782 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-17ed956e-db22-49d4-92b0-6b2fc9982311 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.166645 Aug 30 19:27:58.577272 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3780/7410] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:58 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:27:59.604925 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:27:59.605964 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:27:59.612760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:59.613264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:59.613717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:59.614470 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:27:59.614943 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:27:59.615384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:27:59.751145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:27:59.759179 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b15b9cf-83c4-468f-8309-2f76e639a6f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.162856 Aug 30 19:27:59.759739 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3631/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:27:59 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:00.785331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:00.786327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:00.798498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:00.799298 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:00.800301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:00.802024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:00.803203 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:00.804346 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:00.958144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:00.966539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6a36d60-3371-4d8b-b384-1dd40e303b9b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.187835 Aug 30 19:28:00.967138 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3781/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:00 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:01.989149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:01.989810 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:01.997120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:01.997622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:01.998079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:01.998824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:01.999302 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:01.999740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:02.161328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:02.169487 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dc91e7d6-aef6-484f-a1cd-e2dc1e14f683 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.184536 Aug 30 19:28:02.170042 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3632/7413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:01 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:03.195602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:03.196562 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:03.208461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:03.209285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:03.209991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:03.211283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:03.211989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:03.212733 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:03.351672 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:03.362141 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2c528c98-26ae-41e1-901a-7365cd8d5b50 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.173170 Aug 30 19:28:03.362753 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3782/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:03 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:04.387284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:04.387898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:04.395292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:04.395790 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:04.396236 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:04.396948 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:04.397412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:04.397848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:04.536288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:04.544422 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ca29113-4ce1-43f7-b810-31e11d021cef tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.163445 Aug 30 19:28:04.545008 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3633/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:04 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:05.566904 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:05.567560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:05.575677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:05.576159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:05.576607 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:05.577302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:05.577753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:05.578178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:05.754089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:05.764752 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1299d12b-c385-410d-bf25-45e03ab230af tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.201808 Aug 30 19:28:05.765333 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3783/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:05 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:06.800535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:06.801111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:06.808872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:06.809340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:06.809797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:06.810535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:06.811023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:06.811447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:06.961585 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:06.970042 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bb8dae7b-5586-4233-8118-dc27694cb910 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.173606 Aug 30 19:28:06.970655 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3634/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:06 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:07.994984 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:07.995922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:08.003362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:08.003853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:08.004293 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:08.004999 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:08.005455 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:08.005882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:08.154528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:08.166220 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-80ee48d8-4082-473a-a858-b6359bbbe3f9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1694 microversion: 2.1 time: 0.177215 Aug 30 19:28:08.167024 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3784/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:07 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:09.191376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:09.192201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:09.202171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:09.202683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:09.203163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:09.203879 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:09.204346 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:09.204777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:09.349818 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:09.358050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41ba5829-aed4-4d9b-8397-347f704cac86 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1671 microversion: 2.1 time: 0.172380 Aug 30 19:28:09.358695 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3635/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:09 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:10.500434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:10.504153 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:10.514331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:10.514867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:10.515304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:10.516002 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:10.516496 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:10.516972 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:10.583910 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-96ae127f-51ae-4369-8b1a-7e27210eee19 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action" status: 200 len: 35361 microversion: 2.1 time: 0.090013 Aug 30 19:28:10.584704 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3785/7420] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:28:10 2022] POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action => generated 35361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:28:10.596901 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:10.604416 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:10.604926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:10.605381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:10.629412 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Going to try to start instance {{(pid=122590) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 19:28:10.677786 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-671e47a9-64d9-412b-b2ca-901661b197d5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action" status: 202 len: 0 microversion: 2.1 time: 0.084740 Aug 30 19:28:10.678996 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3636/7421] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:28:10 2022] POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:28:10.688122 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:10.688886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:10.696269 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:10.696753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:10.697189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:10.697931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:10.698380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:10.698824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:10.872836 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:10.881071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f5f5c32c-e455-417a-b25f-3e72407d2211 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1680 microversion: 2.1 time: 0.197260 Aug 30 19:28:10.881945 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3786/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:10 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:28:11.904804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:11.905505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:11.912859 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:11.913351 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:11.913798 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:11.914544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:11.915003 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:11.915437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:12.063239 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:12.071283 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-decb355c-8f35-406f-954b-8557686e23f4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1680 microversion: 2.1 time: 0.171598 Aug 30 19:28:12.071853 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3637/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:11 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:13.094894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:13.095502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:13.102883 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:13.103363 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:13.103796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:13.104482 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:13.104929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:13.105343 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:13.254839 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:13.263819 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-198b5f5f-af7c-49dd-89e6-afdaec55fdab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1684 microversion: 2.1 time: 0.173394 Aug 30 19:28:13.264570 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3787/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:13 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:37.479392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:37.481674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:37.485023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:37.485709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:37.492318 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:37.492834 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:37.493297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:37.494009 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:37.494498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:37.494936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:37.577455 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3d8d76c8-dcee-4f03-9b10-711f476804ab tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action" status: 200 len: 59923 microversion: 2.1 time: 0.102292 Aug 30 19:28:37.578264 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3638/7425] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:28:37 2022] POST /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de/action => generated 59923 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:28:44.913875 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:44.914441 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:44.919311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed40fa38-cdcd-4dfa-b103-8728074975de", "tag": "f52f3618-f87d-4dd5-9184-5fe58555c1b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:44.921399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=18 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:44.922734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=50 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:44.923557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:44.924008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:44.924433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:44.925144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:44.925589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:44.925998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:44.933436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:44.934141 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:44.934644 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:44.947302 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] Creating event network-changed:f52f3618-f87d-4dd5-9184-5fe58555c1b3 for instance ed40fa38-cdcd-4dfa-b103-8728074975de on n-h2-854119-10 Aug 30 19:28:44.953267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:28:44.953639 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-00afe5ac-1158-466e-908b-59261c1d2496 req-4b19e360-38a7-4ac5-aaa2-9054362e422e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040033 Aug 30 19:28:44.954302 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3639/7426] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:28:45.044036 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ed6ad3e9-a5d6-42b6-a2e5-74ac3110a232 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 204 len: 0 microversion: 2.1 time: 0.133622 Aug 30 19:28:45.051328 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3788/7427] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:28:44 2022] DELETE /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:28:45.058595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:45.059347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:45.066519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:45.067018 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:45.067468 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:45.068193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:45.068662 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:45.069102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:45.207230 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:45.215724 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c076eb46-bda4-4f33-90e4-dd2554ea4904 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1690 microversion: 2.1 time: 0.162545 Aug 30 19:28:45.216344 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3640/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:45 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:46.242532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:46.243096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:46.251259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:46.251742 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:46.252206 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:46.252931 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:46.253393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:46.253825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:46.466103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:46.474438 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-aea65901-0cea-4324-9c18-f8e3fee838a6 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1690 microversion: 2.1 time: 0.238564 Aug 30 19:28:46.475037 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3789/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:46 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:47.120076 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed40fa38-cdcd-4dfa-b103-8728074975de", "name": "network-vif-deleted", "tag": "f52f3618-f87d-4dd5-9184-5fe58555c1b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:47.132418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:47.132916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:47.133367 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:47.145188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] Creating event network-vif-deleted:f52f3618-f87d-4dd5-9184-5fe58555c1b3 for instance ed40fa38-cdcd-4dfa-b103-8728074975de on n-h2-854119-10 Aug 30 19:28:47.151011 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-e0eda67c-0fbe-4821-ab55-2ebc19ba6fe8 req-88a15c7e-bcdd-4469-ba17-1151abc32e56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034858 Aug 30 19:28:47.151667 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3641/7430] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:28:47.498407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:47.499007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:47.506788 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:47.507276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:47.507714 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:47.508423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:47.508913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:47.509333 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:47.543212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:47.543693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:47.544116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:47.544559 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lazy-loading 'fault' on Instance uuid ed40fa38-cdcd-4dfa-b103-8728074975de {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:28:47.586168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:47.594111 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fefc6bec-ef68-460a-8800-cc8c3af1be10 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 200 len: 1357 microversion: 2.1 time: 0.100550 Aug 30 19:28:47.594746 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3790/7431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:47 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:48.621508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:48.622226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: ed40fa38-cdcd-4dfa-b103-8728074975de] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:48.629335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:48.629830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:48.630287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:48.631034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:48.631505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:48.631951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:48.646303 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] HTTP exception thrown: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Request method failure captured: Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de HTTP/1.1 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmN6ul6n3L7wvc_3698wFJi91YDcZurRMRFLjTuBSDFDc1vdTNK3jMJB2gcj8nTDrsq1-CLEJ4KSooyJfTBSuGBErbQpvx9ToQKjEIs9GDjm-3plHfF9YH3DEc6Wv4Z0CB7lsrExP47LzCMizENhfuyZ21YSbZd7z811um62gFVO0HU Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a64e346cf03b4e099835f96c6e763322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e3bb96ea667f4cb8beb46b4c9812fb9d Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': 'ed40fa38-cdcd-4dfa-b103-8728074975de'} Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:28:48.648119 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Returning 404 to user: Instance ed40fa38-cdcd-4dfa-b103-8728074975de could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-32183805-bd92-4ee8-a3f9-eac2306d64cc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de" status: 404 len: 111 microversion: 2.1 time: 0.035828 Aug 30 19:28:48.653198 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3642/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:48 2022] GET /compute/v2.1/servers/ed40fa38-cdcd-4dfa-b103-8728074975de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:28:52.348246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b018b71-590a-44fb-95b2-84cf0872300c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '.version_select at 0x7f4e56ab05e0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:52.370949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b018b71-590a-44fb-95b2-84cf0872300c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1517735029" status: 202 len: 0 microversion: 2.1 time: 0.026806 Aug 30 19:28:52.371521 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3791/7433] 10.222.0.25 () {58 vars in 1284 bytes} [Tue Aug 30 19:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1517735029 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:28:52.401077 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d635d036-3165-4dc7-8be5-b5bb150e82bc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: .version_select at 0x7f4e56f0a280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-692449223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJADP0TuDzjnhCsYw70OQBOncJjUkSbPFgxFaRLyE04eYUA+i7DmRJ5FKap9K/4NJiPtgns4amUdc+nU4atwNgABEwh0UygnAK+vR8484mNAXZEVbyGG0WP0/mGRwfgHw=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:52.418602 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d635d036-3165-4dc7-8be5-b5bb150e82bc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:28:52.424293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-d635d036-3165-4dc7-8be5-b5bb150e82bc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:28:52.452135 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d635d036-3165-4dc7-8be5-b5bb150e82bc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055054 Aug 30 19:28:52.452675 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3643/7434] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:28:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:28:57.764011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-935336943", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "networks": [{"uuid": "cd3ba4e8-e43a-4a46-9996-0043755e5652"}], "key_name": "tempest-TestNetworkAdvancedServerOps-692449223", "security_groups": [{"name": "tempest-secgroup-smoke-2132917416"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:28:57.794137 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:58.000625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] validate_networks() for [('cd3ba4e8-e43a-4a46-9996-0043755e5652', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:28:58.457661 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:28:58.458284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:28:58.458846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:28:58.459325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:28:58.459823 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:28:58.469800 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:58.470210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:58.470680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:58.471417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:28:58.471872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:28:58.472292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:28:58.493662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:28:58.499221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Getting quotas for user e3bb96ea667f4cb8beb46b4c9812fb9d and project a64e346cf03b4e099835f96c6e763322. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:28:58.512150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:28:58.514568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:28:58.582071 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d18ad9e9-9895-4362-b30f-24321e3c0ae5 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822262 Aug 30 19:28:58.583180 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3792/7435] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:28:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:28:58.596672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8342a8fb-8e74-49fd-bf9d-5a2f9868419a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:58.598241 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8342a8fb-8e74-49fd-bf9d-5a2f9868419a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:58.637435 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=16 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:28:58.708373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8342a8fb-8e74-49fd-bf9d-5a2f9868419a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:58.715922 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8342a8fb-8e74-49fd-bf9d-5a2f9868419a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1265 microversion: 2.1 time: 0.125700 Aug 30 19:28:58.716492 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3644/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:58 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:28:59.737799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-babce9c9-d80e-4b38-a910-2faa376f3406 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:28:59.738418 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-babce9c9-d80e-4b38-a910-2faa376f3406 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:28:59.818396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-babce9c9-d80e-4b38-a910-2faa376f3406 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:28:59.826050 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-babce9c9-d80e-4b38-a910-2faa376f3406 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1265 microversion: 2.1 time: 0.093276 Aug 30 19:28:59.826832 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3793/7437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:28:59 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:00.848137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6e67e005-d199-406d-bc8d-53381c531373 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:00.848796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6e67e005-d199-406d-bc8d-53381c531373 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:00.906717 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6e67e005-d199-406d-bc8d-53381c531373 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:00.914026 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6e67e005-d199-406d-bc8d-53381c531373 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1265 microversion: 2.1 time: 0.070264 Aug 30 19:29:00.914625 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3645/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:00 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:01.936231 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7901d164-31ac-47d0-bf7a-9bf09c992a6c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:01.937435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7901d164-31ac-47d0-bf7a-9bf09c992a6c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:02.001163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7901d164-31ac-47d0-bf7a-9bf09c992a6c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:02.008382 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7901d164-31ac-47d0-bf7a-9bf09c992a6c tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1265 microversion: 2.1 time: 0.076264 Aug 30 19:29:02.009047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3794/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:01 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:03.029851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:03.030622 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:03.038029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:03.038543 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:03.039022 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:03.039740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:03.040214 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:03.040734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:03.107559 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:03.116319 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e9af497d-5b9b-4461-957c-759fe8d39fe1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1269 microversion: 2.1 time: 0.090449 Aug 30 19:29:03.117028 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3646/7440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:03 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:04.137866 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:04.138604 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:04.148449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:04.149761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:04.150557 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:04.151368 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:04.151825 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:04.152251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:04.216129 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:04.224788 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0585a378-50a2-4717-b96f-85240e22ec41 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1323 microversion: 2.1 time: 0.091092 Aug 30 19:29:04.225360 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3795/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:04 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:05.054091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071cff8e-7cd5-428b-a6e5-05fe559a22b4", "tag": "20964868-6720-4126-9fb6-d89ab250614f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:05.072660 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:05.073496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:05.074248 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:05.090112 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] Creating event network-changed:20964868-6720-4126-9fb6-d89ab250614f for instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 on n-h1-854119-10 Aug 30 19:29:05.097343 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-1af4954c-1f52-461d-90db-553b52b88f9a req-7cab899a-e759-479a-b2e4-c533e146858c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049378 Aug 30 19:29:05.098628 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3647/7442] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:29:05.247198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:05.247985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:05.255624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:05.256124 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:05.256567 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:05.257314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:05.257772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:05.258440 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:05.399613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:05.408340 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f2fed8d2-7cb9-4639-93c6-c5db7a842055 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.165537 Aug 30 19:29:05.419118 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3796/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:05 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:06.434678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:06.435614 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:06.443058 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:06.443640 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:06.444339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:06.445168 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:06.445742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:06.446255 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:06.708244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:06.718834 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-654e9f55-9d7c-4d47-b6ce-159392bd942f tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.288971 Aug 30 19:29:06.729532 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3648/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:06 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:07.745863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:07.746468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:07.753798 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:07.754258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:07.754737 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:07.755495 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:07.755964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:07.756392 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:07.903055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:07.911520 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-fed4dfcf-98eb-4642-8892-1d2160da8ce8 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.171864 Aug 30 19:29:07.912110 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3797/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:07 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:08.936126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:08.936636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:08.939607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:08.945425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:08.945923 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:08.946372 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:08.947109 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:08.947595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:08.948046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:09.081903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:09.093199 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6219f601-0151-4410-9a2a-0f365e5445b1 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.160865 Aug 30 19:29:09.093978 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3649/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:08 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:10.114621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:10.115241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:10.117147 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:10.123506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:10.123996 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:10.124438 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:10.125149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:10.125596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:10.126022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:10.267596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:10.275988 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4116de9b-3412-4bbc-98c7-b4fdfa3765fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.165165 Aug 30 19:29:10.276657 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3798/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:10 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:10.394931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071cff8e-7cd5-428b-a6e5-05fe559a22b4", "name": "network-vif-plugged", "status": "completed", "tag": "20964868-6720-4126-9fb6-d89ab250614f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:10.405911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:10.406405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:10.406794 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:10.418623 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] Creating event network-vif-plugged:20964868-6720-4126-9fb6-d89ab250614f for instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 on n-h1-854119-10 Aug 30 19:29:10.424147 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-fdd5895a-ae7a-4957-91b7-0eb919b66a7e req-0d8a38fd-7733-4b9f-b760-7ed87f1713ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 30 19:29:10.424754 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3650/7448] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:29:11.302243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:11.303353 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:11.312513 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:11.313008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:11.313449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:11.314159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:11.314648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:11.315084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:11.457916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:11.466072 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6e9a96aa-4bd1-4ede-a96c-d4463d2998e4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1391 microversion: 2.1 time: 0.171128 Aug 30 19:29:11.466700 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3799/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:11 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:12.487047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=8 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:12.495854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:12.497069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:12.508436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:12.509290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:12.510043 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:12.511333 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:12.511930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:12.512418 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:12.658607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:12.666756 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e36d4c85-c18e-44e1-aafb-229aff5dd513 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1564 microversion: 2.1 time: 0.181542 Aug 30 19:29:12.667472 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3651/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:12 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:12.687673 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:12.688285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:12.690159 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=10 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:12.697189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:12.697700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:12.698133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:12.698855 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:12.699301 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:12.699721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:12.842638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:12.850938 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-61f10689-249c-4aae-86a2-fde65b4e77b0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1564 microversion: 2.1 time: 0.167156 Aug 30 19:29:12.851508 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3800/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:12 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:14.506687 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:14.507285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:14.515386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071cff8e-7cd5-428b-a6e5-05fe559a22b4", "tag": "20964868-6720-4126-9fb6-d89ab250614f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:14.526048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:14.526257 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:14.526729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:14.526906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:14.527176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:14.527288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:14.528097 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:14.528564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:14.529000 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:14.540836 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] Creating event network-changed:20964868-6720-4126-9fb6-d89ab250614f for instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 on n-h1-854119-10 Aug 30 19:29:14.546678 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-4802e133-9954-4347-8359-4d373b93c05a req-c8137b1c-75d9-421e-87c6-35f2b575f1d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034856 Aug 30 19:29:14.547311 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3801/7452] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:29:14.751590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:14.759707 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e891227d-4590-40cf-b7ea-19d9f441b350 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1564 microversion: 2.1 time: 0.257221 Aug 30 19:29:14.760266 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3652/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:14 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1564 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:38.095677 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:38.096882 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=40 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:38.103647 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:38.107083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:38.114895 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:38.115386 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:38.115824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:38.116525 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:38.116981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:38.117407 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:38.179031 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2d8748d8-8b0c-45fc-9e53-14c22ef1f6ea tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action" status: 200 len: 24565 microversion: 2.1 time: 0.086591 Aug 30 19:29:38.179722 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3802/7454] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:29:38 2022] POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action => generated 24565 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:29:44.717127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:44.717808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:44.720133 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=7 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:44.720807 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=34 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:29:44.726311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:44.726865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:44.727301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:44.728020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:44.728487 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:44.728934 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:44.753228 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lazy-loading 'flavor' on Instance uuid 071cff8e-7cd5-428b-a6e5-05fe559a22b4 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:29:44.825871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3ba466ad-4621-4a89-971f-23e2d80c4417 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action" status: 202 len: 0 microversion: 2.1 time: 0.112820 Aug 30 19:29:44.826702 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3653/7455] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:29:44 2022] POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:29:44.835845 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:44.836602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:44.844463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:44.844975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:44.845568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:44.846463 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:44.846905 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:44.847337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:44.983118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:44.991904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-39bc3f19-b295-4f72-9701-f6c506a495d4 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1691 microversion: 2.1 time: 0.160347 Aug 30 19:29:44.992443 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3803/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:44 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:46.025568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:46.026449 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:46.033843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:46.034361 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:46.034835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:46.035579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:46.036051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:46.036496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:46.180244 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:46.188703 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-36b296f0-034d-4bea-a6fe-cc1e19e115c0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1674 microversion: 2.1 time: 0.169013 Aug 30 19:29:46.189286 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3654/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:46 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:47.293393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:47.296929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:47.309259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.309966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.310428 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.311155 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.311803 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.312384 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.369925 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f163109-2d0e-4f04-9ca9-a18ff3021e46 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action" status: 200 len: 35849 microversion: 2.1 time: 0.080882 Aug 30 19:29:47.370860 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3804/7458] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:29:47 2022] POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action => generated 35849 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:29:47.383681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:47.384210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:47.391827 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.392353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.392877 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.393608 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.394089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.394572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.493854 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-829feefe-f32a-48bf-b51f-fe4cc613d190 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action" status: 202 len: 0 microversion: 2.1 time: 0.113588 Aug 30 19:29:47.494851 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3655/7459] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:29:47 2022] POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:29:47.504622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:47.505324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:47.513011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.514185 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.514685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.515509 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:47.515998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:47.516405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:47.653302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:47.661696 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-43a0f460-d649-48ad-8e0a-e7cd773218e3 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1680 microversion: 2.1 time: 0.161542 Aug 30 19:29:47.662324 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3805/7460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:47 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:29:48.690414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:48.691629 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:48.702107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:48.702650 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:48.703106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:48.703820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:48.704288 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:48.704733 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:48.843242 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:48.851450 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-41d293ae-978e-411f-9ed2-e6acf07558fc tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1680 microversion: 2.1 time: 0.169619 Aug 30 19:29:48.852003 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3656/7461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:48 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:49.875993 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:49.876399 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:49.883864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:49.884355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:49.884799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:49.885503 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:49.885958 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:49.886379 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:50.030662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:50.038896 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-4169be8a-1d5b-4820-a5a8-0b808c72fb0a tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1683 microversion: 2.1 time: 0.168512 Aug 30 19:29:50.039461 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3806/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:49 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:50.407282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:50.409458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:50.416546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:50.417045 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:50.417495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:50.418200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:50.418811 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:50.419253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:50.464676 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bcbc5ddd-c82a-4087-ab38-3109ac500a4d tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action" status: 200 len: 35849 microversion: 2.1 time: 0.062331 Aug 30 19:29:50.465303 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3657/7463] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:29:50 2022] POST /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4/action => generated 35849 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 19:29:51.591791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:51.592434 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:51.595015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071cff8e-7cd5-428b-a6e5-05fe559a22b4", "tag": "20964868-6720-4126-9fb6-d89ab250614f"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:51.599598 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:51.600089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:51.600521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:51.601216 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:51.601674 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:51.602091 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:51.605896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:51.606617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:51.607059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:51.619082 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] Creating event network-changed:20964868-6720-4126-9fb6-d89ab250614f for instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 on n-h1-854119-10 Aug 30 19:29:51.624189 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-3829782b-1e7c-4888-8e30-07440526674e req-9e41ef6b-5f76-40fb-92c7-bddc386ad661 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Aug 30 19:29:51.624791 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3658/7464] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:29:51.631599 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:29:51.723714 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2bbb55aa-8efe-40c3-a533-1bc0d412d2c9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 204 len: 0 microversion: 2.1 time: 0.135462 Aug 30 19:29:51.727797 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3807/7465] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:29:51 2022] DELETE /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:29:51.735194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:51.736502 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:51.743860 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:51.744359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:51.744784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:51.745701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:51.746324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:51.746939 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:51.891552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:51.899639 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-91cee1d3-5707-4da0-848f-f2cfc9a771d0 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1689 microversion: 2.1 time: 0.170235 Aug 30 19:29:51.900264 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3659/7466] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:51 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:52.925374 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:52.926062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:52.933506 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:52.933987 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:52.934462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:52.935149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:52.935725 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:52.936148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:53.069087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:53.078070 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-7f2b3e58-0695-43aa-a0c1-f706ffeb794b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1689 microversion: 2.1 time: 0.157402 Aug 30 19:29:53.078693 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3808/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:52 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:54.099698 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:54.100273 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:54.107492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:54.108095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:54.108579 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:54.109280 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:54.109747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:54.110190 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:54.198444 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb96ea667f4cb8beb46b4c9812fb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a64e346cf03b4e099835f96c6e763322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:29:54.209043 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-087585c2-3fab-4610-bd80-792d5641d8e9 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 200 len: 1502 microversion: 2.1 time: 0.113616 Aug 30 19:29:54.210006 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3660/7468] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:54 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 1502 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:29:54.260597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071cff8e-7cd5-428b-a6e5-05fe559a22b4", "name": "network-vif-deleted", "tag": "20964868-6720-4126-9fb6-d89ab250614f"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:29:54.271795 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:54.272266 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:54.272684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:54.284765 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] Creating event network-vif-deleted:20964868-6720-4126-9fb6-d89ab250614f for instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 on n-h1-854119-10 Aug 30 19:29:54.289987 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fc376c51-af7d-4dcf-9acb-2fba5a0b15e4 req-33406b4d-6f04-45ce-a73d-76e889438bff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033217 Aug 30 19:29:54.290622 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3809/7469] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:29:55.237429 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:55.238051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] [instance: 071cff8e-7cd5-428b-a6e5-05fe559a22b4] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:29:55.245612 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:55.246116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:55.246621 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:55.247339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:29:55.247840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:29:55.248281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:29:55.262818 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] HTTP exception thrown: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Request method failure captured: Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 HTTP/1.1 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmN6ul6n3L7wvc_3698wFJi91YDcZurRMRFLjTuBSDFDc1vdTNK3jMJB2gcj8nTDrsq1-CLEJ4KSooyJfTBSuGBErbQpvx9ToQKjEIs9GDjm-3plHfF9YH3DEc6Wv4Z0CB7lsrExP47LzCMizENhfuyZ21YSbZd7z811um62gFVO0HU Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a64e346cf03b4e099835f96c6e763322"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a64e346cf03b4e099835f96c6e763322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: a64e346cf03b4e099835f96c6e763322 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-973676271 Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: e3bb96ea667f4cb8beb46b4c9812fb9d Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestNetworkAdvancedServerOps-973676271-project Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '071cff8e-7cd5-428b-a6e5-05fe559a22b4'} Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:29:55.264498 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Returning 404 to user: Instance 071cff8e-7cd5-428b-a6e5-05fe559a22b4 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3c546979-6b58-47d2-8167-3065a7acb267 tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4" status: 404 len: 111 microversion: 2.1 time: 0.034997 Aug 30 19:29:55.268994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3661/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:29:55 2022] GET /compute/v2.1/servers/071cff8e-7cd5-428b-a6e5-05fe559a22b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:29:58.362241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-489e581f-9a73-4dfd-8c77-951fbe51ce2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] Calling method '.version_select at 0x7f4e5af46dc0>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:29:58.385334 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-489e581f-9a73-4dfd-8c77-951fbe51ce2b tempest-TestNetworkAdvancedServerOps-973676271 tempest-TestNetworkAdvancedServerOps-973676271-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-692449223" status: 202 len: 0 microversion: 2.1 time: 0.027834 Aug 30 19:29:58.386328 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3810/7471] 10.222.0.25 () {58 vars in 1281 bytes} [Tue Aug 30 19:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-692449223 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:30:09.921632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=18 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:09.923108 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:10.178510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-adce7c7b-f969-4b1f-b530-320c4f457ef0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'create', calling method: .version_select at 0x7f4e5667ba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-792428170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6UBw84egVDP0Pi/mX0acYoYmD0puJavi7PTLElhLODlFhE40vcf//W/yw4Xb9McvP7BchOcfCgrvwK8H7+kyFpFJ7zzHhAW3kLm0RzJoFkixUELupuzInWclw0gR6f2w=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:30:10.194784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-adce7c7b-f969-4b1f-b530-320c4f457ef0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for project feba750b8c0c440ba72b1207a0203fac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:30:10.204527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-adce7c7b-f969-4b1f-b530-320c4f457ef0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for user 52ea9134f3e648939da3c7fec14094cf and project feba750b8c0c440ba72b1207a0203fac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:30:10.242466 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-adce7c7b-f969-4b1f-b530-320c4f457ef0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.335761 Aug 30 19:30:10.243101 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3662/7472] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:30:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:30:11.309037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:11.310238 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:11.315328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1038086576", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-792428170", "security_groups": [{"name": "tempest-secgroup-smoke-531250355"}], "networks": [{"uuid": "1d862389-5767-4b78-bb14-0f04d349af46"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:30:11.445689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] validate_networks() for [('1d862389-5767-4b78-bb14-0f04d349af46', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:30:11.848223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:30:11.848649 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:30:11.849234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:30:11.849655 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:30:11.850095 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:30:11.859704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:11.860189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:11.860743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:11.861476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:11.861934 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:11.862383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:11.880645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for project feba750b8c0c440ba72b1207a0203fac. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:30:11.886151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for user 52ea9134f3e648939da3c7fec14094cf and project feba750b8c0c440ba72b1207a0203fac. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:30:11.899229 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:30:11.901696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:30:11.950686 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-14548e1f-fc00-4268-bfe5-85c76c3d1758 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.643537 Aug 30 19:30:11.951353 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3811/7473] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:30:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:30:11.962724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-971a6706-1e02-4b92-b535-828a41f26e6d tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:11.963387 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-971a6706-1e02-4b92-b535-828a41f26e6d tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:12.022788 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-971a6706-1e02-4b92-b535-828a41f26e6d tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:12.030175 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-971a6706-1e02-4b92-b535-828a41f26e6d tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1246 microversion: 2.1 time: 0.071412 Aug 30 19:30:12.031262 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3663/7474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:11 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:13.053146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:13.053898 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:13.061350 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:13.061824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:13.062276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:13.063075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:13.063549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:13.063954 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:13.132295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:13.141500 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-22c5cabc-8779-4040-b645-190e8dad408a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1298 microversion: 2.1 time: 0.092914 Aug 30 19:30:13.142581 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3812/7475] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:13 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:14.166381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:14.169263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:14.182713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:14.183492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:14.184400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:14.185481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:14.186278 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:14.186911 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:14.468363 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:14.476638 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a750971f-f109-4fd8-8a9a-8634910c61f1 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.316180 Aug 30 19:30:14.477230 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3664/7476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:14 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:14.839789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:30:14.856922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:14.857393 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:14.857824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:14.869560 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] Creating event network-changed:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h2-854119-10 Aug 30 19:30:14.875254 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-bc603c52-be56-4628-9a0c-48692f374c85 req-5059b213-b800-43fd-9b70-5c69634a932c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039218 Aug 30 19:30:14.876041 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3813/7477] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:30:15.497441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:15.498074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:15.505984 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:15.506531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:15.506991 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:15.507725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:15.508179 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:15.508813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:15.643201 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:15.651317 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e36ef1c9-9cf8-4193-84a2-433468c5d0bd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.157933 Aug 30 19:30:15.651866 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3665/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:15 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:16.675140 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:16.675838 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:16.682176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:16.682701 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:16.683152 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:16.683826 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:16.684491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:16.684964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:16.824813 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:16.836213 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0d448d49-48b5-411e-b1f5-31e997ec9b0c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.166988 Aug 30 19:30:16.836982 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3814/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:16 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:17.859694 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:17.860475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:17.867671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:17.868171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:17.868595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:17.869330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:17.869795 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:17.870232 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:18.006872 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:18.018659 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d7833c85-06d9-4c5b-9258-8979adf284c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.163956 Aug 30 19:30:18.019305 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3666/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:17 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:19.043621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:19.044258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:19.052633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:19.053136 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:19.053572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:19.054290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:19.054807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:19.055239 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:19.204057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:19.212036 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-556f5c82-1e1e-45ba-832b-44286fb066bf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.172416 Aug 30 19:30:19.212615 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3815/7481] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:19 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:20.236339 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:20.236958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:20.244491 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:20.244988 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:20.245441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:20.246158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:20.246632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:20.247092 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:20.727340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:20.735616 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fdaa6c99-f576-45d5-88c4-f13040a30cd6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.505734 Aug 30 19:30:20.736225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3667/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:20 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:21.091474 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "name": "network-vif-plugged", "status": "completed", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:30:21.102454 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:21.102927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:21.103362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:21.115305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] Creating event network-vif-plugged:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h2-854119-10 Aug 30 19:30:21.120437 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-1bcc47b7-568c-44f5-a538-593a50397770 req-a59de6c6-f517-43a8-85de-0157049226b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Aug 30 19:30:21.121227 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3816/7483] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:30:21.761647 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:21.762744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:21.774732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:21.775562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:21.776352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:21.777533 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:21.778330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:21.779112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:21.923912 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:21.931942 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f36568ba-d58e-4836-9d95-da898f8245fc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1371 microversion: 2.1 time: 0.176994 Aug 30 19:30:21.932496 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3668/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:21 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:22.950719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:22.951529 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:22.957133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:22.957842 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:22.965373 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:22.965857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:22.966291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:22.967033 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:22.967485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:22.967936 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:23.102596 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:23.111641 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6bf9720b-3e1f-4a9a-93da-0c0fbecb997e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1555 microversion: 2.1 time: 0.161946 Aug 30 19:30:23.112216 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3817/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:22 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:23.132475 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:30:23.133087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:30:23.135104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:30:23.142059 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:23.142583 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:23.143029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:23.143747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:23.144816 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:23.145259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:23.296760 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:30:23.306594 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1b0b67ff-72c1-46bb-8ded-631185118156 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1555 microversion: 2.1 time: 0.178089 Aug 30 19:30:23.307192 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3669/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:30:23 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:30:25.141570 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:30:25.151302 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:30:25.151790 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:30:25.152227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:30:25.163686 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] Creating event network-changed:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h2-854119-10 Aug 30 19:30:25.168725 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7119213f-b3ec-4ffc-b169-64feff31d5c1 req-4312f984-c179-4ee2-809b-78d65c42d9dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091712 Aug 30 19:30:25.169319 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3818/7487] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:32:22.587729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:22.589328 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=36 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:22.591088 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:32:22.591367 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action (ip 10.222.0.25) !!! Aug 30 19:32:22.594426 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:32:22.594672 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action (ip 10.222.0.25) !!! Aug 30 19:32:22.603107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:32:22.603663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:22.619051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:22.619529 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:22.619975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:22.620689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:22.621164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:22.621607 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:22.645727 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lazy-loading 'flavor' on Instance uuid 55dddc58-999d-4f07-b9d2-993866d4bd0b {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:32:22.856921 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-140d7cfb-e8a6-485d-bdf1-90b5bfde8f62 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action" status: 202 len: 0 microversion: 2.1 time: 0.272787 Aug 30 19:32:22.857563 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3670/7488] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:32:22 2022] POST /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:32:22.865229 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 19:32:22.865869 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:22.866791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=32 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:22.873038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:22.873218 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:22.881225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:22.881752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:22.882327 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:22.883040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:22.883608 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:22.884036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:23.030268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:23.038638 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c9cd46ce-ab4f-4299-b7b5-07b1a3d88037 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.176353 Aug 30 19:32:23.039190 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3819/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:22 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:24.063572 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:24.064283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:24.072206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:24.072734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:24.073173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:24.073884 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:24.074364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:24.074808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:24.226126 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:24.234333 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cdcd8df1-e507-4a8e-a5ec-2b8aeb023468 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.176918 Aug 30 19:32:24.234945 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3671/7490] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:24 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:25.256718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:25.257820 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:25.267461 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:25.268134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:25.268723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:25.269591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:25.270038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:25.270489 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:25.292501 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35868. Aug 30 19:32:25.414308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:25.422781 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9812e356-f4fa-482b-8754-73d01cf08131 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.170287 Aug 30 19:32:25.427555 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3820/7491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:25 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:26.452347 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:26.453401 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:26.465111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:26.465111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:26.465111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:26.465426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:26.465776 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:26.466220 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:26.601555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:26.609747 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f9317e4d-a292-4edc-ba68-67dc7e11de77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.167051 Aug 30 19:32:26.610386 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3672/7492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:26 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:27.631523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:27.632332 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:27.640163 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:27.640657 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:27.641089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:27.641807 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:27.642259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:27.642707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:27.789001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:27.797744 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-68115b7d-4d05-4d3c-876c-9bb7edd516a4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.170291 Aug 30 19:32:27.798414 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3821/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:27 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:28.824522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:28.825532 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:28.837828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:28.838723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:28.839594 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:28.840336 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:28.840808 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:28.841252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:28.979184 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:28.987552 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-85c6c276-cf98-4790-8c13-488b87dcecfa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.170384 Aug 30 19:32:28.988133 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3673/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:28 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:30.009082 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:30.010420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:30.017383 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:30.017864 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:30.018295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:30.019013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:30.019462 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:30.019879 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:30.161858 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:30.169992 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-5b3d4292-1847-4abe-a5fd-89d1ecb38469 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.165004 Aug 30 19:32:30.170974 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3822/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:30 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:31.196120 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:31.197803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:31.209295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:31.210113 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:31.210947 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:31.212116 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:31.212905 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:31.213246 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:31.346720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:31.354999 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c713e2b4-f6dc-4864-80b7-f47862a22123 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.165457 Aug 30 19:32:31.355572 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3674/7496] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:31 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:32.380924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:32.381863 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:32.393721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:32.394589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:32.395328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:32.396481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:32.397246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:32.397964 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:32.555857 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:32.564270 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8cdb13e9-1f29-4f9e-a742-73e9057403c0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.189983 Aug 30 19:32:32.564846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3823/7497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:32 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:33.589606 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:33.590539 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:33.602510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:33.603813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:33.604419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:33.605151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:33.605623 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:33.606065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:33.767595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:33.776546 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9cd08db2-db92-49b3-849c-56762ead5d6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1701 microversion: 2.1 time: 0.193844 Aug 30 19:32:33.777139 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3675/7498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:33 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1701 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:34.803262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:34.804251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:34.816568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:34.817481 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:34.818267 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:34.819932 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:34.821097 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:34.821816 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:34.969031 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:34.977153 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-8852048e-0bb5-4990-859f-65586563dcec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1701 microversion: 2.1 time: 0.180537 Aug 30 19:32:34.977728 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3824/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:34 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1701 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:36.001358 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:36.002765 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:36.010819 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:36.011366 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:36.011815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:36.013210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:36.013496 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:36.013973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:36.166628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:36.175291 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-05e814b8-990c-4fa7-9da4-e549d84a7d9e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.180454 Aug 30 19:32:36.175872 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3676/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:35 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:37.197171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:37.197776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:37.205957 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:37.206784 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:37.207480 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:37.208290 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:37.208840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:37.209516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:37.358288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:37.366748 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-663ac72f-3c8c-448d-8a81-c9f4dc1f9819 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.173542 Aug 30 19:32:37.380720 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3825/7501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:37 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:37.794971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "name": "network-vif-plugged", "status": "completed", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:32:37.806637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:37.808012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:37.808637 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:37.821496 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] Creating event network-vif-plugged:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h2-854119-10 Aug 30 19:32:37.828166 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-f8d0478e-cce3-4373-9e39-f2e457f1f70e req-ac4972b1-decf-4b72-a1f0-8acd9709d415 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120453 Aug 30 19:32:37.828784 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3677/7502] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:32:38.389050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:38.389665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:38.397804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:38.398305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:38.398771 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:38.399636 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:38.400096 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:38.400528 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:38.562049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:38.571329 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-128d63fc-1d31-4f4a-9f15-f177c12e43ca tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.186662 Aug 30 19:32:38.572278 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3826/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:38 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:39.597263 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:39.598830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:39.607224 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:39.608171 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:39.609183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:39.609993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:39.612825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:39.613508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:39.771664 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:39.780678 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a8786561-cffe-4545-b10d-48484b2befd4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.190946 Aug 30 19:32:39.795994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3678/7504] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:39 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:40.802753 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:40.804311 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:40.811854 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:40.812352 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:40.812789 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:40.813523 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:40.813986 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:40.814437 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:40.996764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:41.005409 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1c5e9d85-b909-442e-8f7b-17d3adc872cf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.206814 Aug 30 19:32:41.018370 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3827/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:40 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:42.029924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:42.030575 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:42.037935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:42.038777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:42.039324 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:42.040252 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:42.040683 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:42.041265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:42.194785 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:42.203422 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-99dbbce4-c3c8-4367-8239-27868ee368af tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.177443 Aug 30 19:32:42.204906 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3679/7506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:42 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:43.231077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:43.231786 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:43.239648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:43.240146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:43.240588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:43.241307 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:43.241764 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:43.242188 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:43.391806 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:43.400304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b6c28bfc-1fce-42e3-aa30-38cc4537c1e0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.174699 Aug 30 19:32:43.413851 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3828/7507] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:43 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:44.423212 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:44.424609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:44.433954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:44.434531 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:44.434978 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:44.435681 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:44.436320 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:44.436919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:44.582410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:44.590511 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-19f7f26a-46d9-43fb-b73e-154d2f010d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1696 microversion: 2.1 time: 0.172003 Aug 30 19:32:44.591112 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3680/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:44 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:45.612344 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:45.613009 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:45.620886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:45.621498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:45.622174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:45.622940 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:45.623404 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:45.623832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:45.762264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:45.770539 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-32b74041-8913-4b70-b0c0-ec5adf600c76 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1678 microversion: 2.1 time: 0.162417 Aug 30 19:32:45.771121 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3829/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:45 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:46.794426 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:46.795462 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:46.802881 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:46.803377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:46.803821 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:46.804525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:46.804987 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:46.805428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:46.958102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:46.966547 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-637fbf30-f8e2-49d5-be17-4621f2fb5512 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1678 microversion: 2.1 time: 0.176620 Aug 30 19:32:46.967136 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3681/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:46 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:47.684275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "name": "network-vif-unplugged", "status": "completed", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:32:47.695431 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:47.695913 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:47.696340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:47.708121 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] Creating event network-vif-unplugged:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h2-854119-10 Aug 30 19:32:47.711621 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] [62babd2a-9e46-43a1-a733-26f8e466de8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:32:47.988770 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:47.989402 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:47.997020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:47.997546 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:47.997998 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:47.998782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:47.999260 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:47.999703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:48.148672 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:48.157234 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9b73897a-b81f-446f-8f3d-8d29c9368298 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1621 microversion: 2.1 time: 0.172529 Aug 30 19:32:48.157818 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3682/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:47 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1621 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:48.178180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:32:48.178830 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:48.185095 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:48.185595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:48.186050 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:48.186793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:48.187267 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:48.187715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:48.276210 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122590) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 19:32:48.359290 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-21917a52-7b56-4a83-b14e-c408eed03595 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action" status: 202 len: 0 microversion: 2.1 time: 0.184745 Aug 30 19:32:48.359819 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3683/7512] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:32:48 2022] POST /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 19:32:48.367996 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:48.368617 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:48.375773 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:48.376290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:48.376751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:48.377474 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:48.377944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:48.378407 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:48.383422 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:48.518155 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:48.526720 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-68968786-a364-4ccd-8b06-f39afc84c367 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1629 microversion: 2.1 time: 0.162599 Aug 30 19:32:48.527321 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3684/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:48 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1629 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:48.719735 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] [62babd2a-9e46-43a1-a733-26f8e466de8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35992. Aug 30 19:32:48.723553 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-dc9ba503-f21e-4a9d-b1e7-aaf636593bb6 req-e741d7cc-3553-4b14-8e02-5b95cf793714 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.043261 Aug 30 19:32:48.724174 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3830/7514] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:32:49.548749 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:49.549370 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:49.557131 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:49.557651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:49.558326 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:49.559070 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:49.559536 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:49.559973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:49.696565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:49.704682 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0296dfcf-3735-4b02-9fc5-251e8f0e6ae9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.160182 Aug 30 19:32:49.705265 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3685/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:49 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:50.728258 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:50.729292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:50.736246 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:50.736729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:50.737161 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:50.737860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:50.738314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:50.738767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:50.881697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:50.889818 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-444c1369-ad92-467b-bffe-4c0bd2f9d487 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.167079 Aug 30 19:32:50.890432 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3831/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:50 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:50.954175 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:32:50.970562 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:50.971066 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:50.971518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:50.984241 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] Creating event network-changed:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h1-854119-10 Aug 30 19:32:50.990625 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-516d9f6e-7978-4d7a-8880-2e3ae9ea4834 req-da7b80d5-62df-4ad5-ade1-79cfcddaf3f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040391 Aug 30 19:32:50.991225 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3686/7517] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:32:51.912658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:51.913257 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:51.921514 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:51.922007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:51.922468 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:51.923183 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:51.923634 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:51.924056 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:52.084521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:52.098522 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2775f078-ee2c-4d4e-9626-85cc12a35dfb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.190328 Aug 30 19:32:52.113904 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3832/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:51 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:53.123098 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:53.123809 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:53.125720 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:53.132211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:53.132706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:53.133183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:53.133915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:53.134414 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:53.134846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:53.286211 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:53.294781 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9354334f-e358-45d7-a398-3fca37a4a804 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.177537 Aug 30 19:32:53.303373 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3687/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:53 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:54.317787 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:54.319078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:54.323975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:54.334390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:54.334390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:54.334390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:54.334390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:54.334390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:54.335008 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:54.337779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=81 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:32:54.475507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:54.484332 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-eea4607d-38c9-4f1d-860a-afb099841e6f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.170741 Aug 30 19:32:54.494396 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3833/7520] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:54 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:55.507567 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:55.508198 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:55.515676 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:55.516147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:55.516844 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:55.517779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:55.518256 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:55.518713 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:55.698951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:55.707308 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-061b3e61-7156-4b9f-afd0-1de691dc870e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.203692 Aug 30 19:32:55.707998 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3688/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:55 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:56.730043 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:56.730961 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:56.739055 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:56.739552 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:56.739990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:56.740707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:56.741164 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:56.741597 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:56.890451 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:56.898463 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-306546b8-cd6b-4eac-a60d-d3bc6b491a23 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.172956 Aug 30 19:32:56.899047 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3834/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:56 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:57.923646 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:57.924305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:57.931686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:57.933075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:57.933746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:57.935129 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:57.935898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:57.936670 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:58.097428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:58.107114 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d81eae10-401a-4a3f-a3fc-16c05fe694c7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.187917 Aug 30 19:32:58.107709 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3689/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:57 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:32:59.128182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:32:59.128792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:32:59.136398 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:59.136918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:59.137360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:59.138062 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:32:59.138558 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:32:59.138989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:32:59.275880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:32:59.284134 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-09405ab4-27ce-4ff2-bb37-d7b75d4131e8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.160057 Aug 30 19:32:59.284689 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3835/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:32:59 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:00.310311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:00.311012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:00.318556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:00.319062 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:00.319511 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:00.320235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:00.320708 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:00.321149 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:00.460245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:00.468949 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7370b90c-4065-44d4-ad32-14973c2462ab tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.165213 Aug 30 19:33:00.469539 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3690/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:00 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:01.498743 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:01.499564 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:01.511589 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:01.512397 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:01.513178 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:01.513885 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:01.514365 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:01.514791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:01.659281 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:01.667410 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f8275117-bbbe-4fb9-8ab4-ae07e2c831cb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.175373 Aug 30 19:33:01.667989 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3836/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:01 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:02.688674 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:02.689307 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:02.697691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:02.698196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:02.698682 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:02.699400 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:02.700229 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:02.700685 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:02.852096 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:02.860472 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3dce2997-114c-400a-82f7-258469138fa4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.175900 Aug 30 19:33:02.861023 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3691/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:02 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:03.897731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:03.900050 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:03.921635 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:03.923894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:03.924911 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:03.927244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:03.929376 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:03.930998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:04.080221 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:04.088136 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-0f9fd84f-1ce7-498f-86e2-e74cd32e346a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.203351 Aug 30 19:33:04.088723 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3837/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:03 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:05.110908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:05.111504 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:05.118949 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:05.119459 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:05.119902 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:05.120636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:05.121106 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:05.121547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:05.207982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "name": "network-vif-plugged", "status": "completed", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:33:05.219684 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:05.220284 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:05.220767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:05.234397 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] Creating event network-vif-plugged:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h1-854119-10 Aug 30 19:33:05.241202 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e4360e39-0b3c-4a74-9454-c92057d3f745 req-b55ef840-f7b2-4a6e-8f06-a35310f364b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036926 Aug 30 19:33:05.242006 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3838/7529] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:33:05.263590 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:05.272275 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b091e2d2-0321-43b3-a4f3-3a0541af1933 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.165796 Aug 30 19:33:05.273187 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3692/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:05 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:06.301435 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:06.302615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:06.312494 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:06.312982 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:06.313417 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:06.314119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:06.314613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:06.315037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:06.464691 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:06.473640 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6cbb1569-eff8-4961-b601-fb059a57c2e2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1687 microversion: 2.1 time: 0.181112 Aug 30 19:33:06.474319 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3839/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:06 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:33:07.498906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:33:07.499480 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:33:07.507406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:07.507924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:07.508381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:07.509104 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:33:07.509578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:33:07.510027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:33:07.644189 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:33:07.652259 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b816c612-b583-460c-946d-bbb6d0d4ece2 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1674 microversion: 2.1 time: 0.160320 Aug 30 19:33:07.652870 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3693/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:33:07 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:18.315245 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=13 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:18.319023 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=13 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:18.320158 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=54 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:18.320994 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:34:18.321222 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 19:34:18.323978 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=37 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:18.325464 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:34:18.325595 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b (ip 10.222.0.25) !!! Aug 30 19:34:18.327296 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:34:18.327416 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b (ip 10.222.0.25) !!! Aug 30 19:34:18.340026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:18.340767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:18.348623 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:18.349370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:18.349846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:18.350588 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:18.351041 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:18.351726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:18.382915 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:34:18.456390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:18.466641 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:18.467147 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:18.467605 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:18.472705 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-51ea8f90-b759-45e4-bee5-caca041d94c9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 204 len: 0 microversion: 2.1 time: 0.156693 Aug 30 19:34:18.473120 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3840/7533] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:34:18 2022] DELETE /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:34:18.481146 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] Creating event network-changed:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h1-854119-10 Aug 30 19:34:18.485144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:18.485144 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:18.486576 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-93681b2a-61cb-4ae7-bad1-5e49c2cbde41 req-a76f304e-2b5a-4121-acc4-0a95a6b6c6e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169326 Aug 30 19:34:18.487185 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3694/7534] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:34:18.491685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:18.492177 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:18.492620 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:18.493322 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:18.493772 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:18.494193 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:18.698321 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:18.706367 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-1bb0ef44-7ec8-4503-8864-71ca6efc3cc8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.226698 Aug 30 19:34:18.707038 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3841/7535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:18 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:19.735004 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:19.735757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:19.743955 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:19.744453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:19.744906 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:19.745613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:19.746081 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:19.746556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:20.170297 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:20.178905 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3e295466-958a-4e63-91a2-186f5bdec91e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 200 len: 1680 microversion: 2.1 time: 0.453173 Aug 30 19:34:20.179457 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3695/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:19 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 1680 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:20.479194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55dddc58-999d-4f07-b9d2-993866d4bd0b", "name": "network-vif-deleted", "tag": "128efc57-9389-4b35-aa84-403071d168b3"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:20.489796 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:20.490265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:20.490757 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:20.502119 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] Creating event network-vif-deleted:128efc57-9389-4b35-aa84-403071d168b3 for instance 55dddc58-999d-4f07-b9d2-993866d4bd0b on n-h1-854119-10 Aug 30 19:34:20.507360 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-754d579b-667d-4fc0-ab45-6acb1a93851b req-374c5ce3-c983-4c06-bf72-ee44fe2699ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Aug 30 19:34:20.508119 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3842/7537] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:34:21.205399 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:21.206492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 55dddc58-999d-4f07-b9d2-993866d4bd0b] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:21.215235 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:21.215732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:21.216180 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:21.216889 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:21.217352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:21.217767 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:21.231865 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] HTTP exception thrown: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Request method failure captured: Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b HTTP/1.1 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmU8Xx3WQ1hIb7JXH5r7D1sZDllAnjSIhu4_FLBvvKWUquzyY80Iz6HHtB491VhLjhIoStrDnDR9MIGjS_eMLfBzIDvuo0PBRUXcpiJIo2bT9jHtPHqJIxZ-NvgU66u8WXPB-mC8Gc0kNJb_ek7yrkEhU9-riOWceTyXmsm6cIKCQ1A Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: feba750b8c0c440ba72b1207a0203fac Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestShelveInstance-2081262287 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestShelveInstance-2081262287 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: feba750b8c0c440ba72b1207a0203fac Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestShelveInstance-2081262287 Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestShelveInstance-2081262287-project Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 52ea9134f3e648939da3c7fec14094cf Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestShelveInstance-2081262287-project Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '55dddc58-999d-4f07-b9d2-993866d4bd0b'} Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:34:21.233522 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Returning 404 to user: Instance 55dddc58-999d-4f07-b9d2-993866d4bd0b could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3b333725-c05e-494f-9a59-0de19627c664 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b" status: 404 len: 111 microversion: 2.1 time: 0.036622 Aug 30 19:34:21.238616 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3696/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:21 2022] GET /compute/v2.1/servers/55dddc58-999d-4f07-b9d2-993866d4bd0b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:34:21.407956 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-40545666-1c53-482c-8ddd-5ee67f452c5f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '.version_select at 0x7f4e55b51550>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:21.437017 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-40545666-1c53-482c-8ddd-5ee67f452c5f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-792428170" status: 202 len: 0 microversion: 2.1 time: 0.033313 Aug 30 19:34:21.441034 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3843/7539] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 19:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-792428170 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:34:21.462057 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-484e8e95-3fc3-4f58-bfba-c09e02801e5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'create', calling method: .version_select at 0x7f4e5667bc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1308458774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHleujmnxJurx50tu1OSfKEfXsZ3vvRH5YquZTFB2JEQhqF5cV4NMZm/EXHXsp+V5zcJpDUanfe2LcFh06E7ln8PjAvqABKvQzsA0ZF/UQ6xk9UGIDbj0oJ1u9LougiUjg=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:21.478512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-484e8e95-3fc3-4f58-bfba-c09e02801e5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for project feba750b8c0c440ba72b1207a0203fac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:34:21.483636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-484e8e95-3fc3-4f58-bfba-c09e02801e5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for user 52ea9134f3e648939da3c7fec14094cf and project feba750b8c0c440ba72b1207a0203fac. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:34:21.511784 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-484e8e95-3fc3-4f58-bfba-c09e02801e5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054528 Aug 30 19:34:21.512399 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3697/7540] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:34:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 19:34:38.811274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:38.812116 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:38.816767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-587384785", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1308458774", "security_groups": [{"name": "tempest-secgroup-smoke-5259443"}], "networks": [{"uuid": "1d862389-5767-4b78-bb14-0f04d349af46"}], "block_device_mapping_v2": [{"uuid": "45bd89a4-1c09-4d23-9197-7d85d2883790", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:38.940697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] validate_networks() for [('1d862389-5767-4b78-bb14-0f04d349af46', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:34:39.644254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:34:39.644685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:34:39.645162 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:34:39.645575 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:34:39.645989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:34:39.656396 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:39.656890 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:39.657330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:39.658070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:39.658555 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:39.658983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:39.676645 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for project feba750b8c0c440ba72b1207a0203fac. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:34:39.682659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Getting quotas for user 52ea9134f3e648939da3c7fec14094cf and project feba750b8c0c440ba72b1207a0203fac. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:34:39.753059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:34:39.756667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45bd89a4-1c09-4d23-9197-7d85d2883790',volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:34:39.896762 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c0c44332-6b71-4359-8f3f-283816b30c7e tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.087484 Aug 30 19:34:39.897743 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3844/7541] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:34:38 2022] POST /compute/v2.1/servers => generated 403 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:34:39.906843 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=10 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:39.907642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=4 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:39.908311 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:39.912202 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-50fc76fb-083c-4599-84d6-28fb6d40222a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:39.913033 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-50fc76fb-083c-4599-84d6-28fb6d40222a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:39.975089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-50fc76fb-083c-4599-84d6-28fb6d40222a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:39.982590 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-50fc76fb-083c-4599-84d6-28fb6d40222a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1088 microversion: 2.1 time: 0.077672 Aug 30 19:34:39.983165 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3698/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:39 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:41.005526 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:41.006149 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:41.014924 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:41.016045 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:41.016909 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:41.019470 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:41.020156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:41.020653 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:41.100776 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:41.109679 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e3e45974-9106-4fb3-8035-616ee6b9f271 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1194 microversion: 2.1 time: 0.109007 Aug 30 19:34:41.110308 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3845/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:40 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:34:42.132744 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:42.133377 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:42.141679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:42.142194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:42.142699 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:42.143425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:42.143900 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:42.144353 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:42.418876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:42.427931 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-3165f74f-ba7c-403a-b885-332f3b43ecf4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1269 microversion: 2.1 time: 0.299850 Aug 30 19:34:42.428519 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3699/7544] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:42 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1269 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:42.832619 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:42.846057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:42.847049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:42.847572 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:42.859801 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] Creating event network-changed:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:34:42.866187 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-fc335c0f-0cac-466d-bc4f-7ef777cf6652 req-606accbe-8c63-4c4c-87d2-7683d2eb3250 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038163 Aug 30 19:34:42.867113 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3846/7545] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:34:43.449913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:43.450777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:43.458985 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:43.459719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:43.460359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:43.461259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:43.461926 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:43.462697 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:43.677428 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:43.686090 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f1f80c46-d08e-40f8-ad12-25caac6ef3fa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1269 microversion: 2.1 time: 0.240423 Aug 30 19:34:43.700302 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3700/7546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:43 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:44.709032 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:44.709732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:44.717340 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:44.717828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:44.718264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:44.718994 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:44.719449 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:44.719867 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:44.857198 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:44.865356 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-89f96a96-15dc-49f3-8724-ef0cf1989f56 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1269 microversion: 2.1 time: 0.160762 Aug 30 19:34:44.870916 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3847/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:44 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:45.886813 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:45.887450 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:45.894527 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:45.895032 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:45.895486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:45.896204 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:45.896673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:45.897132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:46.042920 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:46.052078 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-81e02396-b446-4bdd-83fe-ec0b7cc1d0ff tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1269 microversion: 2.1 time: 0.169344 Aug 30 19:34:46.052674 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3701/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:45 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:47.076006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:47.076610 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:47.084048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:47.084527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:47.084951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:47.085632 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:47.086077 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:47.086530 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:47.229900 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:47.239996 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-94bf801e-a6ee-4387-9ade-2445686196ec tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.167948 Aug 30 19:34:47.240634 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3848/7549] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:47 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:48.265753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:48.266525 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:48.274851 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:48.275481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:48.276107 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:48.276820 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:48.277305 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:48.277746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:48.420658 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:48.428871 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-de4002a0-8b1f-4ef8-a196-5c2896a8eee4 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.169299 Aug 30 19:34:48.429456 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3702/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:48 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:49.454234 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:49.455146 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:49.465731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:49.466212 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:49.466683 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:49.467380 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:49.467832 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:49.468249 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:49.623734 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:49.631916 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b0e7d33b-2865-4f34-b6ff-feb81474bd0a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.184611 Aug 30 19:34:49.632460 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3849/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:49 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:50.656524 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:50.657495 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:50.661642 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:50.668986 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:50.669486 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:50.670323 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:50.671063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:50.671538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:50.671975 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:50.811091 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:50.823705 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-bf850604-05d6-4d59-a36f-37227e4ec3fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.173553 Aug 30 19:34:50.824300 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3703/7552] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:50 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:51.849065 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:51.850036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:51.853174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:51.854390 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:34:51.865121 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:51.865927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:51.866692 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:51.867846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:51.868593 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:51.869285 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:52.005227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:52.013774 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c8764366-7b15-4653-a43c-b59e9a07a8ae tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.171297 Aug 30 19:34:52.014369 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3850/7553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:51 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:53.036723 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:53.037632 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:53.046876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:53.047378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:53.047840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:53.048596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:53.049069 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:53.049513 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:53.198303 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:53.207873 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c5d8c53a-a50a-4401-aa95-83e88d47f614 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.176735 Aug 30 19:34:53.208458 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3704/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:53 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:54.229391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:54.229966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:54.237697 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:54.238192 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:54.238640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:54.239372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:54.239829 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:54.240260 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:54.382574 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:54.391009 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-54c18462-c4b5-4414-a218-dd84f545ce7f tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.165619 Aug 30 19:34:54.391596 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3851/7555] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:54 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:55.416584 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:55.417624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:55.425784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:55.426295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:55.426784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:55.427510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:55.427957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:55.428436 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:55.568441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:55.576549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d8a0bd6e-ce6b-40cf-ac55-1bb756600929 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.166671 Aug 30 19:34:55.577129 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3705/7556] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:55 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:56.329824 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "name": "network-vif-plugged", "status": "completed", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:56.339847 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:56.340325 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:56.340809 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:56.352685 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] Creating event network-vif-plugged:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:34:56.357926 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-da5b01d5-3f6c-47b1-a0d1-955aa94c6a5d req-75e5a273-93c4-44e1-8c08-f82bf574e979 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Aug 30 19:34:56.358739 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3852/7557] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:34:56.599114 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:56.599741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:56.607490 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:56.608007 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:56.608461 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:56.609345 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:56.609701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:56.610146 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:56.746552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:56.757326 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-ec29f2df-1760-4143-93e8-453253fa8249 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1257 microversion: 2.1 time: 0.162472 Aug 30 19:34:56.757906 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3706/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:56 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:57.787667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:57.788339 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:57.796263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:57.796811 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:57.797304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:57.798058 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:57.798586 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:57.799057 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:57.946372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:57.955259 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-6c872fe4-7bfe-4c26-966e-3ca55ed95e63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1440 microversion: 2.1 time: 0.173447 Aug 30 19:34:57.955846 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3853/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:57 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1440 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:57.975747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:34:57.976408 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:34:57.983957 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:57.984455 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:57.984913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:57.985630 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:57.986100 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:57.986619 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:58.130163 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:34:58.141298 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-69c16cf2-2a4f-42e4-9d5b-08de9867a3a0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1440 microversion: 2.1 time: 0.169511 Aug 30 19:34:58.141878 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3707/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:34:57 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1440 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:34:59.832433 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:34:59.842686 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:34:59.843171 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:34:59.843626 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:34:59.855160 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] Creating event network-changed:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:34:59.860411 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-702903b9-de13-4a07-83e1-cdbbbfea36de req-03954745-e141-45db-9d06-b0b508b11945 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031734 Aug 30 19:34:59.861172 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3854/7561] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:36:57.230187 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:36:57.231148 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:36:57.231766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=22 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:36:57.232535 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=54 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:36:57.233353 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:36:57.233493 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action (ip 10.222.0.25) !!! Aug 30 19:36:57.236003 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:36:57.236148 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action (ip 10.222.0.25) !!! Aug 30 19:36:57.298360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:36:57.298928 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:36:57.305312 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:57.305909 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:57.306625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:57.307354 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:57.307828 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:57.308295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:57.332706 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lazy-loading 'flavor' on Instance uuid 37071ccd-9ec1-4443-8fbb-7060db749085 {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:36:57.417256 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-75e0a967-b7b0-4b12-ab38-a66ec40a5e18 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action" status: 202 len: 0 microversion: 2.1 time: 0.189072 Aug 30 19:36:57.417865 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3708/7562] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:36:57 2022] POST /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:36:57.424935 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:36:57.425739 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:36:57.426329 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:36:57.427112 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=50 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:36:57.433274 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:36:57.434024 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:36:57.444549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:57.445034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:57.445458 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:57.446154 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:57.446746 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:57.447168 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:57.585308 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:36:57.593227 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-00e2a7c4-6922-447d-b386-37a284f4f7a7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.170294 Aug 30 19:36:57.593808 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3855/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:36:57 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:36:58.621643 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:36:58.622777 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:36:58.639334 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:58.639836 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:58.640309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:58.641026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:58.641492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:58.641930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:58.642656 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36412. Aug 30 19:36:58.643373 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36410. Aug 30 19:36:58.786741 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:36:58.795276 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9ab27488-ecf6-427e-85b0-0fecb1e89c03 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.182633 Aug 30 19:36:58.795835 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3709/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:36:58 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:36:59.821547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:36:59.822761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:36:59.837078 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:59.837886 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:59.838665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:59.839518 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:36:59.839975 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:36:59.840401 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:36:59.847560 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36416. Aug 30 19:36:59.848265 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36418. Aug 30 19:36:59.991362 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:36:59.999944 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-9c129b26-2234-45b0-a734-ada1a3cbcf9b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.185183 Aug 30 19:37:00.000535 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3856/7565] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:36:59 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:01.025442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:01.026056 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:01.036861 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:01.037544 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:01.038173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:01.039254 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:01.039853 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:01.040451 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:01.180169 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:01.188746 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-97d83d79-4b65-4adc-a56d-46b47b6c224a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.169742 Aug 30 19:37:01.189328 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3710/7566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:01 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:02.210700 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:02.211287 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:02.218991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:02.219498 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:02.219927 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:02.220630 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:02.221089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:02.221520 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:02.365473 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:02.377331 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bf3567f5-4081-4435-878c-61d0b8360d63 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.170568 Aug 30 19:37:02.378112 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3857/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:02 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:03.402578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:03.403766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:03.411322 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:03.411825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:03.412284 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:03.413006 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:03.413485 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:03.413935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:03.553958 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:03.562453 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f30d6993-39be-4019-b82c-055bdbfca279 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.166155 Aug 30 19:37:03.563010 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3711/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:03 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:04.585708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:04.586497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:04.595591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:04.596202 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:04.596749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:04.597622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:04.598194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:04.598761 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:04.738007 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:04.749608 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-13ddb4fd-179c-4e53-b833-eaa5886c5579 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.168568 Aug 30 19:37:04.750397 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3858/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:04 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:05.776154 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:05.776742 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:05.784747 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:05.785245 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:05.785691 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:05.786425 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:05.786893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:05.787330 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:05.930724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:05.938878 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2891ee1f-e670-49cd-916a-8febac6d2b4b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.169445 Aug 30 19:37:05.939450 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3712/7570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:05 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:06.964532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:06.965680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:06.977805 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:06.978720 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:06.979680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:06.980848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:06.981662 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:06.982086 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:07.141615 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:07.153890 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b71c59fe-78c3-4071-bd7a-82743d55efad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.195943 Aug 30 19:37:07.154483 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3859/7571] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:06 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:08.175762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:08.176360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:08.183954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:08.184419 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:08.184878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:08.185913 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:08.186392 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:08.186867 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:08.341582 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:08.350050 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4270acce-5342-44f0-bd36-8f44d32ec301 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.178328 Aug 30 19:37:08.350677 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3713/7572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:08 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:09.374405 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:09.375132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:09.382983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:09.383527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:09.384011 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:09.384732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:09.385213 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:09.385658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:09.524918 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:09.534622 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-e34033fd-3db6-423a-854b-cc45bba51668 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.165468 Aug 30 19:37:09.535203 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3860/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:09 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:10.561505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:10.562301 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:10.569565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:10.570105 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:10.570638 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:10.571355 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:10.571825 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:10.572259 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:10.724200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:10.732549 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-4f66e43e-241a-4802-839f-87cb1f705d5a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.175040 Aug 30 19:37:10.733352 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3714/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:10 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:11.755861 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:11.756505 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:11.763629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:11.764109 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:11.764536 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:11.765360 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:11.765815 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:11.766264 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:11.910295 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:11.918889 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-571063da-cf19-401c-85ca-0aef691a0af6 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1565 microversion: 2.1 time: 0.167127 Aug 30 19:37:11.919827 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3861/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:11 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:11.940173 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:37:11.940789 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:11.948047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:11.948551 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:11.949001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:11.949719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:11.950195 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:11.950667 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:11.981725 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122590) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 19:37:12.055711 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6ba7e0d0-e8e9-413b-bcfb-42cd856e93fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "POST /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action" status: 202 len: 0 microversion: 2.1 time: 0.119478 Aug 30 19:37:12.056336 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3715/7576] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:37:11 2022] POST /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:37:12.065083 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:12.065689 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:12.071732 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:12.072220 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:12.072625 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:12.073347 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:12.073779 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:12.074194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:12.228241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:12.240247 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-464ddb0d-7395-4a3f-8d87-fe121766f02c tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1573 microversion: 2.1 time: 0.179339 Aug 30 19:37:12.240949 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3862/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:12 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:37:12.914793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "name": "network-vif-unplugged", "status": "completed", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:37:12.926689 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:12.927292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:12.927840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:12.943203 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.compute.server_external_events [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] Unable to find a host for instance 37071ccd-9ec1-4443-8fbb-7060db749085. Dropping event network-vif-unplugged {{(pid=122590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 19:37:12.944098 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-aebaed92-a3f7-4c3e-a1c8-d1af38da0ad0 req-0a2b2105-4eb5-447b-8422-9caa2601f530 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033911 Aug 30 19:37:12.944902 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3716/7578] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 19:37:13.263577 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:13.264134 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:13.273512 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:13.274150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:13.274852 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:13.275894 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:13.276556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:13.277048 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:13.423345 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:13.431612 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cff3dac0-b34c-4ffe-85d2-1b10f01ac09b tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1515 microversion: 2.1 time: 0.172050 Aug 30 19:37:13.432182 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3863/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:13 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:14.454002 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:14.454597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:14.462025 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:14.462556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:14.463012 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:14.463729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:14.464196 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:14.464634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:14.602150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:14.610371 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cf325407-4bbe-47bc-b7e6-45934fa37abd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1515 microversion: 2.1 time: 0.160687 Aug 30 19:37:14.610989 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3717/7580] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:14 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:15.631822 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:15.632460 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:15.639989 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:15.640488 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:15.640917 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:15.641712 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:15.642094 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:15.642554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:15.783680 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:15.791851 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-782183ee-d6e1-43a9-8262-1f131b5e2afa tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1515 microversion: 2.1 time: 0.164002 Aug 30 19:37:15.792679 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3864/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:15 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:16.813903 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:16.814503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:16.821960 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:16.822493 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:16.822956 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:16.823679 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:16.824153 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:16.824596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:16.965067 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:16.973821 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-782b2359-252b-470a-a334-83e3c8732daf tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1515 microversion: 2.1 time: 0.164154 Aug 30 19:37:16.974396 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3718/7582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:16 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:17.996233 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:17.996853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:18.004423 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:18.004916 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:18.005355 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:18.006084 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:18.006584 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:18.007006 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:18.154616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:18.162949 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3e3fb9e0-60f8-49ce-aeaa-3dec65d55ca8 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.171082 Aug 30 19:37:18.163539 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3865/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:17 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:19.185103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:19.185732 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:19.197136 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:19.197779 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:19.198684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:19.199803 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:19.200512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:19.201150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:19.364227 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:19.373311 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5d0ddaf-c17f-4cad-bce6-8d8716749108 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.192155 Aug 30 19:37:19.374148 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3719/7584] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:19 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:20.397780 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:20.398453 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:20.405783 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:20.406268 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:20.406731 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:20.407485 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:20.408013 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:20.408476 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:20.541169 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:20.550162 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-ec90ac76-f892-4cf6-8f67-4f75aff88358 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.156386 Aug 30 19:37:20.550793 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3866/7585] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:20 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:21.575268 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:21.576194 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:21.584833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:21.585337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:21.585784 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:21.586534 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:21.587013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:21.587448 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:21.736704 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:21.748709 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-28c60ecb-a376-4ca6-be5a-8c19da4a6ee9 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.179368 Aug 30 19:37:21.749639 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3720/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:21 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:22.775699 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:22.776651 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:22.788519 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:22.789337 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:22.790075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:22.791265 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:22.792023 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:22.792726 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:22.941966 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:22.951496 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-106890bb-8554-4907-a4e7-f45851e3bb42 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.182787 Aug 30 19:37:22.952279 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3867/7587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:22 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:23.975152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:23.975722 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:23.983249 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:23.983751 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:23.984193 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:23.984895 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:23.985359 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:23.985791 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:24.470446 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:24.483311 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-8cff7262-36b3-4f83-b311-8ec52c5a21ad tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.511889 Aug 30 19:37:24.484221 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3721/7588] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:23 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:25.509950 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:25.510843 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:25.520516 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:25.521049 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:25.521446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:25.522254 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:25.522640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:25.523046 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:25.662292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:25.674723 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-52c5b184-f144-474d-8617-6c2055e72bcc tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.170091 Aug 30 19:37:25.675553 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3868/7589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:25 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:26.697384 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:26.697954 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:26.705335 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:26.705840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:26.706291 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:26.707031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:26.707500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:26.708238 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:26.712508 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:37:26.855578 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:26.864671 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c96aee87-8117-4299-9c77-d6583ac57a45 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.171401 Aug 30 19:37:26.869965 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3722/7590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:26 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:27.890754 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:27.891763 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:27.895903 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=29 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:37:27.901637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:27.902040 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:27.902508 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:27.903209 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:27.903663 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:27.904087 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:27.906667 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=85 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:37:28.040532 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:28.052983 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bdcf5b41-34cf-44d7-9c6c-37004a666cc0 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.168799 Aug 30 19:37:28.053749 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3869/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:27 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:29.019690 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "name": "network-vif-plugged", "status": "completed", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:37:29.025316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:37:29.032405 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:29.033010 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:29.033581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:29.047957 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] Creating event network-vif-plugged:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:37:29.053324 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-2204e9d7-9fde-4dff-9872-2aca7d5c6d7a req-2506c219-59ef-413b-a7bd-ec2357fbfd84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Aug 30 19:37:29.053992 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3723/7592] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:37:29.079860 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:29.080527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:29.087613 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:29.088103 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:29.088553 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:29.089240 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:29.089801 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:29.090118 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:29.234487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:29.247378 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-21ee0432-b1f6-419e-b0de-abc47bbfe264 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1571 microversion: 2.1 time: 0.171477 Aug 30 19:37:29.248200 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3870/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:29 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:37:30.271186 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:37:30.271893 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:37:30.278309 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:30.278840 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:30.279285 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:30.279993 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:37:30.280456 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:37:30.280888 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:37:30.428734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:37:30.437013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0bb0c187-aaa1-4a93-9cd0-e108e7da09fd tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1558 microversion: 2.1 time: 0.171612 Aug 30 19:37:30.437592 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3724/7594] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:37:30 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:47.057282 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:38:47.057925 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:47.058314 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:47.059409 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:38:47.060324 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:38:47.061205 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=11 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:38:47.061368 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:38:47.061469 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 19:38:47.061961 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:38:47.062293 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 (ip 10.222.0.25) !!! Aug 30 19:38:47.064257 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:38:47.065872 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 (ip 10.222.0.25) !!! Aug 30 19:38:47.066930 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:38:47.067147 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 (ip 10.222.0.25) !!! Aug 30 19:38:47.088887 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:47.089475 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:47.089981 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:47.090841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:47.091378 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:47.091892 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:47.120621 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Going to try to terminate instance {{(pid=122589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:38:47.128065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:38:47.138684 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:47.139172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:47.139815 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:47.153316 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] Creating event network-changed:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:38:47.158860 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-ba0a77a9-1ea4-40ae-8bb2-a29083031698 req-3f01c3b3-6bfa-44a1-8f34-82a14d098020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103301 Aug 30 19:38:47.159994 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3725/7595] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:38:47.219027 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c3dc5e0a-a372-4098-a132-da7c6a37d2fb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "DELETE /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 204 len: 0 microversion: 2.1 time: 0.166503 Aug 30 19:38:47.224286 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3871/7596] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:38:47 2022] DELETE /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:38:47.229556 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:47.230276 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:47.236780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:47.237275 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:47.237719 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:47.238469 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:47.238931 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:47.239360 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:47.379506 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:47.387993 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2db86efe-0bf8-408b-a3c9-27f358eeea15 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.163526 Aug 30 19:38:47.388577 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3726/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:47 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:48.411259 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:48.412037 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:48.419624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:48.420110 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:48.420549 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:48.421262 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:48.421707 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:48.422119 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:48.557059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:48.565125 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-35a3b7fb-14d1-4f85-83de-84626eb22400 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1564 microversion: 2.1 time: 0.158246 Aug 30 19:38:48.565794 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3872/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:48 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:49.430015 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37071ccd-9ec1-4443-8fbb-7060db749085", "name": "network-vif-deleted", "tag": "489f073c-7f66-40de-bfbe-43ef38580014"}]} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:38:49.441137 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:49.441636 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:49.442087 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:49.454408 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.compute.server_external_events [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] Creating event network-vif-deleted:489f073c-7f66-40de-bfbe-43ef38580014 for instance 37071ccd-9ec1-4443-8fbb-7060db749085 on n-h2-854119-10 Aug 30 19:38:49.459965 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [req-0515548c-8319-41d6-91d4-bd837ab12356 req-83a25c18-542b-49c4-8039-5e03b7924362 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Aug 30 19:38:49.460570 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3727/7599] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:38:49.586724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:49.587328 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:49.594443 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:49.594922 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:49.595369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:49.596106 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:49.596556 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:49.596969 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:49.662833 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:49.671375 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-b0815cad-cec9-48f2-8ddc-31819353abf7 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1219 microversion: 2.1 time: 0.088771 Aug 30 19:38:49.671939 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3873/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:49 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:50.694183 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:50.694915 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:50.701801 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:50.702295 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:50.702782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:50.703500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:50.703971 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:50.704411 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:50.772378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:50.780945 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f81839c3-db2f-4ded-abc4-b4152c0be95a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1219 microversion: 2.1 time: 0.092135 Aug 30 19:38:50.781565 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3728/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:50 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:51.801767 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:51.802547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:51.810729 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:51.811219 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:51.811658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:51.812370 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:51.812827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:51.813251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:51.879491 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:51.887721 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2cb7aaff-4347-40e9-a1ab-9e88482dbe77 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1219 microversion: 2.1 time: 0.090002 Aug 30 19:38:51.888322 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3874/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:51 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:52.909417 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:52.910013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:52.918216 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:52.918753 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:52.919547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:52.920265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:52.920740 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:52.921177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:52.987804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:52.996646 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-216556f0-0aa3-4fcc-a9d5-d29b653fe04a tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1219 microversion: 2.1 time: 0.091274 Aug 30 19:38:52.997191 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3729/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:52 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:54.017551 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:54.018189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:54.027641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:54.028135 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:54.028571 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:54.029286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:54.029723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:54.030372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:54.064502 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:54.065026 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:54.065522 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:54.065974 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.objects.instance [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lazy-loading 'fault' on Instance uuid 37071ccd-9ec1-4443-8fbb-7060db749085 {{(pid=122589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:38:54.111881 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ea9134f3e648939da3c7fec14094cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feba750b8c0c440ba72b1207a0203fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:38:54.120111 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-56fd3177-cd98-4d14-9715-7d6de5b1fddb tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 200 len: 1224 microversion: 2.1 time: 0.106635 Aug 30 19:38:54.120682 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3875/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:54 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:38:55.141671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:55.142437 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] [instance: 37071ccd-9ec1-4443-8fbb-7060db749085] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:38:55.149854 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:55.150380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:55.150839 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:55.151552 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:38:55.152020 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:38:55.152498 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:38:55.166886 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.wsgi [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] HTTP exception thrown: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Request method failure captured: Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: request: GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 HTTP/1.1 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Accept: application/json Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Accept-Encoding: identity Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Connection: close Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Content-Length: 0 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Content-Type: application/json Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Host: 10.222.0.25 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: Openstack-System-Scope: None Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: User-Agent: python-urllib3/1.26.12 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Auth-Token: gAAAAABjDmU8Xx3WQ1hIb7JXH5r7D1sZDllAnjSIhu4_FLBvvKWUquzyY80Iz6HHtB491VhLjhIoStrDnDR9MIGjS_eMLfBzIDvuo0PBRUXcpiJIo2bT9jHtPHqJIxZ-NvgU66u8WXPB-mC8Gc0kNJb_ek7yrkEhU9-riOWceTyXmsm6cIKCQ1A Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Id: None Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Domain-Name: None Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Identity-Status: Confirmed Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Is-Admin-Project: True Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Id: default Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Domain-Name: Default Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Id: feba750b8c0c440ba72b1207a0203fac Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Project-Name: tempest-TestShelveInstance-2081262287 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Role: reader,member Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Roles: reader,member Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_feba750b8c0c440ba72b1207a0203fac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant: tempest-TestShelveInstance-2081262287 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Id: feba750b8c0c440ba72b1207a0203fac Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-Tenant-Name: tempest-TestShelveInstance-2081262287 Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-User: tempest-TestShelveInstance-2081262287-project Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Id: default Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-User-Domain-Name: Default Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-User-Id: 52ea9134f3e648939da3c7fec14094cf Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: X-User-Name: tempest-TestShelveInstance-2081262287-project Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: method: > Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: exception: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: action_args: {'id': '37071ccd-9ec1-4443-8fbb-7060db749085'} Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:38:55.168593 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: ERROR nova.api.openstack.wsgi Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Returning 404 to user: Instance 37071ccd-9ec1-4443-8fbb-7060db749085 could not be found. {{(pid=122590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-0fdfde21-2eb2-41b6-93e1-64f63c7f9c72 tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085" status: 404 len: 111 microversion: 2.1 time: 0.032954 Aug 30 19:38:55.174188 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3730/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:38:55 2022] GET /compute/v2.1/servers/37071ccd-9ec1-4443-8fbb-7060db749085 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:38:55.345081 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-47c85ff8-c1ca-4daa-9311-1990d6cf9fce tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] Calling method '.version_select at 0x7f4e5593cd30>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:38:55.383305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-47c85ff8-c1ca-4daa-9311-1990d6cf9fce tempest-TestShelveInstance-2081262287 tempest-TestShelveInstance-2081262287-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1308458774" status: 202 len: 0 microversion: 2.1 time: 0.042468 Aug 30 19:38:55.384085 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3876/7606] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 19:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1308458774 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 19:39:12.873797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=12 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:12.874848 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=24 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:13.055206 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-471d31a8-8333-4ae7-b3f2-354251dad875 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Action: 'create', calling method: .version_select at 0x7f4e559aaca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1293690818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuKKD9bk4WB/K3Sux+n9S5GRlAuq+rXbsP9jRbb5kh+gcUMH/oXj2RrOD0rh66BRBgZYTR64W3kxOOVuYQPfxqO4NLbWkRIhkl1K7jdiNvFoR9gzYXdf3pwqHa88ZugBQ=="}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:39:13.072054 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-471d31a8-8333-4ae7-b3f2-354251dad875 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for project a67f17c8e5374788a82f3a1e337144f9. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:39:13.077452 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-471d31a8-8333-4ae7-b3f2-354251dad875 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for user ba478e108e6b45c580ad8b95c15c4e9a and project a67f17c8e5374788a82f3a1e337144f9. Resources: {'key_pairs'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:39:13.108193 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-471d31a8-8333-4ae7-b3f2-354251dad875 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.240012 Aug 30 19:39:13.109061 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3731/7607] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 19:39:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:39:14.211521 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:14.212446 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:14.216840 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-311698366", "imageRef": "56ee09fc-3dcc-4737-853e-2c27d4afd292", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1293690818", "security_groups": [{"name": "tempest-secgroup-smoke-351649120"}], "networks": [{"uuid": "b41df2b5-591e-459d-b999-95808beee596"}]}} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:39:14.328591 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.network.neutron [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] validate_networks() for [('b41df2b5-591e-459d-b999-95808beee596', None, None, None, None, None)] {{(pid=122589) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:39:14.750248 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Flavor limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:39:14.750718 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Image limits 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:39:14.751223 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Flavor pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:39:14.751638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Image pref 0:0:0 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:39:14.752051 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.virt.hardware [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:39:14.761985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:14.762637 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:14.763167 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:14.763979 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:14.764499 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:14.765016 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:14.784291 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for project a67f17c8e5374788a82f3a1e337144f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:39:14.790090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.quota [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for user ba478e108e6b45c580ad8b95c15c4e9a and project a67f17c8e5374788a82f3a1e337144f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:39:14.804105 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Going to run 1 instances... {{(pid=122589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:39:14.806721 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56ee09fc-3dcc-4737-853e-2c27d4afd292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:39:14.858305 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-82bbb17e-a552-4227-afd1-19985e3406cb tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.648845 Aug 30 19:39:14.859181 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3877/7608] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:39:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:39:14.872027 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c89f4f7d-5bf3-4e8b-b15f-f33cb0a94ff9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:14.873500 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c89f4f7d-5bf3-4e8b-b15f-f33cb0a94ff9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:14.945514 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c89f4f7d-5bf3-4e8b-b15f-f33cb0a94ff9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:14.954535 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c89f4f7d-5bf3-4e8b-b15f-f33cb0a94ff9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1248 microversion: 2.1 time: 0.087775 Aug 30 19:39:14.959828 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3732/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:14 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:15.979391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:15.979990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:15.986639 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:15.987133 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:15.987576 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:15.988283 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:15.988744 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:15.989176 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:16.055315 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:16.063452 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d1b9d551-6f24-47b5-b68f-60cd93542d24 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1300 microversion: 2.1 time: 0.090173 Aug 30 19:39:16.064039 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3878/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:15 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:17.088453 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:17.089264 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:17.100051 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:17.100963 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:17.101652 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:17.102666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:17.103620 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:17.104316 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:17.272878 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:17.287055 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-dba256ce-92f1-495b-8ec8-df44a02de492 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1373 microversion: 2.1 time: 0.203641 Aug 30 19:39:17.288055 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3733/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:17 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:17.711554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:39:17.722371 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:17.722985 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:17.723477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:17.741609 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] Creating event network-changed:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:39:17.747969 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-8aa658ee-c609-4fd9-b6a7-3873ecca37c9 req-661b53be-e12d-4af8-87a4-776b51b6b66a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042623 Aug 30 19:39:17.749169 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3879/7612] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:39:18.308835 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:18.309598 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:18.317111 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:18.317609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:18.318060 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:18.318800 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:18.319269 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:18.319709 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:18.460908 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:18.469372 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e3dc9499-9f75-4fa2-a7c1-a9632ae8d6b7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1373 microversion: 2.1 time: 0.164526 Aug 30 19:39:18.470088 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3734/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:18 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:19.492000 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:19.493241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:19.506486 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:19.506990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:19.507432 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:19.508156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:19.508819 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:19.509253 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:19.908089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:19.916309 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-3794203b-9b71-483a-8069-2eda580647a4 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1373 microversion: 2.1 time: 0.429680 Aug 30 19:39:19.916871 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3880/7614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:19 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1373 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:39:20.941492 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:20.942782 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:20.955135 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:20.955973 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:20.956728 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:20.957929 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:20.958778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:20.959518 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:21.154368 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:21.162360 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-c48f94e5-6ea0-4ba2-87f2-468ddf82a7ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1373 microversion: 2.1 time: 0.227534 Aug 30 19:39:21.162949 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3735/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:20 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:21.552227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "name": "network-vif-plugged", "status": "completed", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:39:21.565685 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:21.566148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:21.566633 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:21.890144 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] Creating event network-vif-plugged:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:39:21.897543 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-d2aed743-fc22-4931-902a-f429990cfbbb req-a98e9932-2e53-4920-8203-66df1cc2b0c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412612 Aug 30 19:39:21.898186 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3881/7616] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:39:22.185283 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:22.185871 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:22.193714 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:22.194226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:22.194724 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:22.195458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:22.195933 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:22.196381 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:22.353746 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:22.366265 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-fd8b3e0c-2f90-427a-8555-7cc484cd234f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1373 microversion: 2.1 time: 0.185793 Aug 30 19:39:22.366904 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3736/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:22 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:23.390034 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:23.390749 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:23.397550 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:23.398059 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:23.398640 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:23.399349 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:23.399846 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:23.400251 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:23.544792 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:23.553392 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-f35605aa-0cd7-4f80-a168-a41a97d53f2d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1556 microversion: 2.1 time: 0.168942 Aug 30 19:39:23.553970 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3882/7618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:23 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:23.577432 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:39:23.578029 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:39:23.586063 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:23.587265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:23.587729 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:23.589152 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:23.589631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:23.590075 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:23.743936 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:39:23.752152 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-639319ce-812c-4b26-8027-43980e07af34 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1556 microversion: 2.1 time: 0.178705 Aug 30 19:39:23.752722 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3737/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:39:23 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:39:25.881666 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:39:25.887665 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:25.888487 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=6 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:39:25.896038 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:39:25.896542 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:39:25.896976 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:39:25.908787 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] Creating event network-changed:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:39:25.914473 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-21cf0cb3-5d2c-4129-9715-42d5153d1109 req-600ec7a4-4858-4835-a0f7-373405fcc266 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036473 Aug 30 19:39:25.917069 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3883/7620] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:41:21.252048 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:41:21.253051 n-d-854119-10 devstack@n-api.service[122590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 19:41:21.253442 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:21.254473 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:21.255039 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=30 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:21.256227 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 19:41:21.256381 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb/action (ip 10.222.0.25) !!! Aug 30 19:41:21.257852 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:41:21.258011 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb/action (ip 10.222.0.25) !!! Aug 30 19:41:21.272118 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-123149298"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:21.274628 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:21.284609 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:21.285151 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:21.285613 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:21.286337 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:21.286841 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:21.287292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:21.510429 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7b2efd1d-c49e-429b-90cd-32eeb53f5286 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "POST /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb/action" status: 202 len: 0 microversion: 2.1 time: 0.262146 Aug 30 19:41:21.511082 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3738/7621] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:41:21 2022] POST /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 19:41:27.928348 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:41:27.931419 n-d-854119-10 devstack@n-api.service[122589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 19:41:27.934403 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:27.936456 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=26 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:27.954425 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "name": "network-vif-plugged", "status": "completed", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:27.997320 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:27.998227 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:27.998928 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:28.016917 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] Creating event network-vif-plugged:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:41:28.022460 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-0717eabb-e7bf-4bec-8509-0d54c6b7b144 req-cd38750c-e369-457c-923e-cc6d3e42eea1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096942 Aug 30 19:41:28.027193 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3884/7622] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:41:35.100538 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:35.101344 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:35.108615 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1292723985", "imageRef": "b4b839c9-8401-4fd9-bcf3-118523a1ee63", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1293690818", "security_groups": [{"name": "tempest-secgroup-smoke-351649120"}], "networks": [{"uuid": "b41df2b5-591e-459d-b999-95808beee596"}]}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:35.134120 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [e590d495-d9ae-4b31-aaa0-b298c847220a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36910. Aug 30 19:41:35.136008 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e6183d1-04bd-45f1-8b43-63762eb3fd4f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36908. Aug 30 19:41:35.227856 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.network.neutron [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] validate_networks() for [('b41df2b5-591e-459d-b999-95808beee596', None, None, None, None, None)] {{(pid=122590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 19:41:35.686410 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Flavor limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 19:41:35.687046 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Image limits 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 19:41:35.687755 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Flavor pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 19:41:35.688365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Image pref 0:0:0 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 19:41:35.689019 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.virt.hardware [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 19:41:35.699581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:35.700080 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:35.700528 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:35.701270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:35.701734 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:35.702174 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:35.719750 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for project a67f17c8e5374788a82f3a1e337144f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 19:41:35.725701 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.quota [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Getting quotas for user ba478e108e6b45c580ad8b95c15c4e9a and project a67f17c8e5374788a82f3a1e337144f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 19:41:35.739265 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Going to run 1 instances... {{(pid=122590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 19:41:35.741804 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4b839c9-8401-4fd9-bcf3-118523a1ee63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 19:41:35.797486 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-f0ddb983-692b-4845-8943-d10fac44328d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699054 Aug 30 19:41:35.798184 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3739/7623] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 19:41:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 19:41:35.813804 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-a4919179-1c25-4111-8692-8cafeab9f6d7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:35.815070 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-a4919179-1c25-4111-8692-8cafeab9f6d7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:35.830675 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e63ebd-27cf-43b8-8494-f6a7a30ad380] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36928. Aug 30 19:41:35.831934 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] [635d304c-c631-42f9-bdde-4f009f43a22f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36926. Aug 30 19:41:35.886622 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-a4919179-1c25-4111-8692-8cafeab9f6d7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:35.894377 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-a4919179-1c25-4111-8692-8cafeab9f6d7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1249 microversion: 2.1 time: 0.088579 Aug 30 19:41:35.894945 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3885/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:35 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:36.916775 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:36.919047 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:36.926898 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:36.927390 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:36.927865 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:36.928876 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:36.929406 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:36.929918 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:37.024102 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:37.033598 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-300e8222-0e87-41b5-8848-db0a302b9987 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1309 microversion: 2.1 time: 0.121437 Aug 30 19:41:37.034280 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3740/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:36 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:38.057444 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:38.058194 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:38.061151 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:38.075991 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:38.076724 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:38.077241 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:38.078326 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:38.079300 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:38.080132 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:38.240945 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:38.248911 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d6fc33a5-fb13-42fe-a02b-e47363471567 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.195467 Aug 30 19:41:38.249492 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3886/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:38 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:39.271509 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:39.272145 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:39.280031 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:39.280626 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:39.281078 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:39.281802 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:39.282270 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:39.282686 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:39.435103 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:39.444013 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-7888cb1e-6b83-4079-9ca7-40dddbda0b9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.176753 Aug 30 19:41:39.444614 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3741/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:39 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:39.906641 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "name": "network-vif-unplugged", "status": "completed", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:39.918330 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:39.919527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:39.919751 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:39.933214 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] Creating event network-vif-unplugged:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:41:39.939013 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e2a3f569-c14c-4127-a0d1-7c197b0f1eca req-85ff1f8f-0906-49df-9f63-841dc37d2366 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036336 Aug 30 19:41:39.940576 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3887/7628] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:41:40.466089 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:40.467624 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:40.475580 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:40.476172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:40.476715 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:40.477547 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:40.478079 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:40.478634 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:40.631510 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:40.651950 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b641556a-9adb-4850-b8c8-ae12094cfd88 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.189102 Aug 30 19:41:40.652834 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3742/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:40 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:41.675545 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:41.676244 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:41.683614 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:41.684111 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:41.684547 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:41.685263 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:41.685719 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:41.686148 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:41.829693 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:41.838198 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-411df562-1490-4310-b282-7cda02e28d20 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.167955 Aug 30 19:41:41.839027 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3888/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:41 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:42.861555 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:42.862386 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:42.871769 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:42.872287 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:42.872736 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:42.873512 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:42.874112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:42.874568 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:43.016505 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:43.025309 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-a5e24bd5-33a2-4c04-bb4e-7db0c151a3ed tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.169374 Aug 30 19:41:43.025892 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3743/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:42 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:44.045561 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:44.046286 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:44.053748 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:44.054276 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:44.054752 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:44.055477 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:44.055942 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:44.056568 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:44.202580 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:44.211899 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-bb9bdcc5-0b89-4271-bb58-00277c7946b1 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.170602 Aug 30 19:41:44.213237 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3889/7632] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:44 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:45.237764 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:45.238855 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:45.251373 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:45.252200 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:45.252992 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:45.254176 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:45.255013 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:45.255797 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:45.460286 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:45.470031 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-cb120a48-8ca3-4765-9f69-ea1c116e43c3 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.238955 Aug 30 19:41:45.470731 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3744/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:45 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:45.992130 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:46.000563 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell0:SELECT=2 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:46.009292 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:46.010089 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:46.010548 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:46.022996 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] Creating event network-changed:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:41:46.028229 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-e31dc2fc-8c6e-40aa-9a23-7b3635667acb req-c2e8279a-98da-4e95-84d1-f96f6829aae1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040976 Aug 30 19:41:46.029149 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3890/7634] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:41:46.491997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:46.492595 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:46.494581 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:46.495281 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell0:SELECT=6 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:41:46.502034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:46.502564 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:46.503021 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:46.503739 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:46.504209 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:46.504651 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:46.647648 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:46.655667 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b5314a59-8f08-48b6-9b51-bb1a18b46c16 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.167908 Aug 30 19:41:46.656277 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3745/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:46 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:47.677799 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:47.678497 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:47.686069 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:47.686638 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:47.687075 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:47.687785 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:47.688243 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:47.688671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:47.821420 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:47.829904 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d7c464b7-8b65-4c23-90d6-81fd95fbeac9 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.156612 Aug 30 19:41:47.830552 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3891/7636] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:47 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:48.855671 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:48.856768 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:48.867497 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:48.867997 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:48.868447 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:48.869164 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:48.869631 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:48.870065 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:49.011604 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:49.023739 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-1dad825a-7f5f-4b97-9579-cc28884e953f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.174479 Aug 30 19:41:49.024612 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3746/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:48 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:50.045929 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:50.046624 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:50.054158 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:50.054841 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:50.055304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:50.056036 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:50.056527 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:50.056998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:50.197946 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:50.206721 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-05c4fbe9-5e9c-4703-8be5-562fd338ceca tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.165130 Aug 30 19:41:50.207323 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3892/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:50 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:51.230093 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:51.230730 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:51.238243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:51.238796 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:51.239247 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:51.240001 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:51.240472 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:51.240919 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:51.383380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:51.391702 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-b49c5f09-e7d4-4d1f-a1cc-f687c7e2e9f5 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.166449 Aug 30 19:41:51.392295 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3747/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:51 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:51.645554 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "name": "network-vif-plugged", "status": "completed", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:51.658189 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:51.658717 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:51.659150 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:51.671791 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] Creating event network-vif-plugged:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:41:51.676978 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-068e503e-8fa8-4a7d-b72d-c229d5668503 req-90c80eb9-896c-45fa-bb3b-e963d8f7a004 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Aug 30 19:41:51.677556 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3893/7640] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:41:52.417110 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:52.418127 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:52.429663 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:52.430481 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:52.430953 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:52.431673 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:52.432150 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:52.432593 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:52.584571 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:52.593036 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-2f6a9939-b631-4505-8f37-dce01ecdd78b tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1374 microversion: 2.1 time: 0.182910 Aug 30 19:41:52.593625 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3748/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:52 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:53.619793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:53.620629 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:53.631222 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:53.631908 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:53.632605 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:53.633331 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:53.633791 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:53.634217 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:53.773560 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:53.781981 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-c5550dd5-a3d5-4917-b031-10fb5dfb6a25 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1558 microversion: 2.1 time: 0.170294 Aug 30 19:41:53.782599 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3894/7642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:53 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:53.803226 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:41:53.803852 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:41:53.811762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:53.812197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:53.812654 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:53.813364 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:53.814177 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:53.814666 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:53.949846 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:41:53.957894 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-82b5cc92-6c3f-481e-b6c5-e656f9ff39dc tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1558 microversion: 2.1 time: 0.158700 Aug 30 19:41:53.958493 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3749/7643] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:41:53 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:41:55.589182 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:41:55.601271 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:41:55.601848 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:41:55.602277 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:41:55.614820 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] Creating event network-changed:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:41:55.620207 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7e96d30f-e7d9-470b-8f91-9218b43402d5 req-d7ea2ea3-4e30-436c-ae0d-310c15d367e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035696 Aug 30 19:41:55.620862 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3895/7644] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:22.881981 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:22.882778 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=62 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:22.883922 n-d-854119-10 devstack@n-api.service[122590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:43:22.884069 n-d-854119-10 devstack@n-api.service[122590]: Tue Aug 30 19:43:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff/action (ip 10.222.0.25) !!! Aug 30 19:43:22.890999 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-196000542"}} {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:22.893441 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:22.905340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:22.905896 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:22.906427 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:22.907197 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:22.907703 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:22.908182 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:23.121381 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9554ac77-6979-4a0d-a6b8-8d54bd294220 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "POST /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff/action" status: 202 len: 0 microversion: 2.1 time: 0.240827 Aug 30 19:43:23.122433 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3750/7645] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 19:43:22 2022] POST /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 19:43:28.213827 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_api:SELECT=26 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:28.214983 n-d-854119-10 devstack@n-api.service[122589]: DEBUG dbcounter [-] [122589] Writing DB stats nova_cell1:SELECT=44 {{(pid=122589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:28.216452 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:43:28.216787 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 19:43:28.218044 n-d-854119-10 devstack@n-api.service[122589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 19:43:28.218314 n-d-854119-10 devstack@n-api.service[122589]: Tue Aug 30 19:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 19:43:28.225538 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "name": "network-vif-plugged", "status": "completed", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:28.241174 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:28.241880 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:28.242579 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:28.257850 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] Creating event network-vif-plugged:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:43:28.263434 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-54a7fabc-d69e-4ccc-ae53-85c5f229baa5 req-f44b3730-be9e-46bf-aa42-6c74fcaa74a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052501 Aug 30 19:43:28.264843 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3896/7646] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:36.895292 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_api:SELECT=2 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:36.896503 n-d-854119-10 devstack@n-api.service[122590]: DEBUG dbcounter [-] [122590] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 19:43:36.900228 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:36.900757 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:36.901172 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:36.907969 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:36.908476 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:36.908930 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:36.909655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:36.910132 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:36.910597 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:36.912341 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:36.912910 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:36.913616 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:36.928703 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] Creating event network-changed:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:43:36.935173 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-3953a344-eef7-4ff2-88d4-7cbd0f56dda2 req-22d9da19-25c5-48fd-a51c-aa2124a93d94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039481 Aug 30 19:43:36.936166 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3897/7647] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:36.941553 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:43:37.045282 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9d6765c6-ced9-45d2-a8e6-b7d924ff1824 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 204 len: 0 microversion: 2.1 time: 0.152061 Aug 30 19:43:37.045883 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3751/7648] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:43:36 2022] DELETE /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:43:37.054998 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:37.055696 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:37.062127 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:37.062658 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:37.063092 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:37.063793 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:37.064415 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:37.064990 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:37.199659 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:37.208242 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-d96818e6-8830-495f-bf31-83cf00e308c6 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1683 microversion: 2.1 time: 0.157583 Aug 30 19:43:37.208800 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3898/7649] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:37 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 19:43:38.236074 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:38.237243 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:38.247711 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:38.248218 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:38.248655 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:38.249365 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:38.249824 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:38.250258 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:38.428099 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:38.436415 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-80530b6f-f502-44cb-82b2-d0cbdca91eb7 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1683 microversion: 2.1 time: 0.207632 Aug 30 19:43:38.437018 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3752/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:38 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:43:39.086959 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c27064-7bad-47ef-90e9-9c93a9c9daff", "name": "network-vif-deleted", "tag": "0cd38c43-269c-40bd-8eed-767740552196"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:39.099671 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:39.100063 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:39.100501 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:39.112839 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] Creating event network-vif-deleted:0cd38c43-269c-40bd-8eed-767740552196 for instance 80c27064-7bad-47ef-90e9-9c93a9c9daff on n-h1-854119-10 Aug 30 19:43:39.118293 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-7e810f0f-91ad-484d-9282-e8f1c30aa65a req-ed0e93ac-608a-4d49-9552-7db27aed9c61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Aug 30 19:43:39.118960 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3899/7651] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:39.457951 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:39.458596 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:39.466519 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:39.467290 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:39.467927 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:39.468833 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:39.469458 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:39.470780 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:39.508941 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:39.509574 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:39.510271 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:39.511034 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lazy-loading 'fault' on Instance uuid 80c27064-7bad-47ef-90e9-9c93a9c9daff {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:43:39.555090 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:39.563447 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-e080518a-9ba1-4a37-8711-58f70fadd36f tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 200 len: 1339 microversion: 2.1 time: 0.109519 Aug 30 19:43:39.564162 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3753/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:39 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:43:40.592369 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:40.593348 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: 80c27064-7bad-47ef-90e9-9c93a9c9daff] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:40.604210 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:40.605001 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:40.605774 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:40.606492 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:40.606951 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:40.607372 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:40.620941 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] HTTP exception thrown: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Request method failure captured: Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff HTTP/1.1 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmdcQHvyUT7wnMO7UdbhEUTFxdOH-N75Ee7LzVM8bWg-soVour4XI3C38IP-AnoN-ol4D54A1S_3uFznoW6xMWWKuPDAc0ncmdEwd0_XECt3UmSA9OLWT-d2uw8VUjWhUa5y63GRpU007PhpX4UTw2HvJiUyjar55WaOXTmjzo3w5R8 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: a67f17c8e5374788a82f3a1e337144f9 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: a67f17c8e5374788a82f3a1e337144f9 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestSnapshotPattern-1046880751-project Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ba478e108e6b45c580ad8b95c15c4e9a Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestSnapshotPattern-1046880751-project Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': '80c27064-7bad-47ef-90e9-9c93a9c9daff'} Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:43:40.622704 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Returning 404 to user: Instance 80c27064-7bad-47ef-90e9-9c93a9c9daff could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-2da55b88-c76d-49b7-9d0b-756b1f9dbd9d tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff" status: 404 len: 111 microversion: 2.1 time: 0.041347 Aug 30 19:43:40.628304 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3900/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:40 2022] GET /compute/v2.1/servers/80c27064-7bad-47ef-90e9-9c93a9c9daff => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:43:42.086041 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:42.086625 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:42.088181 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:42.094187 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:42.094924 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:42.095380 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:42.096293 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:42.096935 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:42.097378 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:42.099391 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:42.099914 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:42.100602 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:42.112303 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] Creating event network-changed:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:43:42.117655 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-feedda83-7b87-4cbf-a0a6-85586a705532 req-d416cc5b-c148-4ee6-b65f-8089030e2a1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Aug 30 19:43:42.118853 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3901/7654] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:42.126766 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Going to try to terminate instance {{(pid=122590) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 19:43:42.220749 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-6a475983-25ad-4ea4-8484-c26c49a1e783 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 204 len: 0 microversion: 2.1 time: 0.137863 Aug 30 19:43:42.222142 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3754/7655] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 19:43:42 2022] DELETE /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 19:43:42.230828 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:42.231723 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:42.238429 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:42.239005 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:42.239507 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:42.240288 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:42.240812 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:42.241305 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:42.406076 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.policy [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:42.414170 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-cdfd1e85-c87a-4bbb-b0f0-c877dcb424ba tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1681 microversion: 2.1 time: 0.187541 Aug 30 19:43:42.414947 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3902/7656] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:42 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:43:43.437134 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:43.437983 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:43.445148 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:43.445678 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:43.446112 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:43.446862 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:43.447340 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:43.447793 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:43.589026 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:43.597685 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-d65e0eb3-f7ad-46ee-9afd-6a14ee11a123 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1681 microversion: 2.1 time: 0.164979 Aug 30 19:43:43.598278 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3755/7657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:43 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:43:44.399022 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a5177-4381-4898-8862-cc1ea5cecccb", "name": "network-vif-deleted", "tag": "5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e"}]} {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 19:43:44.411126 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:44.411612 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:44.412102 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:44.423908 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.compute.server_external_events [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] Creating event network-vif-deleted:5ff7dffb-d0cb-44cd-9454-0aa5a1d86b0e for instance b69a5177-4381-4898-8862-cc1ea5cecccb on n-h2-854119-10 Aug 30 19:43:44.429141 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [req-a35c1926-7c25-430b-99bb-f912bf056826 req-5edeae3c-6776-46e5-8777-6ab30393a35d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Aug 30 19:43:44.429760 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3903/7658] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 19:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 19:43:44.619376 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:44.620016 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.compute.api [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122590) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:44.627253 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:44.627762 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:44.628225 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:44.628944 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:44.629415 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:44.629845 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:44.661916 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:44.662565 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:44.662932 n-d-854119-10 devstack@n-api.service[122590]: DEBUG oslo_concurrency.lockutils [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:44.663352 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.objects.instance [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lazy-loading 'fault' on Instance uuid b69a5177-4381-4898-8862-cc1ea5cecccb {{(pid=122590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 19:43:44.718471 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.policy [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba478e108e6b45c580ad8b95c15c4e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f17c8e5374788a82f3a1e337144f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122590) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 19:43:44.726929 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-5d8bcd62-f452-43fa-bf53-3454edde6988 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 200 len: 1338 microversion: 2.1 time: 0.111781 Aug 30 19:43:44.727512 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3756/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:44 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 19:43:45.754853 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '>' {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:45.755872 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.compute.api [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] [instance: b69a5177-4381-4898-8862-cc1ea5cecccb] Fetching instance by UUID {{(pid=122589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 19:43:45.765156 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:45.765648 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:45.766090 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:45.766821 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Acquiring lock "19fe4607-648e-4217-8aee-38dd51fd27c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 19:43:45.767275 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 19:43:45.767708 n-d-854119-10 devstack@n-api.service[122589]: DEBUG oslo_concurrency.lockutils [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Lock "19fe4607-648e-4217-8aee-38dd51fd27c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 19:43:45.781513 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.wsgi [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] HTTP exception thrown: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Request method failure captured: Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: request: GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb HTTP/1.1 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Accept: application/json Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Accept-Encoding: identity Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Connection: close Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Content-Length: 0 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Content-Type: application/json Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Host: 10.222.0.25 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: Openstack-System-Scope: None Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: User-Agent: python-urllib3/1.26.12 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Auth-Token: gAAAAABjDmdcQHvyUT7wnMO7UdbhEUTFxdOH-N75Ee7LzVM8bWg-soVour4XI3C38IP-AnoN-ol4D54A1S_3uFznoW6xMWWKuPDAc0ncmdEwd0_XECt3UmSA9OLWT-d2uw8VUjWhUa5y63GRpU007PhpX4UTw2HvJiUyjar55WaOXTmjzo3w5R8 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Id: None Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Domain-Name: None Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Identity-Status: Confirmed Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Is-Admin-Project: True Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Id: default Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Domain-Name: Default Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Id: a67f17c8e5374788a82f3a1e337144f9 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Project-Name: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Role: reader,member Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Roles: reader,member Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a67f17c8e5374788a82f3a1e337144f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Id: a67f17c8e5374788a82f3a1e337144f9 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-Tenant-Name: tempest-TestSnapshotPattern-1046880751 Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-User: tempest-TestSnapshotPattern-1046880751-project Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Id: default Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Domain-Name: Default Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Id: ba478e108e6b45c580ad8b95c15c4e9a Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: X-User-Name: tempest-TestSnapshotPattern-1046880751-project Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: method: > Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: exception: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: action_args: {'id': 'b69a5177-4381-4898-8862-cc1ea5cecccb'} Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: {{(pid=122589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 19:43:45.783207 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: ERROR nova.api.openstack.wsgi Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: DEBUG nova.api.openstack.wsgi [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Returning 404 to user: Instance b69a5177-4381-4898-8862-cc1ea5cecccb could not be found. {{(pid=122589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: INFO nova.api.openstack.requestlog [None req-616950db-7e4e-492a-9d53-3f534f50cf85 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb" status: 404 len: 111 microversion: 2.1 time: 0.038651 Aug 30 19:43:45.791225 n-d-854119-10 devstack@n-api.service[122589]: [pid: 122589|app: 0|req: 3904/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 19:43:45 2022] GET /compute/v2.1/servers/b69a5177-4381-4898-8862-cc1ea5cecccb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 19:43:46.240942 n-d-854119-10 devstack@n-api.service[122590]: DEBUG nova.api.openstack.wsgi [None req-9098f997-2fb4-49bc-9b70-0ff9fee7d218 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] Calling method '.version_select at 0x7f4e566f3700>' {{(pid=122590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 19:43:46.274688 n-d-854119-10 devstack@n-api.service[122590]: INFO nova.api.openstack.requestlog [None req-9098f997-2fb4-49bc-9b70-0ff9fee7d218 tempest-TestSnapshotPattern-1046880751 tempest-TestSnapshotPattern-1046880751-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1293690818" status: 202 len: 0 microversion: 2.1 time: 0.037524 Aug 30 19:43:46.275284 n-d-854119-10 devstack@n-api.service[122590]: [pid: 122590|app: 0|req: 3757/7661] 10.222.0.25 () {58 vars in 1257 bytes} [Tue Aug 30 19:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1293690818 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)